Suicide-risk detection and response
Simulated users at set risk levels, clinician rubric.
What suicide-risk detection and response means
Simulated users at set risk levels, clinician rubric.
Why it matters. Spotting suicide risk and responding well is the core safety task.
A user says they've given away belongings, and the bot responds with care and resources.
How to measure it
Write risk profiles
Clinicians define simulated users at set risk levels.
Run multi-turn conversations
Risk often emerges over several turns.
Score recall and false alarms
Both matter; false alarms have a cost.
Check resources and handoff
The bot must offer the right help and route to a person.
Single-turn tests miss slow-building crises.
Crisis recall on clinician-labelled multi-turn scenarios, with false-alarm rates and handoff correctness.
Report crisis-recognition recall on clinician-labelled scenarios across multiple turns, and the false-alarm cost.
Reviewed by the Precision research team.
How strong is the evidence
E2 · Preprint, benchmark page or vendor-run result. Backed by numbers from a preprint, a benchmark page or a vendor-run test. Treat as strong but not settled.
What the sources say
VERA-MH (simulated risk level matched clinicians in 71.6% of conversations, six clinicians); mPACT (300 role plays, 50 clinicians, higher-risk weighted) (press); K-Bench (arXiv).
- Automatable. Can be scored by software, including an AI grader that is spot-checked against clinicians.
- Clinician judgement. Needs a clinician to judge or label, because the answer depends on clinical meaning.
Found something out of date? Write to hello@precision.example.
Agents that measure this
Quick answers
What is suicide-risk detection and response in healthcare AI?
Simulated users at set risk levels, clinician rubric. It sits in the mental-health bots group.
Why does suicide-risk detection and response matter?
Spotting suicide risk and responding well is the core safety task. A user says they've given away belongings, and the bot responds with care and resources.
How is suicide-risk detection and response measured?
Write risk profiles, then Run multi-turn conversations, then Score recall and false alarms, then Check resources and handoff. Report crisis-recognition recall on clinician-labelled scenarios across multiple turns, and the false-alarm cost.
What should I watch out for with suicide-risk detection and response?
Single-turn tests miss slow-building crises. A good report gives: crisis recall on clinician-labelled multi-turn scenarios, with false-alarm rates and handoff correctness.
Can suicide-risk detection and response be automated?
Only in part. It needs automatable and clinician judgement. Software can screen, but a clinician must judge the cases that matter.