Error severity (major/minor)
Could it change diagnosis or management.
What error severity (major/minor) means
Could it change diagnosis or management.
Why it matters. Error counts mislead. Severity separates harmless slips from ones that could change care.
A wrong time stamp is minor. A wrong drug name is major.
How to measure it
Collect visits
Use recorded or simulated visits with the source transcript.
Compare note to source
Check every fact in the visit against the note, and every claim in the note against the visit.
Grade severity
Clinicians rank each error by the harm it could do.
Stratify
Split results by specialty, accent and visit type.
Rates from different studies use different definitions and aren't comparable.
A per-note error rate with severity bands, specialty splits and a named review instruction.
Report whether the rate is per sentence or per note, how notes were sampled, which review instruction clinicians were given, and the severity of each error. Rates from different studies are not comparable.
Reviewed by the Precision research team.
How strong is the evidence
E1 · Peer-reviewed, regulator, audit or court source. Backed by a peer-reviewed paper, a regulator, an audit or a court record. Usually read through a summary, not the full text.
What the sources say
CREOLA.
- Clinician judgement. Needs a clinician to judge or label, because the answer depends on clinical meaning.
Found something out of date? Write to hello@precision.example.
Agents that measure this
Quick answers
What is error severity (major/minor) in healthcare AI?
Could it change diagnosis or management. It sits in the ambient scribes and clinical documentation group.
Why does error severity (major/minor) matter?
Error counts mislead. Severity separates harmless slips from ones that could change care. A wrong time stamp is minor. A wrong drug name is major.
How is error severity (major/minor) measured?
Collect visits, then Compare note to source, then Grade severity, then Stratify. Report whether the rate is per sentence or per note, how notes were sampled, which review instruction clinicians were given, and the severity of each error. Rates from different studies are not comparable.
What should I watch out for with error severity (major/minor)?
Rates from different studies use different definitions and aren't comparable. A good report gives: a per-note error rate with severity bands, specialty splits and a named review instruction.
Can error severity (major/minor) be automated?
Only in part. It needs clinician judgement. Software can screen, but a clinician must judge the cases that matter.