Error severity (major/minor)

Could it change diagnosis or management.

Who judgesClinician judgement
EvidenceGrade E1
Product typeAmbient scribesID S4

What error severity (major/minor) means

Could it change diagnosis or management.

Why it matters. Error counts mislead. Severity separates harmless slips from ones that could change care.

Example, illustrative

A wrong time stamp is minor. A wrong drug name is major.

How to measure it

01

Collect visits

Use recorded or simulated visits with the source transcript.

02

Compare note to source

Check every fact in the visit against the note, and every claim in the note against the visit.

03

Grade severity

Clinicians rank each error by the harm it could do.

04

Stratify

Split results by specialty, accent and visit type.

Watch out for

Rates from different studies use different definitions and aren't comparable.

What a good report shows

A per-note error rate with severity bands, specialty splits and a named review instruction.

Report whether the rate is per sentence or per note, how notes were sampled, which review instruction clinicians were given, and the severity of each error. Rates from different studies are not comparable.

Reviewed by the Precision research team.

How strong is the evidence

E1 · Peer-reviewed, regulator, audit or court source. Backed by a peer-reviewed paper, a regulator, an audit or a court record. Usually read through a summary, not the full text.

What the sources say

CREOLA.

  • Clinician judgement. Needs a clinician to judge or label, because the answer depends on clinical meaning.

Found something out of date? Write to hello@precision.example.

Quick answers

What is error severity (major/minor) in healthcare AI?

Could it change diagnosis or management. It sits in the ambient scribes and clinical documentation group.

Why does error severity (major/minor) matter?

Error counts mislead. Severity separates harmless slips from ones that could change care. A wrong time stamp is minor. A wrong drug name is major.

How is error severity (major/minor) measured?

Collect visits, then Compare note to source, then Grade severity, then Stratify. Report whether the rate is per sentence or per note, how notes were sampled, which review instruction clinicians were given, and the severity of each error. Rates from different studies are not comparable.

What should I watch out for with error severity (major/minor)?

Rates from different studies use different definitions and aren't comparable. A good report gives: a per-note error rate with severity bands, specialty splits and a named review instruction.

Can error severity (major/minor) be automated?

Only in part. It needs clinician judgement. Software can screen, but a clinician must judge the cases that matter.

Measure error severity (major/minor) on your own data