PDQI-9 / modified PDQI-9

Nine to eleven criteria on 5-point Likert (accurate, thorough, organised, succinct, internally consistent).

Who judgesClinician judgement
EvidenceGrade E2
Product typeAmbient scribesID S5

What pdqi-9 / modified pdqi-9 means

Nine to eleven criteria on 5-point Likert (accurate, thorough, organised, succinct, internally consistent).

Why it matters. A shared checklist lets reviewers judge note quality the same way.

Example, illustrative

A note scores 4 of 5 for accuracy but 2 for organisation.

How to measure it

01

Collect visits

Use recorded or simulated visits with the source transcript.

02

Compare note to source

Check every fact in the visit against the note, and every claim in the note against the visit.

03

Grade severity

Clinicians rank each error by the harm it could do.

04

Stratify

Split results by specialty, accent and visit type.

Watch out for

Rates from different studies use different definitions and aren't comparable.

What a good report shows

A per-note error rate with severity bands, specialty splits and a named review instruction.

Report whether the rate is per sentence or per note, how notes were sampled, which review instruction clinicians were given, and the severity of each error. Rates from different studies are not comparable.

Reviewed by the Precision research team.

How strong is the evidence

E2 · Preprint, benchmark page or vendor-run result. Backed by numbers from a preprint, a benchmark page or a vendor-run test. Treat as strong but not settled.

What the sources say

Palm: ambient better on thoroughness and organisation, worse on succinctness, consistency and accuracy; inter-rater RWG >0.7 but only moderate in paediatrics and cardiology; Suki-affiliated authors (Frontiers).

  • Clinician judgement. Needs a clinician to judge or label, because the answer depends on clinical meaning.
  1. Frontiersfrontiersin.org

Found something out of date? Write to hello@precision.example.

Quick answers

What is pdqi-9 / modified pdqi-9 in healthcare AI?

Nine to eleven criteria on 5-point Likert (accurate, thorough, organised, succinct, internally consistent). It sits in the ambient scribes and clinical documentation group.

Why does pdqi-9 / modified pdqi-9 matter?

A shared checklist lets reviewers judge note quality the same way. A note scores 4 of 5 for accuracy but 2 for organisation.

How is pdqi-9 / modified pdqi-9 measured?

Collect visits, then Compare note to source, then Grade severity, then Stratify. Report whether the rate is per sentence or per note, how notes were sampled, which review instruction clinicians were given, and the severity of each error. Rates from different studies are not comparable.

What should I watch out for with pdqi-9 / modified pdqi-9?

Rates from different studies use different definitions and aren't comparable. A good report gives: a per-note error rate with severity bands, specialty splits and a named review instruction.

Can pdqi-9 / modified pdqi-9 be automated?

Only in part. It needs clinician judgement. Software can screen, but a clinician must judge the cases that matter.

Measure pdqi-9 / modified pdqi-9 on your own data