Sensitivity, specificity, AUROC
Against reference standard.
What sensitivity, specificity, auroc means
Against reference standard.
Why it matters. Sensitivity and specificity show how well a model finds disease and avoids false alarms.
A model finds 92% of cancers and flags 8% of healthy scans.
How to measure it
Gather local scans
Use scans from your own scanners and protocols.
Adjudicate labels
Radiologists agree the reference reading.
Test across sites and groups
Check scanners, sites and patient groups separately.
Check calibration
Compare predicted and observed rates.
Performance at the vendor's test site often doesn't hold at yours.
Local sensitivity and specificity with subgroup tables, external-site results and calibration.
Report local performance with radiologist-adjudicated labels, external sites, subgroup results and calibration, against a cleared comparator.
Reviewed by the Precision research team.
How strong is the evidence
E4 · Recalled, not verified. Recalled from background knowledge and not verified. Treat it as a lead for investigation, not a finding.
What the sources say
Standard; not researched in depth.
- Clinician judgement. Needs a clinician to judge or label, because the answer depends on clinical meaning.
Found something out of date? Write to hello@precision.example.
Agents that measure this
Quick answers
What is sensitivity, specificity, auroc in healthcare AI?
Against reference standard. It sits in the imaging and diagnostics group.
Why does sensitivity, specificity, auroc matter?
Sensitivity and specificity show how well a model finds disease and avoids false alarms. A model finds 92% of cancers and flags 8% of healthy scans.
How is sensitivity, specificity, auroc measured?
Gather local scans, then Adjudicate labels, then Test across sites and groups, then Check calibration. Report local performance with radiologist-adjudicated labels, external sites, subgroup results and calibration, against a cleared comparator.
What should I watch out for with sensitivity, specificity, auroc?
Performance at the vendor's test site often doesn't hold at yours. A good report gives: local sensitivity and specificity with subgroup tables, external-site results and calibration.
Can sensitivity, specificity, auroc be automated?
Only in part. It needs clinician judgement. Software can screen, but a clinician must judge the cases that matter.