Subgroup performance tables and model cards

FDA draft lifecycle guidance expects them; finalisation is on the FY2027 agenda.

Who judgesClinician judgement
EvidenceGrade E3
Product typeImagingID I4

What subgroup performance tables and model cards means

FDA draft lifecycle guidance expects them; finalisation is on the FY2027 agenda.

Why it matters. Regulators expect performance by subgroup and clear model documentation.

Example, illustrative

A table reports sensitivity by age, sex and scanner model.

How to measure it

01

Gather local scans

Use scans from your own scanners and protocols.

02

Adjudicate labels

Radiologists agree the reference reading.

03

Test across sites and groups

Check scanners, sites and patient groups separately.

04

Check calibration

Compare predicted and observed rates.

Watch out for

Performance at the vendor's test site often doesn't hold at yours.

What a good report shows

Local sensitivity and specificity with subgroup tables, external-site results and calibration.

Report local performance with radiologist-adjudicated labels, external sites, subgroup results and calibration, against a cleared comparator.

Reviewed by the Precision research team.

How strong is the evidence

E3 · Secondary or single-source report. Reported by trade press or a single source. Directional only until checked against the primary document.

What the sources say

(RAPS).

  • Clinician judgement. Needs a clinician to judge or label, because the answer depends on clinical meaning.
  1. RAPSraps.org

Found something out of date? Write to hello@precision.example.

Quick answers

What is subgroup performance tables and model cards in healthcare AI?

FDA draft lifecycle guidance expects them; finalisation is on the FY2027 agenda. It sits in the imaging and diagnostics group.

Why does subgroup performance tables and model cards matter?

Regulators expect performance by subgroup and clear model documentation. A table reports sensitivity by age, sex and scanner model.

How is subgroup performance tables and model cards measured?

Gather local scans, then Adjudicate labels, then Test across sites and groups, then Check calibration. Report local performance with radiologist-adjudicated labels, external sites, subgroup results and calibration, against a cleared comparator.

What should I watch out for with subgroup performance tables and model cards?

Performance at the vendor's test site often doesn't hold at yours. A good report gives: local sensitivity and specificity with subgroup tables, external-site results and calibration.

Can subgroup performance tables and model cards be automated?

Only in part. It needs clinician judgement. Software can screen, but a clinician must judge the cases that matter.

Measure subgroup performance tables and model cards on your own data