Product type · Next

Patient chat quality.

Triage advice that fails on real, messy messages. Patient chat and triage tools talk to people who are worried, vague and in a hurry.

Next in line: we plan to offer this after the core focus areas.

Nextwhere it sits for Precision
10parameters we can measure
3agents that help
3common failures to test first
What goes wrong

Where patient chat breaks.

Patient chat and triage tools talk to people who are worried, vague and in a hurry. They need to spot emergencies and avoid dangerous advice, even when the message is messy.

Misses an emergency

A message hints at stroke or sepsis in everyday words, and the bot suggests rest.

Works in tests, fails with people

In one large trial, people using chatbots chose the right action less than 44% of the time.

Over-reaches

The bot gives dosing or diagnosis advice that it should have handed to a clinician.

How we test it

Three steps, in the open.

Real-user and simulator tests with a deterministic red-flag escalation gate; disclosure compliance.

  1. 01

    Simulate varied patients

    A patient simulator writes the same case in many styles: terse, anxious, wrong terms.

  2. 02

    Probe the red lines

    A red-team agent tries emergencies, jailbreaks and out-of-scope requests.

  3. 03

    Check the handoff

    A deterministic gate must hand red flags to a human every time, regardless of the model.

As a service

Red-team and real-user testing.

As a product

Patient simulator, escalation gate.

Why it matters now

Who builds it, who buys it.

General chatbots (ChatGPT Health, claimed >230M weekly health askers), symptom checkers, health-system bots

The stakes

These tools may approach medical-device territory in some markets, and a missed emergency is the failure with the highest cost.

Measure patient chat on your own data

Questions

Common questions.

Why test with simulated patients?

Real-user trials are slow and costly. Simulators let you test thousands of phrasings first, and we measure the gap between simulated and real results.

What is under-triage?

Under-triage is sending someone to a lower level of care than they need. It's the error to minimise first.

Do you test voice chat as well?

Yes, through the voice-agent tests, which add accents and noise.

Know your healthcare AI is safe to trust
before it reaches a patient.

Book a 30-minute call. We'll look at your product and tell you what we would measure first.