Can Jev Judge Radiology Reports? Evaluating a System One Model for Clinical Factuality

Excerpt

arXiv:2609.27607v1 Announce Type: new Abstract: An AI-generated radiology report can resemble a physician's report while omitting an abnormality, adding an unsupported finding, or reversing its presence. Measuring these factual differences is essential for evaluating report generators. We study Jev, a System One decision model, as a simple, low-cost judge of agreement with physician-written reference reports. Our evaluator checks whether each statement is supported by the other report and combin