Google publishes first Lancet study on medical chatbot: AMIE matches 90% of physician diagnoses

Google has published its first study in The Lancet evaluating AMIE, an artificial-intelligence chatbot designed to conduct pre-visit conversations with patients before urgent-care appointments. The trial took place at the primary-care clinic of Beth Israel Deaconess Medical Center in Boston, where 98 patients interacted with AMIE across 100 encounters. No safety stops were triggered — meaning the system never produced a situation that required immediate intervention by a supervising physician because of patient risk.

Physicians reported that AMIE's conversation summaries helped them prepare for the visit in 75% of cases and influenced their treatment approach in more than half of the appointments. The most striking figure was a 90% concordance between the differential diagnoses suggested by the chatbot and the final diagnosis the physician reached after examination, indicating that AI systems can, under controlled conditions, support the diagnostic process without degrading quality or safety.

The researchers stress that the work is preliminary; the next step requires larger clinical trials to measure impact on actual health outcomes and on clinical workload. Even so, the results point to potential for narrowing communication gaps and easing pressure on overstretched health systems — a domain where tools such as AMIE could serve as a first-line assistant, not a substitute for medical judgment.