MedVersa: A Generalist Foundation Model for Medical Image Interpretation

Hong-Yu Zhou, Julián Nicolás Acosta, Subathra Adithan, Suvrankar Datta, Eric J. Topol +1 more
5/13/2024
cs.CV

No confident code implementation found for this paper. 3 possible matches can be shown below.

Abstract

Current medical AI systems are often limited to narrow applications, hindering widespread adoption. We present MedVersa, a generalist foundation model trained on tens of millions of compiled medical instances. MedVersa unlocks generalist learning from multimodal inputs and outputs, representing the first example of a generalist model reaching competitive performance with leading specialized solutions across a variety of medical imaging scenarios. MedVersa achieves state-of-the-art performance in nine tasks, sometimes outperforming counterparts by over 10%. Radiologist evaluation shows MedVersa-generated reports get superior performance in 95% of normal studies, while matching or exceeding human reports in 71% of cases overall. User studies showed notable reductions in report writing time and discrepancies with the use of MedVersa. Our findings underscore the value of flexible, multimodal AI systems in advancing medical image interpretation and supporting clinical expertise.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 3 weaker matches are hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Cite this paper

@article{zhou2024medversa,
  title  = {MedVersa: A Generalist Foundation Model for Medical Image Interpretation},
  author = {Hong-Yu Zhou and Julián Nicolás Acosta and Subathra Adithan and Suvrankar Datta and Eric J. Topol and Pranav Rajpurkar},
  year   = {2024},
  eprint = {2405.07988},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2405.07988v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2405.07988.svg)](https://codeofpaper.com/paper/2405.07988)

Discussion