Assessment of Cell Nuclei AI Foundation Models in Kidney Pathology

Junlin Guo, Siqi Lu, Can Cui, Ruining Deng, Tianyuan Yao +12 more
8/9/2024
eess.IVcs.AIcs.CV

No official code found. Best implementation: hrlblab/AFM_kidney_cells (5 stars, MIT, last commit 2026-04-17). 1 more below.

Abstract

Cell nuclei instance segmentation is a crucial task in digital kidney pathology. Traditional automatic segmentation methods often lack generalizability when applied to unseen datasets. Recently, the success of foundation models (FMs) has provided a more generalizable solution, potentially enabling the segmentation of any cell type. In this study, we perform a large-scale evaluation of three widely used state-of-the-art (SOTA) cell nuclei foundation models (Cellpose, StarDist, and CellViT). Specifically, we created a highly diverse evaluation dataset consisting of 2,542 kidney whole slide images (WSIs) collected from both human and rodent sources, encompassing various tissue types, sizes, and staining methods. To our knowledge, this is the largest-scale evaluation of its kind to date. Our quantitative analysis of the prediction distribution reveals a persistent performance gap in kidney pathology. Among the evaluated models, CellViT demonstrated superior performance in segmenting nuclei in kidney pathology. However, none of the foundation models are perfect; a performance gap remains in general nuclei segmentation for kidney pathology.

View on arXivView PDF

Code Implementations(2)

Content of this Repository Being Merged into Finetuning part of https://github.com/hrlblab/AFM_kidney_cells

20CSS, HTMLJun 7, 202411 months agoNOASSERTION
computer-visiondeep-learninginstance-segmentationkidneynuclei
MIT

AI foundation models for kidney pathology cells

51CSS, HTMLAug 23, 20246 months agoMIT

Similar Papers

Cite this paper

@article{guo2024assessment,
  title  = {Assessment of Cell Nuclei AI Foundation Models in Kidney Pathology},
  author = {Junlin Guo and Siqi Lu and Can Cui and Ruining Deng and Tianyuan Yao and Zhewen Tao and Yizhe Lin and Marilyn Lionts and Quan Liu and Juming Xiong and Yu Wang and Shilin Zhao and Catie Chang and Mitchell Wilkes and Mengmeng Yin and Haichun Yang and Yuankai Huo},
  year   = {2024},
  eprint = {2408.06381},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2408.06381v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2408.06381.svg)](https://codeofpaper.com/paper/2408.06381)

Discussion