Skip to content
 
 

Latest commit

 

History

57 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 

Repository files navigation

MGPATH

MGPATH: Vision-Language Model with Multi-Granular Prompt Learning for Few-Shot WSI Classification

Anh-Tien Nguyen, Duy Minh Ho Nguyen*, Nghiem Tuong Diep*, Trung Quoc Nguyen, Nhat Ho, Jacqueline Michelle Metsch, Miriam Cindy Maurer, Daniel Sonntag, Hanibal Bohnenberger, Anne-Christin Hauschild

(*Equal second contribution)

Static Badge [Model] [Paper] [BibTeX]

💥 📢 News 💥

  • [14.10.2025]: Release all source codes !
  • [05.10.2025]: MGPATH is published in Transactions on Machine Learning Research (TMLR) !
  • [11.02.2025]: MGPATH is now available on arXiv !
  • [27.02.2025]: MGPath(PLIP-G) Hugging Face models are released !
  • [27.02.2025]: PLIP-G aligment Hugging Face models are released !
  • [27.02.2025]: TCGA-NSCLC's embeddings Hugging Face extracted by Prov-GigaPath are release !

Development Environment Installation

please refer to the installation guide Development Environment Installation

Reproducibility

For the testing, validation, and training slide IDs, please refer to the splits directory.

Model Download

The aligment (Prov-GigaPath and PLIP's text encoder) weight can be download from Hugging Face. After downloading, please copy the weights to the directory weights

Embedding Download

The embedding features of the mentioned datasets, extracted from GigaPath, can be downloaded from Hugging Face.

The spatial embedding features can be also download from Hugging Face.

Creating splits for training and testing

*) please refer to (ViLa-MIL)[https://github.com/Jiangbo-Shi/ViLa-MIL] for TCGA-NSCLC and TCGA-RCC

*) please refer to (MSCPT)[https://github.com/Hanminghao/MSCPT/tree/master] for TCGA-BRCA

Model Overview


Overview of MGPath model architecture

Note

docs/cmd provides essential information to play with the source codes.

Acknowledgement

This work is supported in part by funds from the German Ministry of Education and Research (BMBF) under grant agreements No. 01D2208A and No. 01KD2414A (project FAIrPaCT). The authors gratefully acknowledge the computing time granted by the KISSKI project. The calculations for this research were conducted with computing resources under the project kisski-umg-fairpact-2. The authors also acknowledge the computing time granted by the Resource Allocation Board and provided on the supercomputer Emmy/Grete at NHR-Nord@Göttingen as part of the NHR infrastructure. The calculations for this research were conducted with computing resources under the project nim00014.

The project “Development of an intelligent collaboration service for AI-based collaboration between rescue services and central emergency rooms” (acronym: CONNECT_ED) is funded by the German Federal Ministry of Education and Research under grant number 16SV8977 and by the joint project KISSKI under grant number 1IS22093E.

The authors thank the International Max Planck Research School for Intelligent Systems (IMPRS-IS) for supporting Duy M. H. Nguyen. Duy M. H. Nguyen and Daniel Sonntag are also supported by the XAINES project (BMBF, 01IW20005), No-IDLE project (BMBF, 01IW23002), and the Endowed Chair of Applied Artificial Intelligence, Oldenburg University.

Usage and License Notices

The model is not intended for clinical use as a medical device, diagnostic tool, or any technology for disease diagnosis, treatment, or prevention. It is not a substitute for professional medical advice, diagnosis, or treatment. Users are responsible for evaluating and validating the model to ensure it meets their needs before any clinical application.

Citation

If MGPath is useful for yoru research and applications, please cite using this Bibtex:

@article{
    nguyen2025mgpath,
    title={{MGPATH}: A Vision-Language Model with Multi-Granular Prompt Learning for Few-Shot Whole Slide Pathology Classification},
    author={Anh-Tien Nguyen and Duy Minh Ho Nguyen and Nghiem Tuong Diep and Trung Quoc Nguyen and Nhat Ho and Jacqueline Michelle Metsch and Miriam Cindy Maurer and Daniel Sonntag and Hanibal Bohnenberger and Anne-Christin Hauschild},
    journal={Transactions on Machine Learning Research},
    issn={2835-8856},
    year={2025},
    url={https://openreview.net/forum?id=u7U81JLGjH},
    note={}
}

About

MGPATH

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages