by Zihao Zhao*, Sheng Wang*, Jinchen Gu*,
Yitao Zhu*, Lanzhuju Mei,
Zixu Zhuang, Zhiming Cui, Qian Wang, Dinggang Shen
This repository provides the official implementation of some components of ChatCAD+:
- Modality identification
- Chinese version Interactive CAD of Chest X-rays
- LLM-based knowledge retrieval
- An easy-deploy local web ui (modified from Gpt4All Web UI )
- We would like to thank Merck Manual Professional who make all these medical knowledge public, we sorted their website for easier usage: here
- A BART-based model that has the capability to translate chest X-ray reportsinto Chinese well [link]
- MIMIC-CXR dataset: contained in annotation.json
- R2Gen weights: r2gcmn_mimic-cxr.pth
- PCAM weights: JFchexpert.pth
- Place annotation.json under ./r2g/ and pre-trained weights under ./weights/
You can either find them from original repository or dowload from Google Drive
- pip install -r requirements.txt
- implement web_app.py and input your openai api-key
-
Online demo with available dental and Knee MRI network
@article{wang2023chatcad,
title={Chatcad: Interactive computer-aided diagnosis on medical image using large language models},
author={Wang, Sheng and Zhao, Zihao and Ouyang, Xi and Wang, Qian and Shen, Dinggang},
journal={arXiv preprint arXiv:2302.07257},
year={2023}
}
Our implementation (including coming version) is based on the following codebases. We gratefully thank the authors for their wonderful works.