File size: 1,033 Bytes
914e828 8bdf460 914e828 2227311 914e828 8bdf460 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 |
---
title: BiomedCLIP-BioGPT-IndicTrans2 Radiology Report Generator
emoji: 🔬
colorFrom: blue
colorTo: green
sdk: gradio
sdk_version: 5.49.1
app_file: app.py
pinned: false
---
# 🔬 Cascading BiomedCLIP-BioGPT & IndicTrans2 Radiology Report Generator
This Space demonstrates a two-stage pipeline:
1. **Stage 1 (Report Generation):** A fine-tuned **BiomedCLIP** image encoder and **BioGPT** decoder generate a radiology report in English from a chest X-ray image. The checkpoint files (`biomedclipp.pth`, `biogptt.pth`, `projectorr.pth`) are loaded using `huggingface_hub.hf_hub_download` from this repository.
2. **Stage 2 (Translation):** The English report is automatically translated into Hindi using the **IndicTrans2** model from AI4Bharat.
**Note on Checkpoints:**
The file `app.py` is configured to download the checkpoints from the model's repository. **Ensure the following files are uploaded to this repository and the `REPO_ID` in `app.py` is correctly set:**
* `biomedclipp.pth`
* `biogptt.pth`
* `projectorr.pth` |