biogpt / README.md
Robinhood135's picture
Update README.md
2227311 verified

A newer version of the Gradio SDK is available: 6.1.0

Upgrade
metadata
title: BiomedCLIP-BioGPT-IndicTrans2 Radiology Report Generator
emoji: πŸ”¬
colorFrom: blue
colorTo: green
sdk: gradio
sdk_version: 5.49.1
app_file: app.py
pinned: false

πŸ”¬ Cascading BiomedCLIP-BioGPT & IndicTrans2 Radiology Report Generator

This Space demonstrates a two-stage pipeline:

  1. Stage 1 (Report Generation): A fine-tuned BiomedCLIP image encoder and BioGPT decoder generate a radiology report in English from a chest X-ray image. The checkpoint files (biomedclipp.pth, biogptt.pth, projectorr.pth) are loaded using huggingface_hub.hf_hub_download from this repository.
  2. Stage 2 (Translation): The English report is automatically translated into Hindi using the IndicTrans2 model from AI4Bharat.

Note on Checkpoints: The file app.py is configured to download the checkpoints from the model's repository. Ensure the following files are uploaded to this repository and the REPO_ID in app.py is correctly set:

  • biomedclipp.pth
  • biogptt.pth
  • projectorr.pth