Controllable Generation of Diverse Dermatological Imagery for Fair and Efficient Malignancy Classification
Paper • 2607.12987 • Published
How to use hcarrion/pyogenic_granuloma with Diffusers:
pip install -U diffusers transformers accelerate
import torch
from diffusers import DiffusionPipeline
# switch to "mps" for apple devices
pipe = DiffusionPipeline.from_pretrained("stabilityai/stable-diffusion-2-1-base", dtype=torch.bfloat16, device_map="cuda")
pipe.load_textual_inversion("hcarrion/pyogenic_granuloma")This repository contains the textual inversion adaptation weights learned for pyogenic_granuloma based on the stabilityai/stable-diffusion-2-1-base architecture.
These weights are part of the cgDDI (Controllable Generation of Diverse Dermatological Imagery) framework introduced in the paper Controllable Generation of Diverse Dermatological Imagery for Fair and Efficient Malignancy Classification.
The model learns the disease-specific concept token <pyogenic_granuloma-class> to synthesize controllable, diverse dermatological imagery for fair and efficient malignancy classification.
If you find this work or the associated models useful, please cite:
@inproceedings{carrion2026cgddi,
title = {Controllable Generation of Diverse Dermatological Imagery for Fair and Efficient Malignancy Classification},
author = {Carri{\'o}n, H{\'e}ctor and Norouzi, Narges},
booktitle = {Medical Image Computing and Computer-Assisted Intervention (MICCAI)},
year = {2026},
publisher = {Springer},
series = {Lecture Notes in Computer Science}
}
Base model
stabilityai/stable-diffusion-2-1-base