Image-Text-to-Text
Transformers
Safetensors
qwen3_5
decision-model
calibration
typed-decisions
classification
multimodal
conversational
Instructions to use kirp/jpt-9b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use kirp/jpt-9b with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-text-to-text", model="kirp/jpt-9b") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] pipe(text=messages)# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("kirp/jpt-9b") model = AutoModelForMultimodalLM.from_pretrained("kirp/jpt-9b", device_map="auto") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] inputs = processor.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=256) print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use kirp/jpt-9b with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "kirp/jpt-9b" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "kirp/jpt-9b", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker
docker model run hf.co/kirp/jpt-9b
- SGLang
How to use kirp/jpt-9b with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "kirp/jpt-9b" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "kirp/jpt-9b", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "kirp/jpt-9b" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "kirp/jpt-9b", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }' - Docker Model Runner
How to use kirp/jpt-9b with Docker Model Runner:
docker model run hf.co/kirp/jpt-9b
Model card: JPT-9B JevBench public 0.853 measured with the JevBench CLI
Browse files- README.md +7 -4
- assets/jevbench.png +0 -0
README.md
CHANGED
|
@@ -9,7 +9,7 @@ tags: [decision-model, calibration, typed-decisions, classification, multimodal]
|
|
| 9 |
# JPT-9B
|
| 10 |
|
| 11 |
[](#❯❯-license)
|
| 12 |
-
[](#❯-decision-index-021)
|
| 14 |
[](https://github.com/tic-top/llm2jev)
|
| 15 |
|
|
@@ -40,8 +40,8 @@ Built on [Qwen/Qwen3.5-9B](https://huggingface.co/Qwen/Qwen3.5-9B): a LoRA fine-
|
|
| 40 |
|
| 41 |
### ❯ JevBench v1.4.0
|
| 42 |
|
| 43 |
-
**[JevBench](https://github.com/fstandhartinger/jevbench) [2] scores general typed decisions; JPT-9B reaches 0.
|
| 44 |
-
public accuracy, level with
|
| 45 |
231 public items and 308 sealed items only the maintainer can run, so JPT-9B has no official v1.4 score yet.
|
| 46 |
|
| 47 |

|
|
@@ -54,8 +54,8 @@ public accuracy, level with Winnow-12B and just under Jev 1.13.0 — but below t
|
|
| 54 |
| [JPT-35B-A3B](https://huggingface.co/kirp/jpt-35b-a3b) (ours) | 35B-A3B | 0.892 | pending | pending |
|
| 55 |
| [JPT-4B](https://huggingface.co/kirp/jpt-4b) (ours) | 4B | 0.879 | pending | pending |
|
| 56 |
| Jev 1.13.0 (TypeSafe AI, API) | closed | 0.866 | 0.367 | 63.3 |
|
| 57 |
-
| **JPT-9B** | 9B | **0.857** | pending | pending |
|
| 58 |
| Winnow-12B Q8 | 12B | 0.857 | 0.331 | 55.6 |
|
|
|
|
| 59 |
| JevK5 v0.2.0 | 27B | 0.853 | 0.331 | 62.0 |
|
| 60 |
| decider-35b-a3b | 35B-A3B | 0.831 | 0.315 | 41.2 |
|
| 61 |
| Hopper | — | 0.823 | 0.341 | 59.4 |
|
|
@@ -66,6 +66,9 @@ public accuracy, level with Winnow-12B and just under Jev 1.13.0 — but below t
|
|
| 66 |
| kev 4B (research preview) | 4B | 0.662 | 0.224 | 36.1 |
|
| 67 |
|
| 68 |
Source: other rows from `results/v1.4/jevbench-v1.4-results.json` at jevbench commit `2fa63fa` (2026-09-23).
|
|
|
|
|
|
|
|
|
|
| 69 |
¹ Not in the v1.4 results; its own card's number on the 231 public items. A same-prompt Qwen3.5-9B zero-shot run on
|
| 70 |
the public items has not been done yet.
|
| 71 |
|
|
|
|
| 9 |
# JPT-9B
|
| 10 |
|
| 11 |
[](#❯❯-license)
|
| 12 |
+
[](#❯-jevbench-v140)
|
| 13 |
[](#❯-decision-index-021)
|
| 14 |
[](https://github.com/tic-top/llm2jev)
|
| 15 |
|
|
|
|
| 40 |
|
| 41 |
### ❯ JevBench v1.4.0
|
| 42 |
|
| 43 |
+
**[JevBench](https://github.com/fstandhartinger/jevbench) [2] scores general typed decisions; JPT-9B reaches 0.853
|
| 44 |
+
public accuracy, level with JevK5 and just under Winnow-12B and Jev 1.13.0 — but below the smaller JPT-4B (0.879).** v1.4.0 has
|
| 45 |
231 public items and 308 sealed items only the maintainer can run, so JPT-9B has no official v1.4 score yet.
|
| 46 |
|
| 47 |

|
|
|
|
| 54 |
| [JPT-35B-A3B](https://huggingface.co/kirp/jpt-35b-a3b) (ours) | 35B-A3B | 0.892 | pending | pending |
|
| 55 |
| [JPT-4B](https://huggingface.co/kirp/jpt-4b) (ours) | 4B | 0.879 | pending | pending |
|
| 56 |
| Jev 1.13.0 (TypeSafe AI, API) | closed | 0.866 | 0.367 | 63.3 |
|
|
|
|
| 57 |
| Winnow-12B Q8 | 12B | 0.857 | 0.331 | 55.6 |
|
| 58 |
+
| **JPT-9B** | 9B | **0.853** | pending | pending |
|
| 59 |
| JevK5 v0.2.0 | 27B | 0.853 | 0.331 | 62.0 |
|
| 60 |
| decider-35b-a3b | 35B-A3B | 0.831 | 0.315 | 41.2 |
|
| 61 |
| Hopper | — | 0.823 | 0.341 | 59.4 |
|
|
|
|
| 66 |
| kev 4B (research preview) | 4B | 0.662 | 0.224 | 36.1 |
|
| 67 |
|
| 68 |
Source: other rows from `results/v1.4/jevbench-v1.4-results.json` at jevbench commit `2fa63fa` (2026-09-23).
|
| 69 |
+
Ours measured with JevBench's CLI at `2fa63fa` (SGLang 0.5.18, `kirp/jpt-9b@7114b0c`): 197/231, easy 48 · standard 68 ·
|
| 70 |
+
hard 81. Our own harness gets 198: on `original-intent-02-0` two options tie exactly (0.4864 each) and the two tools
|
| 71 |
+
break the tie differently.
|
| 72 |
¹ Not in the v1.4 results; its own card's number on the 231 public items. A same-prompt Qwen3.5-9B zero-shot run on
|
| 73 |
the public items has not been done yet.
|
| 74 |
|
assets/jevbench.png
CHANGED
|
|