🎯 Introducing Chayan: A Calibrated 4-Model LLM Router Achieving 69% Accuracy on RouterArena
text
🎯 Introducing Chayan: A Calibrated 4-Model LLM Router Achieving 69% Accuracy on RouterArena
new_line
new_line
We're excited to share Chayan, a cost-efficient LLM router that intelligently routes queries between 4 models to maximize accuracy while minimizing cost. Chayan just submitted to the RouterArena leaderboard and achieved 69.05% accuracy on the benchmark!
text
We're excited to share Chayan, a cost-efficient LLM router that intelligently routes queries between 4 models to maximize accuracy while minimizing cost. Chayan just submitted to the RouterArena leaderboard and achieved 69.05% accuracy on the benchmark!
new_line
new_line
🔗 Model: 
text
🔗 Model: 
https://huggingface.co/adaptive-classifier/chayan
adaptive-classifier/chayan
model
resource
https://huggingface.co/adaptive-classifier/chayan
new_line
🔗 Dataset: 
text
🔗 Dataset: 
https://huggingface.co/datasets/RouteWorks/RouterArena
RouteWorks/RouterArena
dataset
resource
https://huggingface.co/datasets/RouteWorks/RouterArena
new_line
new_line
📊 Performance Highlights
text
📊 Performance Highlights
new_line
new_line
Chayan achieves impressive results on the RouterArena benchmark:
text
Chayan achieves impressive results on the RouterArena benchmark:
new_line
• 69.05% accuracy (would rank #1 on current leaderboard)
text
• 69.05% accuracy (would rank #1 on current leaderboard)
new_line
• $0.333 per 1K queries
text
• $0.333 per 1K queries
new_line
• +12.07pp improvement over all-mini baseline (56.98%)
text
• +12.07pp improvement over all-mini baseline (56.98%)
new_line
• 99% of perfect 2-model oracle performance at 57% lower cost
text
• 99% of perfect 2-model oracle performance at 57% lower cost
new_line
new_line
Compared to our previous 2-model router (61.43% accuracy), Chayan delivers +7.62pp improvement through smarter 4-model routing.
text
Compared to our previous 2-model router (61.43% accuracy), Chayan delivers +7.62pp improvement through smarter 4-model routing.
new_line
new_line
🧠 How It Works
text
🧠 How It Works
new_line
new_line
Chayan uses an Adaptive K-NN classifier with prototype memory to route between 4 models:
text
Chayan uses an Adaptive K-NN classifier with prototype memory to route between 4 models:
new_line
• openai/gpt-4o-mini (fast & cheap)
text
• openai/gpt-4o-mini (fast & cheap)
new_line
• google/gemini-2.5-flash-lite (balanced)
text
• google/gemini-2.5-flash-lite (balanced)
new_line
• google/gemini-2.5-flash (capable)
text
• google/gemini-2.5-flash (capable)
new_line
• openai/gpt-4o (most powerful)
text
• openai/gpt-4o (most powerful)
new_line
new_line
🚀 Getting Started
text
🚀 Getting Started
new_line
new_line
You can use Chayan directly from HuggingFace:
text
You can use Chayan directly from HuggingFace:
new_line
new_line
from adaptive_classifier import AdaptiveClassifier
text
from adaptive_classifier import AdaptiveClassifier
new_line
new_line
Load Chayan
text
Load Chayan
new_line
router = AdaptiveClassifier.load("adaptive-classifier/chayan")
text
router = AdaptiveClassifier.load("adaptive-classifier/chayan")
new_line
new_line
Route a query
text
Route a query
new_line
query = "What is the capital of France?"
text
query = "What is the capital of France?"
new_line
predictions = router.predict(query, k=4)
text
predictions = router.predict(query, k=4)
new_line
new_line
Get top model recommendation
text
Get top model recommendation
new_line
best_model = predictions[0][0]
text
best_model = predictions[0][0]
new_line
print(f"Recommended model: {best_model}")
text
print(f"Recommended model: {best_model}")
new_line
new_line
Built with the adaptive-classifier library: 
text
Built with the adaptive-classifier library: 
https://github.com/codelion/adaptive-classifier
https://github.com/codelion/adaptive-classifier
link
🎯 Introducing Chayan: A Calibrated 4-Model LLM Router Achieving 69% Accuracy on RouterArena

We're excited to share Chayan, a cost-efficient LLM router that intelligently routes queries between 4 models to maximize accuracy while minimizing cost. Chayan just submitted to the RouterArena leaderboard and achieved 69.05% accuracy on the benchmark!

🔗 Model: https://huggingface.co/adaptive-classifier/chayan
🔗 Dataset: https://huggingface.co/datasets/RouteWorks/RouterArena

📊 Performance Highlights

Chayan achieves impressive results on the RouterArena benchmark:
• 69.05% accuracy (would rank #1 on current leaderboard)
• $0.333 per 1K queries
• +12.07pp improvement over all-mini baseline (56.98%)
• 99% of perfect 2-model oracle performance at 57% lower cost

Compared to our previous 2-model router (61.43% accuracy), Chayan delivers +7.62pp improvement through smarter 4-model routing.

🧠 How It Works

Chayan uses an Adaptive K-NN classifier with prototype memory to route between 4 models:
• openai/gpt-4o-mini (fast & cheap)
• google/gemini-2.5-flash-lite (balanced)
• google/gemini-2.5-flash (capable)
• openai/gpt-4o (most powerful)

🚀 Getting Started

You can use Chayan directly from HuggingFace:

from adaptive_classifier import AdaptiveClassifier

Load Chayan
router = AdaptiveClassifier.load("adaptive-classifier/chayan")

Route a query
query = "What is the capital of France?"
predictions = router.predict(query, k=4)

Get top model recommendation
best_model = predictions[0][0]
print(f"Recommended model: {best_model}")

Built with the adaptive-classifier library: https://github.com/codelion/adaptive-classifier
🔥
codelion John6666
❤️
codelion DmitriyYurckML
🚀
codelion
👀
codelion