Hugging Face's logo

techdotus
/
Tokle-3M

Text Generation
Transformers
Safetensors
English
tokle
causal-lm
custom-architecture
custom_code
slm
small-language-model
Model card Files
xet
 Community
anandselvadurai-techus commited on
Commit
912fed0
·
verified ·
1 Parent(s): 713054f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -77,7 +77,7 @@ Stage 1 model (SPAB active) vs. the released Tokle-3M (SPAB removed and distille
77
  | Model | Params | Int Index | HellaSwag | ARC-Easy | ARC-Chal | PIQA | ArithMark-3 |
78
  |---|---|---|---|---|---|---|---|
79
  | [Tokle-SPAB-3M](https://huggingface.co/techdotus/Tokle-SPAB-3M) | 11.3M (2.91M trainable + 8.39M frozen) | 9.16 | 27.22% | 34.68% | 24.49% | 54.95% | 41.70% |
80
- | Tokle-3M | 2.91M | 8.92 | 27.20% | 34.85% | 23.98% | 55.01% | 40.80% |
81
 
82
 
83
  ## Comparison Results
@@ -86,7 +86,7 @@ All scores are 0-shot acc_norm, using the Open SLM Leaderboard methodology. Scor
86
 
87
  | Model | Params | Int Index | HellaSwag | ARC-Easy | ARC-Chal | PIQA | ArithMark-3 |
88
  |---|---|---|---|---|---|---|---|
89
- | Tokle-3M (Tech.us) | 2.91M | **8.92** | 27.20% | **34.85%** | **23.98%** | 55.01% | **40.80%** |
90
  | Ember-2 (SurjoLabs) | 2.96M×2 | 7.21 | 27.28% | 33.42% | 22.01% | 55.11% | 35.90% |
91
  | BananaMind-2-Micro (BananaMind) | 2.9M | 6.01 | **28.27%** | 33.12% | 21.93% | 53.21% | 34.00% |
92
  | GPT-S-1.4M (Axiomic Labs) | 1.4M | 5.40 | 26.89% | 31.57% | 21.93% | **55.17%** | 30.20% |
 
77
  | Model | Params | Int Index | HellaSwag | ARC-Easy | ARC-Chal | PIQA | ArithMark-3 |
78
  |---|---|---|---|---|---|---|---|
79
  | [Tokle-SPAB-3M](https://huggingface.co/techdotus/Tokle-SPAB-3M) | 11.3M (2.91M trainable + 8.39M frozen) | 9.16 | 27.22% | 34.68% | 24.49% | 54.95% | 41.70% |
80
+ | Tokle-3M | 2.91M | 8.91 | 27.20% | 34.85% | 23.98% | 55.01% | 40.80% |
81
 
82
 
83
  ## Comparison Results
 
86
 
87
  | Model | Params | Int Index | HellaSwag | ARC-Easy | ARC-Chal | PIQA | ArithMark-3 |
88
  |---|---|---|---|---|---|---|---|
89
+ | Tokle-3M (Tech.us) | 2.91M | **8.91** | 27.20% | **34.85%** | **23.98%** | 55.01% | **40.80%** |
90
  | Ember-2 (SurjoLabs) | 2.96M×2 | 7.21 | 27.28% | 33.42% | 22.01% | 55.11% | 35.90% |
91
  | BananaMind-2-Micro (BananaMind) | 2.9M | 6.01 | **28.27%** | 33.12% | 21.93% | 53.21% | 34.00% |
92
  | GPT-S-1.4M (Axiomic Labs) | 1.4M | 5.40 | 26.89% | 31.57% | 21.93% | **55.17%** | 30.20% |