See https://github.com/michahu/pre-pretraining for more information.

Usage:

model = AutoModel.from_pretrained('michahu8/pythia-160m-c4-only-10k')
tokenizer = AutoTokenizer.from_pretrained('EleutherAI/pythia-160m')
Downloads last month
4
Safetensors
Model size
0.1B params
Tensor type
F32
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support