See https://github.com/michahu/pre-pretraining for more information.
Usage:
model = AutoModel.from_pretrained('michahu8/pythia-160m-c4-only-10k')
tokenizer = AutoTokenizer.from_pretrained('EleutherAI/pythia-160m')
- Downloads last month
- 4
See https://github.com/michahu/pre-pretraining for more information.
Usage:
model = AutoModel.from_pretrained('michahu8/pythia-160m-c4-only-10k')
tokenizer = AutoTokenizer.from_pretrained('EleutherAI/pythia-160m')