How do I load the tokenizer

#7
by stanpony - opened

For some reason when I do
tokenizer = AutoTokenizer.from_pretrained("karpathy/nanochat-d32")
I get thrown this error: Error loading tokenizer: Unrecognized model in karpathy/nanochat-d34. Should have a model_type key in its config.json, or contain one of the following strings in its name
Even though, I am just following these directions: https://huggingface.co/docs/transformers/main/model_doc/nanochat.

Sign up or log in to comment