mlx port of karpathy’s minbpe 🤕
text
mlx port of karpathy’s minbpe 🤕
new_line
Minimal (byte-level) Byte Pair Encoding tokenizer. Algorithmically follows along the GPT2 tokenizer.
text
Minimal (byte-level) Byte Pair Encoding tokenizer. Algorithmically follows along the GPT2 tokenizer.
new_line
Code: 
text
Code: 
https://github.com/Jaykef/mlx-minbpe
https://github.com/Jaykef/mlx-minbpe
link
mlx port of karpathy’s minbpe 🤕
Minimal (byte-level) Byte Pair Encoding tokenizer. Algorithmically follows along the GPT2 tokenizer.
Code: https://github.com/Jaykef/mlx-minbpe
🔥
radames osanseviero roseopal