SFT + Quantisation + Unsloth is a super easy way of squeezing extra performance out of an LLM at low latencies. Here are some hand y resources to bootstrap your projects.
text
SFT + Quantisation + Unsloth is a super easy way of squeezing extra performance out of an LLM at low latencies. Here are some hand y resources to bootstrap your projects.
new_line
new_line
Here's a filtered dataset from Helpsteer2 with the most correct and coherent samples: 
text
Here's a filtered dataset from Helpsteer2 with the most correct and coherent samples: 
https://huggingface.co/datasets/burtenshaw/helpsteer-2-plus
burtenshaw/helpsteer-2-plus
dataset
resource
https://huggingface.co/datasets/burtenshaw/helpsteer-2-plus
new_line
This is a SFT finetuned model: ttps://huggingface.co/burtenshaw/gemma-help-tiny-sft
text
This is a SFT finetuned model: ttps://huggingface.co/burtenshaw/gemma-help-tiny-sft
new_line
This is the notebook I use to train the model: 
text
This is the notebook I use to train the model: 
https://colab.research.google.com/drive/17oskw_5lil5C3jCW34rA-EXjXnGgRRZw?usp=sharing
https://colab.research.google.com/drive/17oskw_5lil5C3jCW34rA-EXjXnGgRRZw?usp=sharing
link
new_line
Here's a load of Unsloth notebook on finetuning and inference: 
text
Here's a load of Unsloth notebook on finetuning and inference: 
https://docs.unsloth.ai/get-started/unsloth-notebooks
https://docs.unsloth.ai/get-started/unsloth-notebooks
link
SFT + Quantisation + Unsloth is a super easy way of squeezing extra performance out of an LLM at low latencies. Here are some hand y resources to bootstrap your projects.

Here's a filtered dataset from Helpsteer2 with the most correct and coherent samples: https://huggingface.co/datasets/burtenshaw/helpsteer-2-plus
This is a SFT finetuned model: ttps://huggingface.co/burtenshaw/gemma-help-tiny-sft
This is the notebook I use to train the model: https://colab.research.google.com/drive/17oskw_5lil5C3jCW34rA-EXjXnGgRRZw?usp=sharing
Here's a load of Unsloth notebook on finetuning and inference: https://docs.unsloth.ai/get-started/unsloth-notebooks
👍
gabrielmbmb patiencerichard osanseviero John6666 venezianof
67463c77676e0a95b234354b
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/2SOse3hVc-wHpusp8eA1M.png
franco veneziano
venezianof
user