Started fine tuning Gemma 3 using evolutionary approach. It is not the worst model according to AHA leaderboard and it is one of the smart according to lmarena.ai. My objective is to make it based, anti woke, wise, beneficial and then some.
text
Started fine tuning Gemma 3 using evolutionary approach. It is not the worst model according to AHA leaderboard and it is one of the smart according to lmarena.ai. My objective is to make it based, anti woke, wise, beneficial and then some.
new_line
new_line
Several GPUs are fine tuning it at the same time, each using a different dataset and using QLoRA and the successful ones are merged later. Compared to LoRa this allows faster training and also reduced overfitting because the merge operation heals overfitting. The problem with this could be the 4 bit quantization may make models dumber. But I am not looking for sheer IQ. Too much mind is a problem anyway :)
text
Several GPUs are fine tuning it at the same time, each using a different dataset and using QLoRA and the successful ones are merged later. Compared to LoRa this allows faster training and also reduced overfitting because the merge operation heals overfitting. The problem with this could be the 4 bit quantization may make models dumber. But I am not looking for sheer IQ. Too much mind is a problem anyway :)
new_line
new_line
Has anyone tried parallel QLoRa and merge before?
text
Has anyone tried parallel QLoRa and merge before?
new_line
new_line
I also automated the dataset selection and benchmarking and converging to objectives (the fit function, the reward). It is basically trying to get higher score in AHA Leaderboard as fast as possible with a diverse set of organisms that "evolve by training".
text
I also automated the dataset selection and benchmarking and converging to objectives (the fit function, the reward). It is basically trying to get higher score in AHA Leaderboard as fast as possible with a diverse set of organisms that "evolve by training".
new_line
new_line
I want to release some cool stuff when I have the time:
text
I want to release some cool stuff when I have the time:
new_line
- how an answer to a single question changes over time, with each training round or day
text
- how an answer to a single question changes over time, with each training round or day
new_line
- a chart to show AHA alignment over training rounds
text
- a chart to show AHA alignment over training rounds
Started fine tuning Gemma 3 using evolutionary approach. It is not the worst model according to AHA leaderboard and it is one of the smart according to lmarena.ai. My objective is to make it based, anti woke, wise, beneficial and then some.

Several GPUs are fine tuning it at the same time, each using a different dataset and using QLoRA and the successful ones are merged later. Compared to LoRa this allows faster training and also reduced overfitting because the merge operation heals overfitting. The problem with this could be the 4 bit quantization may make models dumber. But I am not looking for sheer IQ. Too much mind is a problem anyway :)

Has anyone tried parallel QLoRa and merge before?

I also automated the dataset selection and benchmarking and converging to objectives (the fit function, the reward). It is basically trying to get higher score in AHA Leaderboard as fast as possible with a diverse set of organisms that "evolve by training".

I want to release some cool stuff when I have the time:
- how an answer to a single question changes over time, with each training round or day
- a chart to show AHA alignment over training rounds
👀
victor John6666 CATAMERCA AtAndDev dtotsila punkreload xinnn63 dantezxcd
😎
Norod78 CATAMERCA AtAndDev dantezxcd
🚀
etemiz CATAMERCA AtAndDev dantezxcd
67b8e0d79107c46e941a3fc8
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/kjcJuaIcvP-1x4Hmf6LMt.png
Karen Akers
karenny
user
65a488b5224f96d8cc3754fc
/avatars/cf21cf2c8f1c9d5a8fb35761acdef04b.svg
Emin Temiz
etemiz
user