🚀 Release of open-source Korean LLM: GECKO-7B
text
🚀 Release of open-source Korean LLM: GECKO-7B
new_line
new_line
I am delighted to share my recent project, GECKO, a bilingual large language model for Korean and English 🇰🇷🇺🇸. This initiative was inspired by the lack of resources for Korean large language models.
text
I am delighted to share my recent project, GECKO, a bilingual large language model for Korean and English 🇰🇷🇺🇸. This initiative was inspired by the lack of resources for Korean large language models.
new_line
new_line
@donggyukimc
mention
donggyukimc
  and I wrote the technical report to share our insights and experiences of developing our model. While our model may not achieve sate-of-the-art performance on all benchmarks, it shows modest results with a relatively small amount of pretrained tokens.
text
  and I wrote the technical report to share our insights and experiences of developing our model. While our model may not achieve sate-of-the-art performance on all benchmarks, it shows modest results with a relatively small amount of pretrained tokens.
new_line
new_line
I hope GECKO contribute to the open-source community, offering resources that can built upon and improved. I believe that through collaboration and shared knowledge, we can advance the capabilities and accessibility of large language models for Korean and other low-resource languages.
text
I hope GECKO contribute to the open-source community, offering resources that can built upon and improved. I believe that through collaboration and shared knowledge, we can advance the capabilities and accessibility of large language models for Korean and other low-resource languages.
new_line
new_line
🤗 Model: 
text
🤗 Model: 
https://huggingface.co/kifai/GECKO-7B
kifai/GECKO-7B
model
resource
https://huggingface.co/kifai/GECKO-7B
new_line
📄 Technical Report: 
text
📄 Technical Report: 
https://arxiv.org/pdf/2405.15640
https://arxiv.org/pdf/2405.15640
link
🚀 Release of open-source Korean LLM: GECKO-7B

I am delighted to share my recent project, GECKO, a bilingual large language model for Korean and English 🇰🇷🇺🇸. This initiative was inspired by the lack of resources for Korean large language models.

@donggyukimc  and I wrote the technical report to share our insights and experiences of developing our model. While our model may not achieve sate-of-the-art performance on all benchmarks, it shows modest results with a relatively small amount of pretrained tokens.

I hope GECKO contribute to the open-source community, offering resources that can built upon and improved. I believe that through collaboration and shared knowledge, we can advance the capabilities and accessibility of large language models for Korean and other low-resource languages.

🤗 Model: https://huggingface.co/kifai/GECKO-7B
📄 Technical Report: https://arxiv.org/pdf/2405.15640
👍
nicolay-r osanseviero
66641e111b6504d4ec0b57c9
/avatars/4d3dea3779ce9bc67482e0fe0eca4b41.svg
zerodimension
danish1121
user