Today, we’re releasing our first pretrained Open Language Models (OLMo) at the Allen Institute for AI (AI2), a set of 7 billion parameter models and one 1 billion parameter variant. This line of work was probably the main reason I joined AI2 and is the biggest lever I see possible to enact meaningful change in how AI is used, studied, and discussed in the short term. 
text
Today, we’re releasing our first pretrained Open Language Models (OLMo) at the Allen Institute for AI (AI2), a set of 7 billion parameter models and one 1 billion parameter variant. This line of work was probably the main reason I joined AI2 and is the biggest lever I see possible to enact meaningful change in how AI is used, studied, and discussed in the short term. 
new_line
new_line
Links at the top because that's what you want:
text
Links at the top because that's what you want:
new_line
* Core 7B model: 
text
* Core 7B model: 
https://huggingface.co/allenai/OLMo-7B
allenai/OLMo-7B
model
resource
https://huggingface.co/allenai/OLMo-7B
new_line
* 7B model twin (different GPU hardware): 
text
* 7B model twin (different GPU hardware): 
https://huggingface.co/allenai/OLMo-7B-Twin-2T
allenai/OLMo-7B-Twin-2T
model
resource
https://huggingface.co/allenai/OLMo-7B-Twin-2T
new_line
* 1B model: 
text
* 1B model: 
https://huggingface.co/allenai/OLMo-1B
allenai/OLMo-1B
model
resource
https://huggingface.co/allenai/OLMo-1B
new_line
* Dataset: 
text
* Dataset: 
https://huggingface.co/datasets/allenai/dolma
allenai/dolma
dataset
resource
https://huggingface.co/datasets/allenai/dolma
new_line
* Paper (arxiv soon): 
text
* Paper (arxiv soon): 
https://allenai.org/olmo/olmo-paper.pdf
https://allenai.org/olmo/olmo-paper.pdf
link
new_line
* My personal blog post: 
text
* My personal blog post: 
https://www.interconnects.ai/p/olmo
https://www.interconnects.ai/p/olmo
link
new_line
new_line
new_line
OLMo will represent a new type of LLM enabling new approaches to ML research and deployment, because on a key axis of openness, OLMo represents something entirely different. OLMo is built for scientists to be able to develop research directions at every point in the development process and execute on them, which was previously not available due to incomplete information and tools.
text
OLMo will represent a new type of LLM enabling new approaches to ML research and deployment, because on a key axis of openness, OLMo represents something entirely different. OLMo is built for scientists to be able to develop research directions at every point in the development process and execute on them, which was previously not available due to incomplete information and tools.
new_line
new_line
Depending on the evaluation methods, OLMo 1 is either the best 7 billion parameter base model available for download or one of the best. This relies on a new way of thinking where models are judged on parameter plus token budget, similar to how scaling laws are measured for LLMs.
text
Depending on the evaluation methods, OLMo 1 is either the best 7 billion parameter base model available for download or one of the best. This relies on a new way of thinking where models are judged on parameter plus token budget, similar to how scaling laws are measured for LLMs.
new_line
new_line
We're just getting started, so please help us learn how to be more scientific with LLMs!
text
We're just getting started, so please help us learn how to be more scientific with LLMs!
Today, we’re releasing our first pretrained Open Language Models (OLMo) at the Allen Institute for AI (AI2), a set of 7 billion parameter models and one 1 billion parameter variant. This line of work was probably the main reason I joined AI2 and is the biggest lever I see possible to enact meaningful change in how AI is used, studied, and discussed in the short term. 

Links at the top because that's what you want:
* Core 7B model: https://huggingface.co/allenai/OLMo-7B
* 7B model twin (different GPU hardware): https://huggingface.co/allenai/OLMo-7B-Twin-2T
* 1B model: https://huggingface.co/allenai/OLMo-1B
* Dataset: https://huggingface.co/datasets/allenai/dolma
* Paper (arxiv soon): https://allenai.org/olmo/olmo-paper.pdf
* My personal blog post: https://www.interconnects.ai/p/olmo


OLMo will represent a new type of LLM enabling new approaches to ML research and deployment, because on a key axis of openness, OLMo represents something entirely different. OLMo is built for scientists to be able to develop research directions at every point in the development process and execute on them, which was previously not available due to incomplete information and tools.

Depending on the evaluation methods, OLMo 1 is either the best 7 billion parameter base model available for download or one of the best. This relies on a new way of thinking where models are judged on parameter plus token budget, similar to how scaling laws are measured for LLMs.

We're just getting started, so please help us learn how to be more scientific with LLMs!
❤️
julien-c osanseviero thomwolf AdinaY clem DnzzL LZDXN PereLluis13 venkateshmurugadas 90Barricade93 linoyts rbiswasfc Hamish victor yleo BrigitteTousi ArunkumarVR samforeman Maani adamm-hf davanstrien socialprescribing kramp beomi alielfilali01 jeffboudier patrickocal Gilojond imrohankataria eswardivi anileo1 shtoshni ahkarami radames pulkitmehtawork chaosIsRythmic
🤝
thomwolf clem fffiloni victor BrigitteTousi adamm-hf socialprescribing beomi ahkarami radames
🤯
osanseviero clem victor BrigitteTousi adamm-hf beomi alielfilali01
👍
stormchaser mathiasn1
64848ddca7c0d8460b8d3900
https://cdn-avatars.huggingface.co/v1/production/uploads/64848ddca7c0d8460b8d3900/qRdcqKJ7BA5_1vJq6ZB5x.png
Arun Nadarasa
socialprescribing
user
613a226b0fd0cb3c9b9ede5a
https://cdn-avatars.huggingface.co/v1/production/uploads/613a226b0fd0cb3c9b9ede5a/Dhi8bmqnAiG6s1rqNxJjM.jpeg
Pulkit Mehta
pulkitmehtawork
user