metadata
license: apache-2.0
inference: false
base_model: allenai/OLMo-2-1124-13B-Instruct
base_model_relation: quantized
tags:
- green
- llmware-chat
- p13
- gguf
olmo-13b-gguf
olmo-13b-gguf is a GGUF Q4_K_M quantized version of Allen AI Olmo 2 13B Instruct, providing a fast, small inference implementation, optimized for AI PCs.
Model Description
- Developed by: AllenAI
- Quantized by: bartowksi
- Model type: olmo2
- Parameters: 13 billion
- Model Parent: allenai/OLMo-2-1124-13B-Instruct
- Language(s) (NLP): English
- License: Apache 2.0
- Uses: Chat, general-purpose LLM
- Quantization: int4