Two AI startups, DeepSeek & Moonshot AI , keep moving in perfect sync 👇 
text
Two AI startups, DeepSeek & Moonshot AI , keep moving in perfect sync 👇 
new_line
new_line
✨ Last December: DeepSeek & Moonshot AI released their reasoning models on the SAME DAY.
text
✨ Last December: DeepSeek & Moonshot AI released their reasoning models on the SAME DAY.
new_line
DeepSeek: 
text
DeepSeek: 
https://huggingface.co/deepseek-ai/DeepSeek-R1
deepseek-ai/DeepSeek-R1
model
resource
https://huggingface.co/deepseek-ai/DeepSeek-R1
new_line
MoonShot: 
text
MoonShot: 
https://github.com/MoonshotAI/Kimi-k1.5
https://github.com/MoonshotAI/Kimi-k1.5
link
new_line
new_line
✨ Last week: Both teams published papers on modifying attention mechanisms on the SAME DAY AGAIN.
text
✨ Last week: Both teams published papers on modifying attention mechanisms on the SAME DAY AGAIN.
new_line
DeepSeek: 
text
DeepSeek: 
Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse
  Attention (2502.11089)
https://huggingface.co/papers/2502.11089
2502.11089
paper
resource
https://huggingface.co/papers/2502.11089
new_line
Moonshot: 
text
Moonshot: 
MoBA: Mixture of Block Attention for Long-Context LLMs (2502.13189)
https://huggingface.co/papers/2502.13189
2502.13189
paper
resource
https://huggingface.co/papers/2502.13189
new_line
new_line
✨ TODAY:
text
✨ TODAY:
new_line
DeepSeek unveiled Flash MLA: a efficient MLA decoding kernel for NVIDIA Hopper GPUs, optimized for variable-length sequences.
text
DeepSeek unveiled Flash MLA: a efficient MLA decoding kernel for NVIDIA Hopper GPUs, optimized for variable-length sequences.
new_line
https://github.com/deepseek-ai/FlashMLA
https://github.com/deepseek-ai/FlashMLA
link
new_line
new_line
Moonshot AI introduces Moonlight: a 3B/16B MoE trained on 5.7T tokens using Muon, pushing the Pareto frontier with fewer FLOPs.
text
Moonshot AI introduces Moonlight: a 3B/16B MoE trained on 5.7T tokens using Muon, pushing the Pareto frontier with fewer FLOPs.
new_line
https://huggingface.co/moonshotai/Moonlight-16B-A3B
moonshotai/Moonlight-16B-A3B
model
resource
https://huggingface.co/moonshotai/Moonlight-16B-A3B
new_line
new_line
What's next? 👀
text
What's next? 👀
new_line
Two AI startups, DeepSeek & Moonshot AI , keep moving in perfect sync 👇 

✨ Last December: DeepSeek & Moonshot AI released their reasoning models on the SAME DAY.
DeepSeek: https://huggingface.co/deepseek-ai/DeepSeek-R1
MoonShot: https://github.com/MoonshotAI/Kimi-k1.5

✨ Last week: Both teams published papers on modifying attention mechanisms on the SAME DAY AGAIN.
DeepSeek: https://huggingface.co/papers/2502.11089
Moonshot: https://huggingface.co/papers/2502.13189

✨ TODAY:
DeepSeek unveiled Flash MLA: a efficient MLA decoding kernel for NVIDIA Hopper GPUs, optimized for variable-length sequences.
https://github.com/deepseek-ai/FlashMLA

Moonshot AI introduces Moonlight: a 3B/16B MoE trained on 5.7T tokens using Muon, pushing the Pareto frontier with fewer FLOPs.
https://huggingface.co/moonshotai/Moonlight-16B-A3B

What's next? 👀

🔥
AdinaY John6666 wanghaofan brunatrevelin dantezxcd
👍
schuler dantezxcd