Having some fun with long context benchmarks (watch the video!!) 
text
Having some fun with long context benchmarks (watch the video!!) 
new_line
new_line
NoLiMA: 
text
NoLiMA: 
NoLiMa: Long-Context Evaluation Beyond Literal Matching (2502.05167)
https://huggingface.co/papers/2502.05167
2502.05167
paper
resource
https://huggingface.co/papers/2502.05167
new_line
Fiction LiveBench: 
text
Fiction LiveBench: 
https://fiction.live/stories/Fiction-liveBench-Mar-25-2025/oQdzQvKHw8JyXbN87
https://fiction.live/stories/Fiction-liveBench-Mar-25-2025/oQdzQvKHw8JyXbN87
link
new_line
Michalenglo: 
text
Michalenglo: 
https://deepmind.google/research/publications/117639/
https://deepmind.google/research/publications/117639/
link
new_line
LongGenBench: 
text
LongGenBench: 
Spinning the Golden Thread: Benchmarking Long-Form Generation in
  Language Models (2409.02076)
https://huggingface.co/papers/2409.02076
2409.02076
paper
resource
https://huggingface.co/papers/2409.02076
new_line
NeedleBench: 
text
NeedleBench: 
NeedleBench: Can LLMs Do Retrieval and Reasoning in 1 Million Context
  Window? (2407.11963)
https://huggingface.co/papers/2407.11963
2407.11963
paper
resource
https://huggingface.co/papers/2407.11963
new_line
RULER: 
text
RULER: 
RULER: What's the Real Context Size of Your Long-Context Language
  Models? (2404.06654)
https://huggingface.co/papers/2404.06654
2404.06654
paper
resource
https://huggingface.co/papers/2404.06654
new_line
new_line
For more: 
text
For more: 
https://www.reddit.com/r/rajistics/comments/1jxwk29/long_context_llm_benchmarks_video/
https://www.reddit.com/r/rajistics/comments/1jxwk29/long_context_llm_benchmarks_video/
link
new_line
new_line
 let me know if you like these posts
text
 let me know if you like these posts
Having some fun with long context benchmarks (watch the video!!) 

NoLiMA: https://huggingface.co/papers/2502.05167
Fiction LiveBench: https://fiction.live/stories/Fiction-liveBench-Mar-25-2025/oQdzQvKHw8JyXbN87
Michalenglo: https://deepmind.google/research/publications/117639/
LongGenBench: https://huggingface.co/papers/2409.02076
NeedleBench: https://huggingface.co/papers/2407.11963
RULER: https://huggingface.co/papers/2404.06654

For more: https://www.reddit.com/r/rajistics/comments/1jxwk29/long_context_llm_benchmarks_video/

 let me know if you like these posts
👍
John6666 Fishtiks rjmehta uretzky