THUDM/LongBench

• highreadme#1

  Strengthen the README's opening sentence to explicitly position LongBench as an LLM performance evaluation benchmark.

  原因：

  当前

  LongBench v2 is designed to assess the ability of LLMs to handle long-context problems requiring **deep understanding and reasoning** across real-world multitasks.

  复制粘贴的修复

  复制

  LongBench v2 is a comprehensive benchmark designed for the rigorous evaluation of Large Language Model (LLM) performance on long-context problems, specifically focusing on deep understanding and reasoning across real-world multitasks.

  待办完成忽略
• mediumtopics#2

  Add more specific topics to improve categorization for performance assessment and document comprehension.

  原因：

  当前

  benchmark, llm, long-context, longtext

  复制粘贴的修复

  复制

  benchmark, llm, long-context, longtext, llm-evaluation, document-comprehension, reasoning, understanding

  待办完成忽略
• lowabout#3

  Expand the repository description to clearly state its purpose as an LLM benchmark.

  原因：

  当前

  LongBench v2 and LongBench (ACL 25'&24')

  复制粘贴的修复

  复制

  LongBench is a comprehensive benchmark for evaluating Large Language Models (LLMs) on their ability to handle long-context problems, focusing on deep understanding and reasoning across realistic multitasks.

  待办完成忽略

本次扫描解析到的品类 GEO 通道：google/gemini-2.5-flash, deepseek/deepseek-v4-flash

• 品类问题

  How can I effectively benchmark large language models for extended context understanding?

  你：第 1 位
  AI 推荐顺序：

  1. LongBench ← 你
  2. L-Eval
  3. Needle-in-a-Haystack (NIAH) Test
  4. OpenAI API
  5. Anthropic Claude API
  6. Google Gemini API
  7. RAGAS
  8. LlamaIndex's evaluation modules
  9. Hugging Face `transformers`
  10. GPT-2
  11. LLaMA
  12. Mistral
  13. CNN/DailyMail
  14. XSum
  15. LongSumm
  16. ROUGE
  17. BERTScore
  18. Hugging Face `evaluate`
  19. HumanEval
  20. MBPP
  查看 AI 完整回答
• 品类问题

  What tools help assess LLM performance on complex, very long document comprehension tasks?

  你：未被推荐
  AI 推荐顺序：

  1. LlamaIndex
  2. LangChain
  3. Ragas
  4. DeepEval
  5. Humanloop
  6. Weights & Biases (W&B) Prompts
  7. Galileo

  AI 推荐了 7 个替代方案，却始终没点名 THUDM/LongBench。这就是要补上的差距。

  查看 AI 完整回答

• Metadata completeness

  pass

• README presence

  pass

• Compared to common alternatives in this category, what is the core differentiator of THUDM/LongBench?

  pass
  ✓AI 明确点名了 THUDM/LongBench

  AI 的回答可能信誓旦旦却是错的。请按事实核对：技术栈、目标人群、差异化点是不是和你实际的对得上？

• If a team adopts THUDM/LongBench in production, what risks or prerequisites should they evaluate first?

  pass
  ✓AI 明确点名了 THUDM/LongBench

  AI 的回答可能信誓旦旦却是错的。请按事实核对：技术栈、目标人群、差异化点是不是和你实际的对得上？

• In one sentence, what problem does the repo THUDM/LongBench solve, and who is the primary audience?

  pass
  ✓AI 明确点名了 THUDM/LongBench

  AI 的回答可能信誓旦旦却是错的。请按事实核对：技术栈、目标人群、差异化点是不是和你实际的对得上？