KLUE-benchmark/KLUE

• highreadme#1

  Emphasize 'comprehensive' and 'multi-task' nature in README opening

  原因：

  当前

  The KLUE is introduced to make advances in Korean NLP. Korean pre-trained language models (PLMs) have appeared to solve Korean NLP problems since PLMs have brought significant performance gains in NLP problems in other languages. Despite the proliferation of Korean language models, however, none of the proper evaluation datasets has been opened yet. The lack of such benchmark dataset limits the fair comparison between the models and further progress on model architectures.

  复制粘贴的修复

  复制

  KLUE is a comprehensive, multi-task benchmark introduced to advance Korean NLP by providing standardized evaluation for pre-trained language models (PLMs). Despite the proliferation of Korean language models, a proper, comprehensive evaluation dataset has been lacking, limiting fair comparison and further progress. KLUE addresses this by offering diverse tasks and data.

  待办完成忽略
• mediumtopics#2

  Add a topic to highlight multi-task nature

  原因：

  当前

  benchmark, bert, korean, korean-nlp, roberta

  复制粘贴的修复

  复制

  benchmark, bert, korean, korean-nlp, roberta, multi-task-benchmark

  待办完成忽略
• lowreadme#3

  Add a brief 'Comparison with other Korean NLP benchmarks' section

  原因：

  复制粘贴的修复

  复制

  ## Comparison with other Korean NLP benchmarks
  While several valuable Korean NLP datasets exist (e.g., KorNLI/KorSTS for specific tasks, KorQuAD for QA), KLUE stands out as a comprehensive, multi-task benchmark. Unlike single-task datasets, KLUE integrates 8 diverse tasks, providing a holistic evaluation framework for Korean Language Understanding models.

  待办完成忽略

本次扫描解析到的品类 GEO 通道：google/gemini-2.5-flash, deepseek/deepseek-v4-flash

• 品类问题

  How to benchmark different Korean natural language understanding models effectively?

  你：第 1 位
  AI 推荐顺序：

  1. KLUE ← 你
  2. KorNLI/KorSTS
  3. Naver NLP Challenge Datasets
  4. KorQuAD
  5. NSMC
  6. HateSpeech-KR
  7. AI Hub Datasets
  查看 AI 完整回答
• 品类问题

  What are the best comprehensive evaluation benchmarks for Korean language models?

  你：未被推荐
  AI 推荐顺序：

  1. KLUE (Korean Language Understanding Evaluation)
  2. KorNLI/KorSTS
  3. Naver NLP Challenge
  4. Kakao Brain's KoBART/KoGPT benchmarks
  5. AI Hub Korean Datasets

  AI 推荐了 5 个替代方案，却始终没点名 KLUE-benchmark/KLUE。这就是要补上的差距。

  查看 AI 完整回答

• Metadata completeness

  pass

• README presence

  pass

• Compared to common alternatives in this category, what is the core differentiator of KLUE-benchmark/KLUE?

  pass
  ✓AI 明确点名了 KLUE-benchmark/KLUE

  AI 的回答可能信誓旦旦却是错的。请按事实核对：技术栈、目标人群、差异化点是不是和你实际的对得上？

• If a team adopts KLUE-benchmark/KLUE in production, what risks or prerequisites should they evaluate first?

  pass
  ✓AI 明确点名了 KLUE-benchmark/KLUE

  AI 的回答可能信誓旦旦却是错的。请按事实核对：技术栈、目标人群、差异化点是不是和你实际的对得上？

• In one sentence, what problem does the repo KLUE-benchmark/KLUE solve, and who is the primary audience?

  pass
  ✓AI 明确点名了 KLUE-benchmark/KLUE

  AI 的回答可能信誓旦旦却是错的。请按事实核对：技术栈、目标人群、差异化点是不是和你实际的对得上？