google-research/bleurt

• mediumreadme#1

  Refine README's opening sentence to highlight learned metric and human correlation

  原因：

  当前

  # BLEURT: a Transfer Learning-Based Metric for Natural Language Generation
  
  BLEURT is an evaluation metric for Natural Language Generation. It takes a pair of sentences as input, a *reference* and a *candidate*, and it returns a score that indicates to what extent the candidate is fluent and conveys the meaning of the reference. It is comparable to `sentence-BLEU`, `BERTscore`, and `COMET`.

  复制粘贴的修复

  复制

  # BLEURT: a Transfer Learning-Based Metric for Natural Language Generation
  
  BLEURT is a *learned evaluation metric* for Natural Language Generation, explicitly trained on human quality judgments to predict the quality of generated text. It takes a pair of sentences as input, a *reference* and a *candidate*, and it returns a score that indicates to what extent the candidate is fluent and conveys the meaning of the reference. It is comparable to `sentence-BLEU`, `BERTscore`, and `COMET`.

  待办完成忽略
• lowreadme#2

  Add a 'Comparison with other metrics' section to the README

  原因：

  复制粘贴的修复

  复制

  ## Comparison with other metrics
  
  BLEURT is a learned metric, distinguishing it from traditional lexical overlap metrics like `BLEU` and `ROUGE`. Unlike `BERTScore` which relies on contextual embeddings similarity, BLEURT is explicitly trained on human quality judgments (e.g., WMT human ratings) to predict text quality, often correlating better with human perceptions. `COMET` is another learned metric, and while both aim for high human correlation, BLEURT's training methodology and model architecture (based on BERT/RemBERT) offer a distinct approach. For specific use cases, fine-tuning BLEURT on domain-specific human ratings can yield superior performance.

  待办完成忽略

本次扫描解析到的品类 GEO 通道：google/gemini-2.5-flash, deepseek/deepseek-v4-flash

• 品类问题

  How to accurately evaluate the fluency and semantic similarity of generated text?

  你：第 2 位
  AI 推荐顺序：

  1. BERTScore
  2. BLEURT ← 你
  3. ROUGE
  4. METEOR
  5. Amazon Mechanical Turk
  6. Appen
  7. Scale AI
  8. Hugging Face Transformers library
  9. MAUVE
  查看 AI 完整回答
• 品类问题

  What are robust, learned metrics for assessing natural language generation quality?

  你：第 4 位
  AI 推荐顺序：

  1. COMET
  2. BERTScore
  3. MoverScore
  4. BLEURT ← 你
  5. GEMBA
  6. UniTE
  查看 AI 完整回答

• Metadata completeness

  warn

  建议：

• README presence

  pass

• Compared to common alternatives in this category, what is the core differentiator of google-research/bleurt?

  pass
  ✓AI 明确点名了 google-research/bleurt

  AI 的回答可能信誓旦旦却是错的。请按事实核对：技术栈、目标人群、差异化点是不是和你实际的对得上？

• If a team adopts google-research/bleurt in production, what risks or prerequisites should they evaluate first?

  pass
  ✓AI 明确点名了 google-research/bleurt

  AI 的回答可能信誓旦旦却是错的。请按事实核对：技术栈、目标人群、差异化点是不是和你实际的对得上？

• In one sentence, what problem does the repo google-research/bleurt solve, and who is the primary audience?

  pass
  ✓AI 明确点名了 google-research/bleurt

  AI 的回答可能信誓旦旦却是错的。请按事实核对：技术栈、目标人群、差异化点是不是和你实际的对得上？