RRepoGEO

REPOGEO REPORT · LITE

open-compass/opencompass

Default branch main · commit 2f5f5e32 · scanned 5/14/2026, 1:41:48 PM

GitHub: 6,992 stars · 778 forks

AI VISIBILITY SCORE
40 /100
Critical
Category recall
0 / 2
Not recommended in any query
Rule findings
2 pass · 0 warn · 0 fail
Objective metadata checks
AI knows your name
3 / 3
Direct prompts that named your repo
HOW TO READ THIS REPORT

Action plan is what to do next — copy-pasteable changes prioritized by impact. Category visibility is the real GEO test: when a user asks an AI a brand-free question that should surface open-compass/opencompass, does the AI actually recommend you — or your competitors? Objective checks verify the metadata signals AI engines weight first. Self-mention check detects whether AI even knows you exist by name.

Action plan — copy-paste fixes

3 prioritized changes generated by gemini-2.5-flash. Mark items done after you ship the fix.

OVERALL DIRECTION
  • highreadme#1
    Add a clear, concise positioning statement to the README's opening

    Why:

    COPY-PASTE FIX
    Add the following sentence prominently at the very beginning of the README, after the title/badges: "OpenCompass is a comprehensive, unified, and reproducible platform for evaluating large language models (LLMs) across diverse models and datasets."
  • mediumtopics#2
    Add more specific topics to improve category visibility

    Why:

    CURRENT
    benchmark, chatgpt, evaluation, large-language-model, llama2, llama3, llm, openai
    COPY-PASTE FIX
    benchmark, chatgpt, evaluation, large-language-model, llama2, llama3, llm, openai, llm-evaluation-framework, llm-benchmarking, model-evaluation-platform
  • mediumabout#3
    Refine the 'About' description to emphasize 'framework' or 'platform'

    Why:

    CURRENT
    OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.
    COPY-PASTE FIX
    OpenCompass is a comprehensive LLM evaluation framework and platform, supporting a wide range of models (Llama3, Mistral, InternLM2, GPT-4, LLaMa2, Qwen, GLM, Claude, etc.) over 100+ datasets.

Category GEO backends resolved for this scan: google/gemini-2.5-flash, deepseek/deepseek-v4-flash

Category visibility — the real GEO test

Brand-free queries asked to google/gemini-2.5-flash. Did AI recommend you, or someone else?

Same questions for every model — switch tabs to compare answers and rankings.

Recall
0 / 2
0% of queries surface open-compass/opencompass
Avg rank
—
Lower is better. #1 = top recommendation.
Share of voice
0%
Of all named tools, what % are you?
Top rival
BLEU
Recommended in 1 of 2 queries
COMPETITOR LEADERBOARD
  1. BLEU · recommended 1×
  2. ROUGE · recommended 1×
  3. METEOR · recommended 1×
  4. BERTScore · recommended 1×
  5. Perplexity · recommended 1×
  • CATEGORY QUERY
    How can I effectively evaluate the performance of different large language models?
    you: not recommended
    AI recommended (in order):
    1. BLEU
    2. ROUGE
    3. METEOR
    4. BERTScore
    5. Perplexity
    6. Appen
    7. Amazon Mechanical Turk
    8. Argilla
    9. HELM
    10. GLUE
    11. SuperGLUE
    12. MMLU
    13. BigBench

    AI recommended 13 alternatives but never named open-compass/opencompass. This is the gap to close.

    Show full AI answer
  • CATEGORY QUERY
    What tools are available for benchmarking multiple LLMs across diverse datasets?
    you: not recommended
    AI recommended (in order):
    1. EleutherAI/lm-evaluation-harness (EleutherAI/lm-evaluation-harness)
    2. OpenAI Evals (openai/evals)
    3. Hugging Face Evaluate library (huggingface/evaluate)
    4. LangChain Evaluation (langchain-ai/langchain)
    5. DeepEval (confident-ai/deepeval)
    6. Ragas (explodinggradients/ragas)

    AI recommended 6 alternatives but never named open-compass/opencompass. This is the gap to close.

    Show full AI answer

Objective checks

Rule-based audits of metadata signals AI engines weight most.

  • Metadata completeness
    pass

  • README presence
    pass

Self-mention check

Does AI even know your repo exists when asked about it directly?

  • Compared to common alternatives in this category, what is the core differentiator of open-compass/opencompass?
    pass
    AI named open-compass/opencompass explicitly

    AI answers can be confidently wrong. Read for accuracy: does it match your actual tech stack, audience, and differentiator?

  • If a team adopts open-compass/opencompass in production, what risks or prerequisites should they evaluate first?
    pass
    AI named open-compass/opencompass explicitly

    AI answers can be confidently wrong. Read for accuracy: does it match your actual tech stack, audience, and differentiator?

  • In one sentence, what problem does the repo open-compass/opencompass solve, and who is the primary audience?
    pass
    AI named open-compass/opencompass explicitly

    AI answers can be confidently wrong. Read for accuracy: does it match your actual tech stack, audience, and differentiator?

Embed your GEO score

Drop this badge into the README of open-compass/opencompass. It auto-updates whenever the report is rescanned and links back to the latest report — easy public proof that you care about AI discoverability.

RepoGEO badge previewLive preview
MARKDOWN (README)
[![RepoGEO](https://repogeo.com/badge/open-compass/opencompass.svg)](https://repogeo.com/en/r/open-compass/opencompass)
HTML
<a href="https://repogeo.com/en/r/open-compass/opencompass"><img src="https://repogeo.com/badge/open-compass/opencompass.svg" alt="RepoGEO" /></a>
Pro

Subscribe to Pro for deep diagnoses

open-compass/opencompass — Lite scans stay free; this card itemizes Pro deep limits vs Lite.

  • Deep reports10 / month
  • Brand-free category queries5 vs 2 in Lite
  • Prioritized action items8 vs 3 in Lite