RRepoGEO

REPOGEO REPORT · LITE

sylinrl/TruthfulQA

Default branch main · commit d71c1108 · scanned 6/12/2026, 7:12:52 PM

GitHub: 926 stars · 117 forks

AI VISIBILITY SCORE
80 /100
Healthy
Category recall
2 / 2
Avg rank #1.0 when recommended
Rule findings
1 pass · 1 warn · 0 fail
Objective metadata checks
AI knows your name
2 / 3
Direct prompts that named your repo
HOW TO READ THIS REPORT

Action plan is what to do next — copy-pasteable changes prioritized by impact. Category visibility is the real GEO test: when a user asks an AI a brand-free question that should surface sylinrl/TruthfulQA, does the AI actually recommend you — or your competitors? Objective checks verify the metadata signals AI engines weight first. Self-mention check detects whether AI even knows you exist by name.

Action plan — copy-paste fixes

3 prioritized changes generated by gemini-2.5-flash. Mark items done after you ship the fix.

OVERALL DIRECTION
  • hightopics#1
    Add relevant topics to the repository

    Why:

    COPY-PASTE FIX
    llm-evaluation, truthfulness, language-models, nlp, benchmark, ai-safety, misinformation, falsehoods
  • mediumreadme#2
    Refine README's opening sentence to emphasize unique focus

    Why:

    CURRENT
    This repository contains code for evaluating model performance on the TruthfulQA benchmark.
    COPY-PASTE FIX
    This repository provides the code and dataset for the TruthfulQA benchmark, specifically designed to measure how large language models mimic human falsehoods and common misconceptions.
  • lowhomepage#3
    Update 'Homepage' link to the repository URL

    Why:

    CURRENT
    https://arxiv.org/abs/2109.07958
    COPY-PASTE FIX
    https://github.com/sylinrl/TruthfulQA

Category GEO backends resolved for this scan: google/gemini-2.5-flash, deepseek/deepseek-v4-flash

Category visibility — the real GEO test

Brand-free queries asked to google/gemini-2.5-flash. Did AI recommend you, or someone else?

Same questions for every model — switch tabs to compare answers and rankings.

Recall
2 / 2
100% of queries surface sylinrl/TruthfulQA
Avg rank
#1.0
Lower is better. #1 = top recommendation.
Share of voice
8%
Of all named tools, what % are you?
Top rival
Ragas-AI/ragas
Recommended in 1 of 2 queries
COMPETITOR LEADERBOARD
  1. Ragas-AI/ragas · recommended 1×
  2. run-llama/llama_index · recommended 1×
  3. Wikidata · recommended 1×
  4. DBpedia · recommended 1×
  5. Google Knowledge Graph API · recommended 1×
  • CATEGORY QUERY
    How can I evaluate the factual accuracy and truthfulness of a large language model's outputs?
    you: #1
    AI recommended (in order):
    1. TruthfulQA ← you
    2. Ragas (Ragas-AI/ragas)
    3. LlamaIndex (run-llama/llama_index)
    4. Wikidata
    5. DBpedia
    6. Google Knowledge Graph API
    7. OpenAI API
    8. Anthropic API
    9. Google AI Studio
    10. Vertex AI
    11. Hugging Face Transformers (huggingface/transformers)
    12. LangChain (langchain-ai/langchain)
    13. ROUGE
    14. BLEU
    15. Sentence-BERT (UKPLab/sentence-transformers)
    16. OpenAI embeddings
    Show full AI answer
  • CATEGORY QUERY
    What benchmarks exist to measure a language model's tendency to mimic human falsehoods?
    you: #1
    AI recommended (in order):
    1. TruthfulQA ← you
    2. FACTOOL
    3. FEVER
    4. LIAR
    5. HellaSwag
    6. Adversarial NLI
    7. BIG-bench
    8. MMLU
    9. RealToxicityPrompts
    Show full AI answer

Objective checks

Rule-based audits of metadata signals AI engines weight most.

  • Metadata completeness
    warn

    Suggestion:

  • README presence
    pass

Self-mention check

Does AI even know your repo exists when asked about it directly?

  • Compared to common alternatives in this category, what is the core differentiator of sylinrl/TruthfulQA?
    pass
    AI named sylinrl/TruthfulQA explicitly

    AI answers can be confidently wrong. Read for accuracy: does it match your actual tech stack, audience, and differentiator?

  • If a team adopts sylinrl/TruthfulQA in production, what risks or prerequisites should they evaluate first?
    pass
    AI named sylinrl/TruthfulQA explicitly

    AI answers can be confidently wrong. Read for accuracy: does it match your actual tech stack, audience, and differentiator?

  • In one sentence, what problem does the repo sylinrl/TruthfulQA solve, and who is the primary audience?
    pass
    AI did not name sylinrl/TruthfulQA — likely talking about a different project

    AI answers can be confidently wrong. Read for accuracy: does it match your actual tech stack, audience, and differentiator?

Embed your GEO score

Drop this badge into the README of sylinrl/TruthfulQA. It auto-updates whenever the report is rescanned and links back to the latest report — easy public proof that you care about AI discoverability.

RepoGEO badge previewLive preview
MARKDOWN (README)
[![RepoGEO](https://repogeo.com/badge/sylinrl/TruthfulQA.svg)](https://repogeo.com/en/r/sylinrl/TruthfulQA)
HTML
<a href="https://repogeo.com/en/r/sylinrl/TruthfulQA"><img src="https://repogeo.com/badge/sylinrl/TruthfulQA.svg" alt="RepoGEO" /></a>
Pro

Subscribe to Pro for deep diagnoses

sylinrl/TruthfulQA — Lite scans stay free; this card itemizes Pro deep limits vs Lite.

  • Deep reports10 / month
  • Brand-free category queries5 vs 2 in Lite
  • Prioritized action items8 vs 3 in Lite