REPOGEO REPORT · LITE
petergpt/bullshit-benchmark
Default branch main · commit 7b92fe7b · scanned 5/30/2026, 4:43:44 AM
GitHub: 1,666 stars · 64 forks
Action plan is what to do next — copy-pasteable changes prioritized by impact. Category visibility is the real GEO test: when a user asks an AI a brand-free question that should surface petergpt/bullshit-benchmark, does the AI actually recommend you — or your competitors? Objective checks verify the metadata signals AI engines weight first. Self-mention check detects whether AI even knows you exist by name.
Action plan — copy-paste fixes
2 prioritized changes generated by gemini-2.5-flash. Mark items done after you ship the fix.
- highreadme#1Clarify the README's H1 and opening sentence for better AI categorization
Why:
CURRENT<h1> BullshitBench v2 </h1> BullshitBench measures whether models detect nonsense, call it out clearly, and avoid confidently continuing with invalid assumptions.
COPY-PASTE FIX<h1> BullshitBench v2: An LLM Nonsense Detection Benchmark </h1> BullshitBench is a comprehensive benchmark suite designed to measure whether AI models detect nonsense, call it out clearly, and avoid confidently continuing with invalid assumptions.
- mediumhomepage#2Update the repository homepage URL to the project viewer
Why:
CURRENThttps://x.com/petergostev
COPY-PASTE FIXhttps://petergpt.github.io/bullshit-benchmark/viewer/index.v2.html
Category GEO backends resolved for this scan: google/gemini-2.5-flash, deepseek/deepseek-v4-flash
Category visibility — the real GEO test
Brand-free queries asked to google/gemini-2.5-flash. Did AI recommend you, or someone else?
Same questions for every model — switch tabs to compare answers and rankings.
- Scale AI · recommended 2×
- Appen · recommended 2×
- Ragas · recommended 1×
- Guardrails AI · recommended 1×
- GPT-4 · recommended 1×
- CATEGORY QUERYHow to assess if an AI model confidently answers nonsensical or invalid user prompts?you: not recommendedAI recommended (in order):
- Scale AI
- Appen
- Ragas
- Guardrails AI
- GPT-4
- Claude 3 Opus
- Sentence-BERT
- Python with `re` module
AI recommended 8 alternatives but never named petergpt/bullshit-benchmark. This is the gap to close.
Show full AI answer
- CATEGORY QUERYWhat tools help benchmark an LLM's tendency to generate confident answers to false premises?you: not recommendedAI recommended (in order):
- TruthfulQA
- FactScore
- Wikidata
- HELM
- RAGAS
- DBpedia
- Scale AI
- Appen
- Amazon Mechanical Turk
- OpenAI Evals
AI recommended 10 alternatives but never named petergpt/bullshit-benchmark. This is the gap to close.
Show full AI answer
Objective checks
Rule-based audits of metadata signals AI engines weight most.
- Metadata completenesswarn
Suggestion:
- README presencepass
Self-mention check
Does AI even know your repo exists when asked about it directly?
- Compared to common alternatives in this category, what is the core differentiator of petergpt/bullshit-benchmark?passAI named petergpt/bullshit-benchmark explicitly
AI answers can be confidently wrong. Read for accuracy: does it match your actual tech stack, audience, and differentiator?
- If a team adopts petergpt/bullshit-benchmark in production, what risks or prerequisites should they evaluate first?passAI named petergpt/bullshit-benchmark explicitly
AI answers can be confidently wrong. Read for accuracy: does it match your actual tech stack, audience, and differentiator?
- In one sentence, what problem does the repo petergpt/bullshit-benchmark solve, and who is the primary audience?passAI named petergpt/bullshit-benchmark explicitly
AI answers can be confidently wrong. Read for accuracy: does it match your actual tech stack, audience, and differentiator?
Embed your GEO score
Drop this badge into the README of petergpt/bullshit-benchmark. It auto-updates whenever the report is rescanned and links back to the latest report — easy public proof that you care about AI discoverability.
[](https://repogeo.com/en/r/petergpt/bullshit-benchmark)<a href="https://repogeo.com/en/r/petergpt/bullshit-benchmark"><img src="https://repogeo.com/badge/petergpt/bullshit-benchmark.svg" alt="RepoGEO" /></a>Subscribe to Pro for deep diagnoses
petergpt/bullshit-benchmark — Lite scans stay free; this card itemizes Pro deep limits vs Lite.
- Deep reports10 / month
- Brand-free category queries5 vs 2 in Lite
- Prioritized action items8 vs 3 in Lite