truthful.reviews
robots.txt

Robots Exclusion Standard data for truthful.reviews

Resource Scan

Scan Details

Site Domain truthful.reviews
Base Domain truthful.reviews
Scan Status Ok
Last Scan2026-04-14T09:02:14+00:00
Next Scan 2026-04-21T09:02:14+00:00

Last Scan

Scanned2026-04-14T09:02:14+00:00
URL https://truthful.reviews/robots.txt
Domain IPs 91.98.42.46
Response IP 91.98.42.46
Found Yes
Hash 8987e529a304b037872d3eda21a38ac29ce5c095e11194436b73661851e80d4e
SimHash 7915b852ee11

Groups

*

Rule Path
Allow /
Allow /_next/static/
Disallow /api/
Disallow /admin/
Disallow /_next/data/
Disallow /_next/image/

gptbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

oai-searchbot

Rule Path
Allow /

google-extended

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

perplexity-user

Rule Path
Allow /

claude-web

Rule Path
Allow /

claude-searchbot

Rule Path
Allow /

claudebot

Rule Path
Allow /

anthropic-ai

Rule Path
Allow /

Other Records

Field Value
sitemap https://truthful.reviews/sitemap.xml