perscent.app
robots.txt

Robots Exclusion Standard data for perscent.app

Resource Scan

Scan Details

Site Domain perscent.app
Base Domain perscent.app
Scan Status Ok
Last Scan2026-03-15T23:33:36+00:00
Next Scan 2026-03-22T23:33:36+00:00

Last Scan

Scanned2026-03-15T23:33:36+00:00
URL https://perscent.app/robots.txt
Domain IPs 216.198.79.1, 64.29.17.65
Response IP 64.29.17.1
Found Yes
Hash 4ffabc98cfceda69ccba85445c02ee6ffa6dae1de1e1bf7d59559e8cdcbdabbc
SimHash 6c9859166682

Groups

*

Rule Path
Allow /
Allow /blog/
Allow /essence-enigma/
Allow /quiz/
Allow /contact/
Disallow /terms
Disallow /policy
Disallow /disclaimer
Disallow /api/
Disallow /_next/
Disallow /*/_next/
Disallow /*?
Disallow /*%3D
Disallow /*.json$
Disallow /*.js$
Disallow /*.css$

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

googlebot

Rule Path
Allow /
Allow /*.js$
Allow /*.css$
Allow /*.png$
Allow /*.jpg$
Allow /*.gif$
Allow /*.svg$
Allow /*.webp$
Allow /*.mp3$
Allow /*.m4a$

bingbot

Rule Path
Allow /
Allow /*.js$
Allow /*.css$
Allow /images/

Other Records

Field Value
sitemap https://perscent.app/sitemap.xml

Comments

  • Block AI scraping and training
  • Search engine specific rules
  • Sitemaps