pegasuschauffeur.com
robots.txt

Robots Exclusion Standard data for pegasuschauffeur.com

Resource Scan

Scan Details

Site Domain pegasuschauffeur.com
Base Domain pegasuschauffeur.com
Scan Status Ok
Last Scan2025-08-13T16:39:35+00:00
Next Scan 2025-09-12T16:39:35+00:00

Last Scan

Scanned2025-08-13T16:39:35+00:00
URL https://pegasuschauffeur.com/robots.txt
Domain IPs 108.157.254.109, 108.157.254.124, 108.157.254.22, 108.157.254.71
Response IP 108.157.254.109
Found Yes
Hash 4c117e2dd7565edfd602e56c9564e6c00d0df0ec96c290a3278cd637ac90e120
SimHash 6914add7e733

Groups

*

Rule Path
Allow /

oai-searchbot

Rule Path
Allow /

Other Records

Field Value
sitemap https://pegasuschauffeur.com/sitemap.xml

Comments

  • Allow all crawlers
  • Explicitly allow ChatGPT's crawler (OAI-Searchbot)
  • Host
  • Sitemaps

Warnings

  • `host` is not a known field.