breakbeatheaven.com
robots.txt

Robots Exclusion Standard data for breakbeatheaven.com

Resource Scan

Scan Details

Site Domain breakbeatheaven.com
Base Domain breakbeatheaven.com
Scan Status Ok
Last Scan2025-10-24T19:58:46+00:00
Next Scan 2025-11-23T19:58:46+00:00

Last Scan

Scanned2025-10-24T19:58:46+00:00
URL https://breakbeatheaven.com/robots.txt
Domain IPs 104.21.25.190, 172.67.134.124, 2606:4700:3034::ac43:867c, 2606:4700:3036::6815:19be
Response IP 104.21.25.190
Found Yes
Hash e2248038aa2459d35dccc003281720ce5c9035887e5fd7f1c0eb42ce37cfbab3
SimHash e251d9ff8117

Groups

slurp

Rule Path
Disallow /

yahoo pipes 1.0

Rule Path
Disallow /

Other Records

Field Value
sitemap /sitemap/sitemap.xml

Comments

  • Yahoo bot is evil.
  • Yahoo Pipes is for feeds not web pages.
  • this technically isn't valid, since for some godforsaken reason
  • sitemap paths must be ABSOLUTE and not relative.