breadahead.com
robots.txt

Robots Exclusion Standard data for breadahead.com

Resource Scan

Scan Details

Site Domain breadahead.com
Base Domain breadahead.com
Scan Status Ok
Last Scan2025-08-25T17:21:50+00:00
Next Scan 2025-09-24T17:21:50+00:00

Last Scan

Scanned2025-08-25T17:21:50+00:00
URL https://breadahead.com/robots.txt
Domain IPs 104.19.154.92
Response IP 104.19.154.92
Found Yes
Hash 43c525d77d1d91b0c443790df3b6f74b62329d62a4824ceba289fb4b707b795c
SimHash 6c704b2067b3

Groups

*

Rule Path
Disallow
Disallow /cgi-bin/

Comments

  • Allow crawling of all content