blackbreadco.com
robots.txt

Robots Exclusion Standard data for blackbreadco.com

Resource Scan

Scan Details

Site Domain blackbreadco.com
Base Domain blackbreadco.com
Scan Status Ok
Last Scan2025-10-11T21:53:16+00:00
Next Scan 2025-10-25T21:53:16+00:00

Last Scan

Scanned2025-10-11T21:53:16+00:00
URL https://blackbreadco.com/robots.txt
Domain IPs 104.21.52.73, 172.67.196.176, 2606:4700:3032::6815:3449, 2606:4700:3036::ac43:c4b0
Response IP 104.21.52.73
Found Yes
Hash 42d4118e1d2fa94e88b644dbb367ff21b208c54913e2df8816270051d58db3c1
SimHash 6c4cdc91c283

Groups

lumenapi

Rule Path
Disallow /

lumen

Rule Path
Disallow /

googlebot

Rule Path
Disallow

googlebot-image
googlebot-mobile

Rule Path
Disallow

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://blackbreadco.com/sitemap.xml