bigdonsboys.com
robots.txt

Robots Exclusion Standard data for bigdonsboys.com

Resource Scan

Scan Details

Site Domain bigdonsboys.com
Base Domain bigdonsboys.com
Scan Status Ok
Last Scan2025-10-06T03:43:04+00:00
Next Scan 2025-10-13T03:43:04+00:00

Last Scan

Scanned2025-10-06T03:43:04+00:00
URL https://bigdonsboys.com/robots.txt
Domain IPs 104.21.62.211, 172.67.139.86, 2606:4700:3030::ac43:8b56, 2606:4700:3037::6815:3ed3
Response IP 172.67.139.86
Found Yes
Hash 269dc7b60c59a6c4c099066597d7b584aed8191081515aae606cf4534dd86a41
SimHash 651854c4c595

Groups

*
*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

Other Records

Field Value
sitemap https://bigdonsboys.com/sitemap.xml