checkwitharthur.com
robots.txt

Robots Exclusion Standard data for checkwitharthur.com

Resource Scan

Scan Details

Site Domain checkwitharthur.com
Base Domain checkwitharthur.com
Scan Status Ok
Last Scan2025-09-18T23:54:16+00:00
Next Scan 2025-09-25T23:54:16+00:00

Last Scan

Scanned2025-09-18T23:54:16+00:00
URL https://checkwitharthur.com/robots.txt
Domain IPs 50.87.249.29
Response IP 50.87.249.29
Found Yes
Hash 3ce6c9069bd454f90955bb9c1ecefcb24dd90d8ffc8226b5aa18089d8c3141f8
SimHash 691d7d45c7d3

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /g/
Disallow /s/

Other Records

Field Value
sitemap https://www.checkwitharthur.com/sitemap.txt