bob-web.com
robots.txt

Robots Exclusion Standard data for bob-web.com

Resource Scan

Scan Details

Site Domain bob-web.com
Base Domain bob-web.com
Scan Status Ok
Last Scan2025-10-06T07:03:38+00:00
Next Scan 2025-11-05T07:03:38+00:00

Last Scan

Scanned2025-10-06T07:03:38+00:00
URL https://bob-web.com/robots.txt
Domain IPs 104.21.51.249, 172.67.192.129, 2606:4700:3030::ac43:c081, 2606:4700:3034::6815:33f9
Response IP 172.67.192.129
Found Yes
Hash 4cd602a3a610ec27e614f904990efd3671fb7b60e363774153d371a729aa21ce
SimHash 61154d40ed53

Groups

*

Rule Path
Disallow /cdn-cgi/

Other Records

Field Value
sitemap https://bob-web.com/sitemap_index.xml