bobknudsen.com
robots.txt

Robots Exclusion Standard data for bobknudsen.com

Resource Scan

Scan Details

Site Domain bobknudsen.com
Base Domain bobknudsen.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-08-18T04:41:18+00:00
Next Scan 2025-11-16T04:41:18+00:00

Last Successful Scan

Scanned2024-01-26T20:56:05+00:00
URL https://bobknudsen.com/robots.txt
Redirect https://www.bobknudsen.com.bobknudsen.com/robots.txt
Redirect Domain www.bobknudsen.com.bobknudsen.com
Redirect Base bobknudsen.com
Domain IPs 2001:4860:4802:32::15, 2001:4860:4802:34::15, 2001:4860:4802:36::15, 2001:4860:4802:38::15, 216.239.32.21, 216.239.34.21, 216.239.36.21, 216.239.38.21
Redirect IPs 142.251.175.121, 2404:6800:4003:c0f::79
Response IP 74.125.200.121
Found Yes
Hash f6684d1d9d3ab44177ccb7588d58690e81aebdc94e7318517ba636de6346efc1
SimHash 2b0492704f12

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /search
Allow /

Other Records

Field Value
sitemap https://www.bobknudsen.com.bobknudsen.com/sitemap.xml