johntshaw.net
robots.txt
Robots Exclusion Standard data for johntshaw.net
Resource Scan
Scan Details
Site Domain | johntshaw.net |
Base Domain | johntshaw.net |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2024-07-16T08:53:39+00:00 |
Next Scan | 2024-10-14T08:53:39+00:00 |
Last Successful Scan
Scanned | 2022-12-01T21:53:12+00:00 |
URL | https://johntshaw.net/robots.txt |
Redirect | https://www.johntshaw.net/robots.txt |
Redirect Domain | www.johntshaw.net |
Redirect Base | johntshaw.net |
Domain IPs | 104.21.27.101, 172.67.142.63 |
Redirect IPs | 104.21.27.101, 172.67.142.63 |
Response IP | 104.21.27.101 |
Found | Yes |
Hash | 66826825b9ba604da3da82c2e52a5565075aa638443cd710f18c22840f00ff7f |
SimHash | 7d551c04cd92 |
Other Records
Field | Value |
---|---|
sitemap | http://www.johntshaw.net/sitemap.xml |