yourwebsitename.com
robots.txt
Robots Exclusion Standard data for yourwebsitename.com
Resource Scan
Scan Details
Site Domain | yourwebsitename.com |
Base Domain | yourwebsitename.com |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2024-04-29T18:52:39+00:00 |
Next Scan | 2024-06-28T18:52:39+00:00 |
Last Successful Scan
Scanned | 2022-10-28T07:53:49+00:00 |
URL | https://yourwebsitename.com/robots.txt |
Redirect | http://yourwebsitename.com/robots.txt |
Response IP | 45.56.79.23, 198.58.118.167, 45.33.23.183, 96.126.123.244, 45.79.19.196, 45.33.2.79, 173.255.194.134, 72.14.185.43, 45.33.18.44, 45.33.30.197, 72.14.178.174, 45.33.20.235 |
Found | Yes |
Hash | c0afd7f31bd33b9260f152dbab90c0e0142dc074b268448c94e664252e83ff0c |
SimHash | 4a54d4954550 |
Groups
*
Rule | Path |
---|---|
Disallow | / |