resource.org
robots.txt
Robots Exclusion Standard data for resource.org
Resource Scan
Scan Details
Site Domain | resource.org |
Base Domain | resource.org |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2024-08-23T20:00:34+00:00 |
Next Scan | 2024-11-21T20:00:34+00:00 |
Last Successful Scan
Scanned | 2022-10-08T06:48:54+00:00 |
URL | http://resource.org/robots.txt |
Redirect | https://public.resource.org/robots.txt |
Redirect Domain | public.resource.org |
Redirect Base | resource.org |
Response IP | 13.33.33.124, 13.33.33.52, 13.33.33.23, 13.33.33.78 |
Found | Yes |
Hash | 4a61fc2d95bc5738f827c9edc514f7e4c91c4105fb95391d3a6de033d3d85409 |
SimHash | 5400c130c374 |
Groups
*
Rule | Path |
---|---|
Disallow | /aaron/pub/msg00399.html |
Disallow | /aaron/pub/msg00398.html |
Disallow | /aaron/pub/msg00397.html |
Disallow | /aaron/pub/msg00396.html |
Comments