pilgrimasp.com
robots.txt
Robots Exclusion Standard data for pilgrimasp.com
Resource Scan
Scan Details
Site Domain | pilgrimasp.com |
Base Domain | pilgrimasp.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2024-09-22T16:12:32+00:00 |
Next Scan | 2024-12-21T16:12:32+00:00 |
Last Successful Scan
Scanned | 2023-11-03T20:26:58+00:00 |
URL | http://pilgrimasp.com/robots.txt |
Domain IPs | 205.178.189.129 |
Response IP | 205.178.189.129 |
Found | Yes |
Hash | 0ba83dffd49aeef1b356e01d91c0b48661485b6c768b90e637428488a730cb4f |
SimHash | 205c71747c55 |
Groups
*
Rule | Path |
---|---|
Disallow | /googleresults.jsp |
Disallow | /results.jsp |
Disallow | /results-b.jsp |
Disallow | /ns-results.jsp |
Disallow | /w-results.jsp |
Disallow | /s-results.jsp |
Disallow | /results-travel.jsp |
Disallow | /results-medical.jsp |
Disallow | /tc-results.jsp |
Disallow | /m-results.jsp |
Disallow | /results-monster.jsp |
Disallow | /emailAdCampaign.jsp |
Disallow | /domainSearch.jsp |