html.store.yahoodns.net
robots.txt
Robots Exclusion Standard data for html.store.yahoodns.net
Resource Scan
Scan Details
Site Domain | html.store.yahoodns.net |
Base Domain | yahoodns.net |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Request timed out. |
Last Scan | 2024-06-16T01:48:58+00:00 |
Next Scan | 2024-09-14T01:48:58+00:00 |
Last Successful Scan
Scanned | 2023-04-29T07:34:12+00:00 |
URL | http://html.store.yahoodns.net/robots.txt |
Domain IPs | 74.6.52.135, 98.139.28.145 |
Response IP | 74.6.52.135 |
Found | Yes |
Hash | a0007e1d09b34c4290d0a990565bc66f1fe6cfc32bab413ec4fc5f082d4c4c06 |
SimHash | a8216507efb0 |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /RT/ |
Disallow | /TG/ |
Disallow | /QS/ |
Disallow | /wgl/ |
Disallow | /P/ |
Disallow | /ymix/ |
Disallow | /OS/ |
Disallow | /cs/ |
Disallow | /en%3D |
Disallow | /io%3D |
Disallow | /*/cgi-bin/ |
Comments