html.store.yahoodns.net
robots.txt

Robots Exclusion Standard data for html.store.yahoodns.net

Resource Scan

Scan Details

Site Domain html.store.yahoodns.net
Base Domain yahoodns.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonRequest timed out.
Last Scan2024-06-16T01:48:58+00:00
Next Scan 2024-09-14T01:48:58+00:00

Last Successful Scan

Scanned2023-04-29T07:34:12+00:00
URL http://html.store.yahoodns.net/robots.txt
Domain IPs 74.6.52.135, 98.139.28.145
Response IP 74.6.52.135
Found Yes
Hash a0007e1d09b34c4290d0a990565bc66f1fe6cfc32bab413ec4fc5f082d4c4c06
SimHash a8216507efb0

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /RT/
Disallow /TG/
Disallow /QS/
Disallow /wgl/
Disallow /P/
Disallow /ymix/
Disallow /OS/
Disallow /cs/
Disallow /en%3D
Disallow /io%3D
Disallow /*/cgi-bin/

roverbot

Rule Path
Disallow /

Comments

  • Cap is html
  • Rover is a bad dog <http://www.roverbot.com>