cache.legacy.net
robots.txt

Robots Exclusion Standard data for cache.legacy.net

Resource Scan

Scan Details

Site Domain cache.legacy.net
Base Domain legacy.net
Scan Status Ok
Last Scan2024-05-24T23:36:38+00:00
Next Scan 2024-06-23T23:36:38+00:00

Last Scan

Scanned2024-05-24T23:36:38+00:00
URL https://cache.legacy.net/robots.txt
Domain IPs 104.17.105.199, 104.17.106.199, 104.17.107.199, 104.17.108.199, 104.17.109.199
Response IP 104.17.106.199
Found Yes
Hash a9591cda4499be9580613857f8450531a9e7451d5f30b8caa190a4870c8a58b9
SimHash e489d6c0e595

Groups

googlebot/

Rule Path
Disallow /legacy/multimedia

mediapartners-google*

Rule Path
Disallow /legacy/multimedia

architext spider

Rule Path
Disallow /legacy/multimedia

scooter

Rule Path
Disallow /legacy/multimedia

mercator

Rule Path
Disallow /legacy/multimedia

ask jeeves

Rule Path
Disallow /legacy/multimedia

slurp

Rule Path
Disallow /legacy/multimedia

teomaagent

Rule Path
Disallow /legacy/multimedia

fast-webcrawler

Rule Path
Disallow /legacy/multimedia

infoseek sidewinder/

Rule Path
Disallow /legacy/multimedia

lycos_spider_(t-rex)

Rule Path
Disallow /legacy/multimedia

lycos_spide_(modspider)

Rule Path
Disallow /legacy/multimedia

crawler

Rule Path
Disallow /legacy/multimedia

mantraagent

Rule Path
Disallow /legacy/multimedia

zyborg

Rule Path
Disallow /legacy/multimedia

webcrawler

Rule Path
Disallow /legacy/multimedia

msnbot/

Rule Path
Disallow /legacy/multimedia

gulliver

Rule Path
Disallow /legacy/multimedia

gigabot/

Rule Path
Disallow /legacy/multimedia

freshbot

Rule Path
Disallow /legacy/multimedia

goforit.com

Rule Path
Disallow /legacy/multimedia

gsa-crawler

Rule Path
Disallow /legacy/multimedia

inktomi search

Rule Path
Disallow /legacy/multimedia

yahooseeker/1.2

Rule Path
Disallow /legacy/multimedia

*

Rule Path
Disallow /legacy/multimedia