weather.ee
robots.txt

Robots Exclusion Standard data for weather.ee

Resource Scan

Scan Details

Site Domain weather.ee
Base Domain weather.ee
Scan Status Ok
Last Scan2024-11-13T22:05:11+00:00
Next Scan 2024-11-20T22:05:11+00:00

Last Scan

Scanned2024-11-13T22:05:11+00:00
URL https://weather.ee/robots.txt
Domain IPs 217.146.68.146
Response IP 217.146.68.146
Found Yes
Hash fd5eebfa3a75725dea001580f04a8a753c8c971471041638b577db425e8d7c8b
SimHash 321227428e59

Groups

*

Rule Path
Disallow /kola/
Disallow /2
Disallow /MindTerm/
Disallow /ban
Disallow /client/
Disallow /data/
Disallow /diktor/
Disallow /errors/
Disallow /images/
Disallow /kaamera
Disallow /mail
Disallow /muudamind/
Disallow /operatiivinfo/
Disallow /squirrelmail/
Disallow /stat
Disallow /tingmargid/
Disallow /tsweb/

Comments

  • Robots Exclusion Standard file
  • read more from http://info.webcrawler.com/mak/projects/robots/robots.html
  • Disallow: /analog
  • Disallow: /css
  • Disallow: /sisu/