inimene.ee
robots.txt

Robots Exclusion Standard data for inimene.ee

Resource Scan

Scan Details

Site Domain inimene.ee
Base Domain inimene.ee
Scan Status Ok
Last Scan2025-09-17T20:33:35+00:00
Next Scan 2025-09-24T20:33:35+00:00

Last Scan

Scanned2025-09-17T20:33:35+00:00
URL https://inimene.ee/robots.txt
Domain IPs 217.146.69.2
Response IP 217.146.69.2
Found Yes
Hash d352b4c8bde0aa58a4fb636d2a90f6c9de4b1d5ca20bfe2292236219c7bdce64
SimHash 5c1d4d42ce91

Groups

*

Rule Path
Disallow /admin/
Disallow /engine/
Disallow /module/
Disallow /errorPages/
Disallow /config/
Disallow /widgetModule/
Disallow /logs/

Other Records

Field Value
crawl-delay 2

yandexbot
yandex
semrushbot
blexbot
semrushbot-sa
seznambot
semrushbot/1.2~bl

Rule Path
Disallow /

Other Records

Field Value
sitemap /sitemap.xml

Comments

  • /robots.txt