Log In Sign Up

mestorator.ru
robots.txt

Robots Exclusion Standard data for mestorator.ru

Resource Scan

Scan Details

Site Domain mestorator.ru
Base Domain mestorator.ru
Scan Status Ok
Last Scan2025-04-10T23:24:29+00:00
Next Scan 2025-05-10T23:24:29+00:00

Last Scan

Scanned2025-04-10T23:24:29+00:00
URL https://mestorator.ru/robots.txt
Domain IPs 104.21.75.96, 172.67.219.98, 2606:4700:3032::ac43:db62, 2606:4700:3035::6815:4b60
Response IP 104.21.75.96
Found Yes
Hash 2401f7c79b0e6366ac98e57743c12481590a8464d095a13f04dea6f23a503f25
SimHash 2811c8aaefe1

Groups

mj12bot

Rule Path
Disallow /

sputnikbot
*

Rule Path
Disallow /p/
Disallow /all-notice*
Disallow /my_notices.html*
Disallow *editnotice*
Disallow /index.html*
Disallow *_html*
Disallow *showform*
Disallow *arenda-*
Disallow */auth*
Back to top

Warnings

  • `host` is not a known field.
Back to top