Log In Sign Up

motorhunter.ru
robots.txt

Robots Exclusion Standard data for motorhunter.ru

Resource Scan

Scan Details

Site Domain motorhunter.ru
Base Domain motorhunter.ru
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-05-31T21:51:07+00:00
Next Scan 2025-06-14T21:51:07+00:00

Last Successful Scan

Scanned2025-05-16T20:46:58+00:00
URL https://motorhunter.ru/robots.txt
Redirect https://www.motorhunter.ru/robots.txt
Redirect Domain www.motorhunter.ru
Redirect Base motorhunter.ru
Domain IPs 178.250.159.243
Redirect IPs 178.250.159.243
Response IP 178.250.159.243
Found Yes
Hash 7ed9d8b8bf9451cff0b5254fffcf135ef5d6c179c72c260484c579dfd4ebdda4
SimHash 0b54c4435133

Groups

yandex

Rule Path
Disallow /razrab/

googlebot

Rule Path
Disallow

mediapartners-google

Rule Path
Disallow

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dataforseobot/1.0

Rule Path
Disallow /

serpstatbot/2.1

Rule Path
Disallow /

dotbot/1.2

Rule Path
Disallow /

blexbot/1.0

Rule Path
Disallow /

semrushbot/7~bl

Rule Path
Disallow /

keys-so-bot

Rule Path
Disallow /
Back to top

Warnings

  • `host` is not a known field.
Back to top