Log In Sign Up

rudorogi.ru
robots.txt

Robots Exclusion Standard data for rudorogi.ru

Resource Scan

Scan Details

Site Domain rudorogi.ru
Base Domain rudorogi.ru
Scan Status Ok
Last Scan2024-09-21T22:08:46+00:00
Next Scan 2024-09-28T22:08:46+00:00

Last Scan

Scanned2024-09-21T22:08:46+00:00
URL https://rudorogi.ru/robots.txt
Domain IPs 188.130.153.32, 188.130.153.33
Response IP 188.130.153.32
Found Yes
Hash 400f47f3e2a88667d73d0576272c65fe77de782af0c2a120514d2202dd857080
SimHash 724cd7404e33

Groups

mediapartners-google

Rule Path
Disallow

rogerbot
dotbot
ahrefsbot
mj12bot
linkdexbot
sosospider
proximic
baiduspider
baiduspider-video
baiduspider-image
naverbot
yeti
coccoc
blexbot
sogou spider
semrushbot
cliqzbot

Rule Path
Disallow /

*

Rule Path
Disallow /away
Disallow /articles/search
Back to top

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.
Back to top