Log In Sign Up

allroutes.ru
robots.txt

Robots Exclusion Standard data for allroutes.ru

Resource Scan

Scan Details

Site Domain allroutes.ru
Base Domain allroutes.ru
Scan Status Ok
Last Scan2024-09-26T22:28:50+00:00
Next Scan 2024-10-03T22:28:50+00:00

Last Scan

Scanned2024-09-26T22:28:50+00:00
URL https://allroutes.ru/robots.txt
Domain IPs 104.21.92.143, 172.67.195.49, 2606:4700:3031::ac43:c331, 2606:4700:3037::6815:5c8f
Response IP 104.21.92.143
Found Yes
Hash 55939fe933d54c1fafc18312e9abc0403b18bcc0402399201c5c94e9d161f1bb
SimHash 2a65e7e2cd39

Groups

*

Rule Path
Disallow /test*
Disallow /ajax*
Allow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

nutch

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://allroutes.ru/sitemap.xml.gz
Back to top

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.
Back to top