regionoperator.ru
robots.txt

Robots Exclusion Standard data for regionoperator.ru

Resource Scan

Scan Details

Site Domain regionoperator.ru
Base Domain regionoperator.ru
Scan Status Ok
Last Scan2024-11-14T16:12:36+00:00
Next Scan 2024-11-21T16:12:36+00:00

Last Scan

Scanned2024-11-14T16:12:36+00:00
URL https://regionoperator.ru/robots.txt
Domain IPs 104.21.15.184, 172.67.163.195, 2606:4700:3032::6815:fb8, 2606:4700:3035::ac43:a3c3
Response IP 104.21.15.184
Found Yes
Hash c4e2b4620b94fe30c13a5eba35d04c8395c3fdacb0aa32a8120e3e72dbfdc44a
SimHash 0a65efeacd39

Groups

*

Rule Path
Allow *
Disallow /img/ico/*
Disallow /noindex/
Disallow /noindex/*
Disallow /images/
Disallow /images/*

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

nutch

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

Other Records

Field Value
sitemap https://regionoperator.ru/sitemap/important-phones.xml.gz
sitemap https://regionoperator.ru/sitemap.xml

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.