Log In Sign Up

myband.ru
robots.txt

Robots Exclusion Standard data for myband.ru

Resource Scan

Scan Details

Site Domain myband.ru
Base Domain myband.ru
Scan Status Ok
Last Scan2024-10-22T00:58:55+00:00
Next Scan 2024-11-21T00:58:55+00:00

Last Scan

Scanned2024-10-22T00:58:55+00:00
URL https://myband.ru/robots.txt
Domain IPs 104.21.78.87, 172.67.219.16, 2606:4700:3032::ac43:db10, 2606:4700:3033::6815:4e57
Response IP 172.67.219.16
Found Yes
Hash 505cbb28c98f149916543f96aa0133e69449dd64b77905d488f31f3bea2e400e
SimHash a16c5b306a9a

Groups

*

Rule Path
Disallow /messages/
Disallow /places/
Disallow /photo/
Disallow /track/

megaindex.ru

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

python-requests/2.10.0

Rule Path
Disallow /

python-urllib/2.6

Rule Path
Disallow /

wsdl2objc

Rule Path
Disallow /

dataparksearch/4.54-2016-10-26 (+http://dataparksearch.org/bot)

Rule Path
Disallow /

go-http-client/1.1

Rule Path
Disallow /

bsp spider

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

exabot

Rule Path
Disallow /

idbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-news

Rule Path
Disallow /

baiduspider-favo

Rule Path
Disallow /

baiduspider-cpro

Rule Path
Disallow /

baiduspider-ads

Rule Path
Disallow /

baidu

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

flipboardproxy

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://myband.ru/sitemap.xml
Back to top

Warnings

  • `host` is not a known field.
Back to top