locator.ua
robots.txt

Robots Exclusion Standard data for locator.ua

Resource Scan

Scan Details

Site Domain locator.ua
Base Domain locator.ua
Scan Status Ok
Last Scan2024-11-12T15:52:01+00:00
Next Scan 2024-11-19T15:52:01+00:00

Last Scan

Scanned2024-11-12T15:52:01+00:00
URL https://locator.ua/robots.txt
Domain IPs 104.21.60.10, 172.67.186.214, 2606:4700:3031::ac43:bad6, 2606:4700:3034::6815:3c0a
Response IP 104.21.60.10
Found Yes
Hash 33d7589a89e5b6950771322060d929069ebb19e339641911d2ce5a83fcc88e40
SimHash 867fd863ef8d

Groups

*

Rule Path
Disallow /1
Disallow /2
Disallow /3
Disallow /4
Disallow /shop
Disallow /upanel/
Disallow /login/
Disallow /report.php
Disallow /email.php
Disallow /list.php
Disallow /%3C
Disallow /%
Disallow /*locality%3D1$
Disallow /leave/
Disallow /dynobj3.php
Disallow /lapi.php
Disallow /out.php
Disallow /js/
Disallow /hot/
Disallow /search.php
Disallow /en/
Disallow /bye/
Disallow /mariupol/
Disallow /doneck/
Disallow /luhansk/
Disallow /brovary/
Disallow /cherkasy/
Disallow /chernivci/
Disallow /dnipro/
Disallow /irpin/
Disallow /ivano-frankivsk/
Disallow /kharkiv/
Disallow /khmelnyckyj/
Disallow /kropyvnyckyj/
Disallow /kryvyj-rih/
Disallow /kyivska-obl./
Disallow /lviv/
Disallow /mykolaiv/
Disallow /odesa/
Disallow /phone/
Disallow /uzhhorod/
Disallow /vinnycya/
Disallow /zaporizhzhya/
Disallow /zhytomyr/
Disallow /phone/
Disallow /boryspil/
Disallow /derazhnya/
Disallow /kalush/
Disallow /kamyanske/
Disallow /kobelyaky/
Disallow /komisarivka/
Disallow /kramatorsk/
Disallow /nizhyn/
Disallow /oleksandriya/
Disallow /petropavlivska-borshchahivka/
Disallow /pidhorodne/
Disallow /pl/
Disallow /polonne/
Disallow /rivne/
Disallow /romny/
Disallow /valky/
Disallow /volodymyr/
Disallow /bbb/
Disallow /berehove/
Disallow /evpatoriya/
Disallow /horenka/
Disallow /kalush/
Disallow /kremenchuk/
Disallow /phones/
Disallow /ustymivka/
Disallow /berezna/
Disallow /kalanchak/
Disallow /khryplyn/
Disallow /komisarivka/
Disallow /pidhorodne/
Disallow /ru/l/ivano-frankivsk/
Disallow /ua/l/ivano-frankivsk/
Disallow /shack/
Disallow /slovyansk/
Disallow /valky/
Disallow /zolochiv

seznambot

Rule Path
Disallow /

hubspot webcrawler

Rule Path
Disallow /

hubspot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

barkrowler/0.9

Rule Path
Disallow /

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

megaindex.ru

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

serpstatbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

awariorssbot
awariosmartbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

duckduckgo-favicons-bot

Rule Path
Disallow /

bluechipbacklinks

Rule Path
Disallow /

ltx71 - (http://ltx71.com/)

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

startmebot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

geedobot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

senutobot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /