avtoopt.in.ua
robots.txt

Robots Exclusion Standard data for avtoopt.in.ua

Resource Scan

Scan Details

Site Domain avtoopt.in.ua
Base Domain avtoopt.in.ua
Scan Status Ok
Last Scan2024-09-27T15:51:45+00:00
Next Scan 2024-10-27T15:51:45+00:00

Last Scan

Scanned2024-09-27T15:51:45+00:00
URL https://avtoopt.in.ua/robots.txt
Domain IPs 104.26.8.222, 104.26.9.222, 172.67.73.6, 2606:4700:20::681a:8de, 2606:4700:20::681a:9de, 2606:4700:20::ac43:4906
Response IP 104.26.9.222
Found Yes
Hash ea9a56beb52518c3782f594ea59ab40802f768567d25cfd6163ae600da64f718
SimHash 670c1e54ced9

Groups

*

Rule Path
Disallow /*?utm_
Disallow /*?gclid=*
Disallow /*users
Disallow /register
Disallow /signin
Disallow /lostpassword
Disallow /*sort%3D
Disallow /cart
Disallow /*?q=
Disallow /ajax*
Disallow /order*
Disallow /kat_num/*
Disallow /go/*

claudebot/1.0

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

dataforseobot/1.0

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

keys-so-bot

Rule Path
Disallow /

amazonbot/0.1

Rule Path
Disallow /

coccocbot-web/1.0

Rule Path
Disallow /

yandexmetrika/2.0

Rule Path
Disallow /

yadirectfetcher/1.0

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

yandexrenderresourcesbot/1.0

Rule Path
Disallow /

yandexaccessibilitybot/3.0

Rule Path
Disallow /

awariobot/1.0

Rule Path
Disallow /

yandexmobilebot/3.0

Rule Path
Disallow /

duckduckbot/1.1

Rule Path
Disallow /

ccbot/2.0

Rule Path
Disallow /

duckduckbot-https/1.1

Rule Path
Disallow /

inetdex-bot/2.0

Rule Path
Disallow /

trendictionbot0.5.0

Rule Path
Disallow /

blexbot/1.0

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

wellknownbot/0.1

Rule Path
Disallow /

yak/1.0

Rule Path
Disallow /

yandexrca/1.0

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

duckduckgo-favicons-bot/1.0

Rule Path
Disallow /

yandexuserproxy

Rule Path
Disallow /

coccocbot-image/1.0

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

sebot-wa

Rule Path
Disallow /

cubot_note_s

Rule Path
Disallow /

Other Records

Field Value
sitemap https://avtoopt.in.ua/sitemap.xml

Warnings

  • `host` is not a known field.