autosite.ua
robots.txt

Robots Exclusion Standard data for autosite.ua

Resource Scan

Scan Details

Site Domain autosite.ua
Base Domain autosite.ua
Scan Status Ok
Last Scan2024-05-28T01:16:47+00:00
Next Scan 2024-06-04T01:16:47+00:00

Last Scan

Scanned2024-05-28T01:16:47+00:00
URL https://autosite.ua/robots.txt
Domain IPs 77.120.101.154
Response IP 77.120.101.154
Found Yes
Hash a64ff8c132396df9b844b080cde045531af7080a680cd0aa569c6bf5402ded52
SimHash 965dc6d2c998

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /used_results.html
Disallow /zapchasti_results.html
Disallow /catalog_master.html
Disallow /account/notepad/
Disallow /compare.html
Disallow /new_compare.html
Disallow /error.html
Disallow /404.html

trendictionbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ahrefssiteaudit

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

Warnings

  • `host` is not a known field.