avtomax.ua
robots.txt

Robots Exclusion Standard data for avtomax.ua

Resource Scan

Scan Details

Site Domain avtomax.ua
Base Domain avtomax.ua
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-03-07T12:44:48+00:00
Next Scan 2025-06-05T12:44:48+00:00

Last Successful Scan

Scanned2024-02-12T08:36:59+00:00
URL https://avtomax.ua/robots.txt
Domain IPs 104.21.50.49, 172.67.157.28, 2606:4700:3031::6815:3231, 2606:4700:3031::ac43:9d1c
Response IP 172.67.157.28
Found Yes
Hash ff3ff438ce0afe68c43aa8858f90ce265f555d0285f0ac400951456591291d8e
SimHash 0129cac2033b

Groups

mediapartners-google

Rule Path
Disallow

yadirectfetcher

Rule Path
Disallow

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

solomonobot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

blekkobot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

proximic

Rule Path
Disallow /

*

Rule Path
Allow /img/*?storage
Allow /frontend/compiled.js
Allow /search/AsyncFilters
Allow /news.html?page=
Allow /testdrive.html?page=
Allow /search/adpage/*
Disallow *?
Disallow */terms.html
Disallow */policy.html
Disallow */about.html
Disallow */feedback.html
Disallow /*/outclick
Disallow */search/*
Disallow */login.html

yandex

Rule Path
Disallow *?
Disallow */terms.html
Disallow */policy.html
Disallow */about.html
Disallow */feedback.html
Disallow /*/outclick
Disallow */search/*
Allow /search/adpage/*
Disallow */login.html
Allow /news.html?page=
Allow /testdrive.html?page=

Warnings

  • `host` is not a known field.