Log In Sign Up

avtomall.com.ua
robots.txt

Robots Exclusion Standard data for avtomall.com.ua

Resource Scan

Scan Details

Site Domain avtomall.com.ua
Base Domain avtomall.com.ua
Scan Status Ok
Last Scan2024-11-03T14:11:46+00:00
Next Scan 2024-12-03T14:11:46+00:00

Last Scan

Scanned2024-11-03T14:11:46+00:00
URL https://avtomall.com.ua/robots.txt
Domain IPs 168.119.40.104
Response IP 168.119.40.104
Found Yes
Hash d6c98960f0e00bd4657e7d17f62f71c4076ee4a2198f66a645a494db474e0a9d
SimHash 635ce0e04b98

Groups

*

Rule Path
Allow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

alittle client

Rule Path
Disallow /

solomonobot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

impendoom-bot

Rule Path
Disallow /

cincraw

Rule Path
Disallow /

coccocbot-image

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

bne.es_bot

Rule Path
Disallow /

seobilitybot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://avtomall.com.ua/sitemap.xml
Back to top

Warnings

  • `host` is not a known field.
Back to top