autolux.mk
robots.txt

Robots Exclusion Standard data for autolux.mk

Archived Snapshots

Resource Scan

Scan Details

Site Domain	autolux.mk
Base Domain	autolux.mk
Scan Status	Ok
Last Scan	2025-11-01T20:45:59+00:00
Next Scan	2025-12-01T20:45:59+00:00

Last Scan

Scanned	2025-11-01T20:45:59+00:00
URL	https://autolux.mk/robots.txt
Domain IPs	104.21.6.58, 172.67.154.248, 2606:4700:3030::ac43:9af8, 2606:4700:3037::6815:63a
Response IP	172.67.154.248
Found	Yes
Hash	2afb4240bb41022c5a8e26d950ad02fa91083873758f7dd2f65b503f93413733
SimHash	16554d036d99

Groups

mj12bot

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-sa

Rule	Path
Disallow	/

Rule

Path

Disallow

ahrefsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

dotbot

Rule	Path
Disallow	/

Rule

Path

Disallow

dotbot

Rule	Path
Disallow	/

Rule

Path

Disallow

mauibot

Rule	Path
Disallow	/

Rule

Path

Disallow

petalbot

Rule	Path
Disallow	/

Rule

Path

Disallow

megaindex.ru/2.0

Rule	Path
Disallow	/

Rule

Path

Disallow

megaindex.ru

Rule	Path
Disallow	/

Rule

Path

Disallow

megaindex.ru

Rule	Path
Disallow	/

Rule

Path

Disallow

megaindex.com

Rule	Path
Disallow	/

Rule

Path

Disallow

blexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

webmeup-crawler

Rule	Path
Disallow	/

Rule

Path

Disallow

webmeup crawler

Rule	Path
Disallow	/

Rule

Path

Disallow

yandexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

yandex robot

Rule	Path
Disallow	/

Rule

Path

Disallow

yandex

Rule	Path
Disallow	/

Rule

Path

Disallow

barkrowler

Rule	Path
Disallow	/

Rule

Path

Disallow

adsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

mail.ru_bot

Rule	Path
Disallow	/

Rule

Path

Disallow

mail.ru_bot/2.0

Rule	Path
Disallow	/

Rule

Path

Disallow

mail.ru

Rule	Path
Disallow	/

Rule

Path

Disallow

mail.ru_bot/2.0; +http://go.mail.ru/help/robots

Rule	Path
Disallow	/

Rule

Path

Disallow

zoombot

Rule	Path
Disallow	/

Rule

Path

Disallow

zoominfobot

Rule	Path
Disallow	/

Rule

Path

Disallow

zumbot

Rule	Path
Disallow	/

Rule

Path

Disallow

newspaper robot

Rule	Path
Disallow	/

Rule

Path

Disallow

newspaper

Rule	Path
Disallow	/

Rule

Path

Disallow

crawl.sogou.com

Rule	Path
Disallow	/

Rule

Path

Disallow

sogouspider

Rule	Path
Disallow	/

Rule

Path

Disallow

sogou web spider

Rule	Path
Disallow	/

Rule

Path

Disallow

sogou spider

Rule	Path
Disallow	/

Rule

Path

Disallow

netestate

Rule	Path
Disallow	/

Rule

Path

Disallow

netestate ne crawler (+http://www.website-datenbank.de/)

Rule	Path
Disallow	/

Rule

Path

Disallow

seekport crawler

Rule	Path
Disallow	/

Rule

Path

Disallow

seokicks

Rule	Path
Disallow	/

Rule

Path

Disallow

seokicks-robot

Rule	Path
Disallow	/

Rule

Path

Disallow

coccocbot

Rule	Path
Disallow	/

Rule

Path

Disallow

clark-crawler

Rule	Path
Disallow	/

Rule

Path

Disallow

clark-crawler2

Rule	Path
Disallow	/

Rule

Path

Disallow

seznambot

Rule	Path
Disallow	/

Rule

Path

Disallow

scrapy

Rule	Path
Disallow	/

Rule

Path

Disallow

nutch

Rule	Path
Disallow	/

Rule

Path

Disallow

indeedbot

Rule	Path
Disallow	/

Rule

Path

Disallow

komodiabot

Rule	Path
Disallow	/

Rule

Path

Disallow

komodiabot/1.0

Rule	Path
Disallow	/

Rule

Path

Disallow

autolux.mkrobots.txt

Resource Scan

Scan Details

Last Scan

Groups

mj12bot

semrushbot

semrushbot-sa

ahrefsbot

dotbot

dotbot

mauibot

petalbot

megaindex.ru/2.0

megaindex.ru

megaindex.ru

megaindex.com

blexbot

webmeup-crawler

webmeup crawler

yandexbot

yandex robot

yandex

barkrowler

adsbot

mail.ru_bot

mail.ru_bot/2.0

mail.ru

mail.ru_bot/2.0; +http://go.mail.ru/help/robots

zoombot

zoominfobot

zumbot

newspaper robot

newspaper

crawl.sogou.com

sogouspider

sogou web spider

sogou spider

netestate

netestate ne crawler (+http://www.website-datenbank.de/)

seekport crawler

seokicks

seokicks-robot

coccocbot

clark-crawler

clark-crawler2

seznambot

scrapy

nutch

indeedbot

komodiabot

komodiabot/1.0

autolux.mk
robots.txt