auto-plast.eu
robots.txt

Robots Exclusion Standard data for auto-plast.eu

Archived Snapshots

Resource Scan

Scan Details

Site Domain	auto-plast.eu
Base Domain	auto-plast.eu
Scan Status	Ok
Last Scan	2024-09-27T18:38:49+00:00
Next Scan	2024-10-04T18:38:49+00:00

Last Scan

Scanned	2024-09-27T18:38:49+00:00
URL	https://auto-plast.eu/robots.txt
Domain IPs	91.194.229.98
Response IP	91.194.229.98
Found	Yes
Hash	30306a69d730aeecf9f9038fed66f8c55dec1843df5057ee80f550cf43203197
SimHash	4b1d45426080

Groups

xovibot

Rule	Path
Disallow	/

Rule

Path

Disallow

wotbox

Rule	Path
Disallow	/

Rule

Path

Disallow

wbsearchbot

Rule	Path
Disallow	/

Rule

Path

Disallow

unisterbot

Rule	Path
Disallow	/

Rule

Path

Disallow

turnitinbot

Rule	Path
Disallow	/

Rule

Path

Disallow

spbot

Rule	Path
Disallow	/

Rule

Path

Disallow

sogou spider

Rule	Path
Disallow	/

Rule

Path

Disallow

smtbot

Rule	Path
Disallow	/

Rule

Path

Disallow

siteexplorer

Rule	Path
Disallow	/

Rule

Path

Disallow

sistrix

Rule	Path
Disallow	/

Rule

Path

Disallow

seznambot

Rule	Path
Disallow	/

Rule

Path

Disallow

seokicks-robot

Rule	Path
Disallow	/

Rule

Path

Disallow

sentibot

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot

Rule	Path
Disallow	/

Rule

Path

Disallow

searchmetricsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

screenerbot

Rule	Path
Disallow	/

Rule

Path

Disallow

publiclibraryarchive.org

Rule	Path
Disallow	/

Rule

Path

Disallow

panscient.com

Rule	Path
Disallow	/

Rule

Path

Disallow

nutch

Rule	Path
Disallow	/

Rule

Path

Disallow

netestate ne crawler

Rule	Path
Disallow	/

Rule

Path

Disallow

mj12bot

Rule	Path
Disallow	/wp-includes/
Disallow	/wp-admin/

Rule

Path

Disallow

/wp-includes/

Disallow

/wp-admin/

Other Records

Field	Value
crawl-delay	10

Field

Value

crawl-delay

mixbot

Rule	Path
Disallow	/

Rule

Path

Disallow

memorybot

Rule	Path
Disallow	/

Rule

Path

Disallow

megaindex.ru/2.0

Rule	Path
Disallow	/

Rule

Path

Disallow

megaindex.ru

Rule	Path
Disallow	/

Rule

Path

Disallow

meanpathbot

Rule	Path
Disallow	/

Rule

Path

Disallow

mail.ru

Rule	Path
Disallow	/

Rule

Path

Disallow

lipperhey

Rule	Path
Disallow	/

Rule

Path

Disallow

linkpadbot

Rule	Path
Disallow	/

Rule

Path

Disallow

istellabot

Rule	Path
Disallow	/

Rule

Path

Disallow

heritrix

Rule	Path
Disallow	/

Rule

Path

Disallow

googlebot

Rule	Path
Disallow	/wp-admin/

Rule

Path

Disallow

/wp-admin/

feedbooster

Rule	Path
Disallow	/

Rule

Path

Disallow

ezooms

Rule	Path
Disallow	/

Rule

Path

Disallow

exb language crawler

Rule	Path
Disallow	/

Rule

Path

Disallow

easouspider

Rule	Path
Disallow	/

Rule

Path

Disallow

bubing

Rule	Path
Disallow	/

Rule

Path

Disallow

bpimagewalker/2.0

Rule	Path
Disallow	/

Rule

Path

Disallow

blexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

advbot

Rule	Path
Disallow	/

Rule

Path

Disallow

aboundexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

abonti

Rule	Path
Disallow	/

Rule

Path

Disallow

*

Rule	Path
Disallow	/wp-includes/
Disallow	/wp-admin/
Allow	/wp-admin/admin-ajax.php

Rule

Path

Disallow

/wp-includes/

Disallow

/wp-admin/

Allow

/wp-admin/admin-ajax.php

Other Records

Field	Value
crawl-delay	10

Field

Value

crawl-delay

Other Records

Field	Value
sitemap	http://auto-plast.eu/sitemap_index.xml

Field

Value

sitemap

http://auto-plast.eu/sitemap_index.xml

auto-plast.eurobots.txt

Resource Scan

Scan Details

Last Scan

Groups

xovibot

wotbox

wbsearchbot

unisterbot

turnitinbot

spbot

sogou spider

smtbot

siteexplorer

sistrix

seznambot

seokicks-robot

sentibot

semrushbot

searchmetricsbot

screenerbot

publiclibraryarchive.org

panscient.com

nutch

netestate ne crawler

mj12bot

Other Records

mixbot

memorybot

megaindex.ru/2.0

megaindex.ru

meanpathbot

mail.ru

lipperhey

linkpadbot

istellabot

heritrix

googlebot

feedbooster

ezooms

exb language crawler

easouspider

bubing

bpimagewalker/2.0

blexbot

advbot

aboundexbot

abonti

*

Other Records

Other Records

auto-plast.eu
robots.txt