accudienst.nl
robots.txt

Robots Exclusion Standard data for accudienst.nl

Archived Snapshots

Resource Scan

Scan Details

Site Domain	accudienst.nl
Base Domain	accudienst.nl
Scan Status	Ok
Last Scan	2024-09-18T11:12:31+00:00
Next Scan	2024-10-18T11:12:31+00:00

Last Scan

Scanned	2024-09-18T11:12:31+00:00
URL	https://www.accudienst.nl/robots.txt
Domain IPs	213.163.83.230
Response IP	213.163.83.230
Found	Yes
Hash	ee6425a203262e92935495b87afa9aa8f4e62cf5717035fd4f4805fd56e6b589
SimHash	5b767541d8a0

Groups

mojeekbot

Rule	Path
Disallow	/

Rule

Path

Disallow

dataforseobot

Rule	Path
Disallow	/example

Rule

Path

Disallow

/example

seoscanner

Rule	Path
Disallow	/

Rule

Path

Disallow

serpstatbot

Rule	Path
Disallow	/

Rule

Path

Disallow

geedobot

Rule	Path
Disallow	/

Rule

Path

Disallow

lcc

Rule	Path
Disallow	/

Rule

Path

Disallow

barkrowler

Rule	Path
Disallow	/

Rule

Path

Disallow

bubing

Rule	Path
Disallow	/

Rule

Path

Disallow

dotbot

Rule	Path
Disallow	/

Rule

Path

Disallow

dotbot

Rule	Path
Disallow	/

Rule

Path

Disallow

adscanner

Rule	Path
Disallow	/

Rule

Path

Disallow

sosospider

Rule	Path
Disallow	/

Rule

Path

Disallow

sosospider

Rule	Path
Disallow	/

Rule

Path

Disallow

turnitinbot

Rule	Path
Disallow	/

Rule

Path

Disallow

ocelli

Rule	Path
Disallow	/

Rule

Path

Disallow

jyxobot

Rule	Path
Disallow	/

Rule

Path

Disallow

exabot

Rule	Path
Disallow	/

Rule

Path

Disallow

ichiro

Rule	Path
Disallow	/

Rule

Path

Disallow

gosospider

Rule	Path
Disallow	/

Rule

Path

Disallow

twengabot-2.0

Rule	Path
Disallow	/

Rule

Path

Disallow

psbot

Rule	Path
Disallow	/

Rule

Path

Disallow

vagabondo

Rule	Path
Disallow	/

Rule

Path

Disallow

jikespider

Rule	Path
Disallow	/

Rule

Path

Disallow

yyspider

Rule	Path
Disallow	/

Rule

Path

Disallow

spbot

Rule	Path
Disallow	/

Rule

Path

Disallow

blexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

megaindex

Rule	Path
Disallow	/

Rule

Path

Disallow

megaindex.ru/2.0

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-sa

Rule	Path
Disallow	/

Rule

Path

Disallow

mj12bot

Rule	Path
Disallow	/

Rule

Path

Disallow

yandexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

sogou web spider

Rule	Path
Disallow	/

Rule

Path

Disallow

ltx71

Rule	Path
Disallow	/

Rule

Path

Disallow

mail.ru_bot

Rule	Path
Disallow	/

Rule

Path

Disallow

baiduspider

Rule	Path
Disallow	/

Rule

Path

Disallow

cazoodlebot

Rule	Path
Disallow	/

Rule

Path

Disallow

fasterfox

Rule	Path
Disallow	/

Rule

Path

Disallow

shopwiki

Rule	Path
Disallow	/

Rule

Path

Disallow

ccbot

Rule	Path
Disallow	/

Rule

Path

Disallow

istellabot

Rule	Path
Disallow	/

Rule

Path

Disallow

seokicks-robot

Rule	Path
Disallow	/

Rule

Path

Disallow

petalbot

Rule	Path
Disallow	/

Rule

Path

Disallow

twitterbot

Rule	Path
Disallow	/

Rule

Path

Disallow

blexbot

No rules defined. All paths allowed.

Other Records

Field	Value
crawl-delay	20

Field

Value

crawl-delay

slurp

No rules defined. All paths allowed.

Other Records

Field	Value
crawl-delay	20

Field

Value

crawl-delay

yahoo! slurp

No rules defined. All paths allowed.

Other Records

Field	Value
crawl-delay	20

Field

Value

crawl-delay

accudienst.nlrobots.txt

Resource Scan

Scan Details

Last Scan

Groups

mojeekbot

dataforseobot

seoscanner

serpstatbot

geedobot

lcc

barkrowler

bubing

dotbot

dotbot

adscanner

sosospider

sosospider

turnitinbot

ocelli

jyxobot

exabot

ichiro

gosospider

twengabot-2.0

psbot

vagabondo

jikespider

yyspider

spbot

blexbot

megaindex

megaindex.ru/2.0

semrushbot

semrushbot-sa

mj12bot

yandexbot

sogou web spider

ltx71

mail.ru_bot

baiduspider

cazoodlebot

fasterfox

shopwiki

ccbot

istellabot

seokicks-robot

petalbot

twitterbot

blexbot

Other Records

slurp

Other Records

yahoo! slurp

Other Records

accudienst.nl
robots.txt