aphorismen.de
robots.txt

Robots Exclusion Standard data for aphorismen.de

Archived Snapshots

Resource Scan

Scan Details

Site Domain	aphorismen.de
Base Domain	aphorismen.de
Scan Status	Ok
Last Scan	2024-10-01T17:26:10+00:00
Next Scan	2024-10-08T17:26:10+00:00

Last Scan

Scanned	2024-10-01T17:26:10+00:00
URL	https://aphorismen.de/robots.txt
Redirect	https://www.aphorismen.de/robots.txt
Redirect Domain	www.aphorismen.de
Redirect Base	aphorismen.de
Domain IPs	104.26.14.187, 104.26.15.187, 172.67.68.190, 2606:4700:20::681a:ebb, 2606:4700:20::681a:fbb, 2606:4700:20::ac43:44be
Redirect IPs	104.26.14.187, 104.26.15.187, 172.67.68.190, 2606:4700:20::681a:ebb, 2606:4700:20::681a:fbb, 2606:4700:20::ac43:44be
Response IP	172.67.68.190
Found	Yes
Hash	cd4b6e914db62bc7334cc3fb0c036da591cde8d97116fa4130ab53d87480f50c
SimHash	ba9c5d10c959

Groups

gptbot

Rule	Path
Disallow	/

Rule

Path

Disallow

ccbot

Rule	Path
Disallow	/

Rule

Path

Disallow

dataforseobot

Rule	Path
Disallow	/

Rule

Path

Disallow

velenpublicwebcrawler

Rule	Path
Disallow	/

Rule

Path

Disallow

httrack 3.0

Rule	Path
Disallow	/

Rule

Path

Disallow

blexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

zoominfobot

Rule	Path
Disallow	/

Rule

Path

Disallow

exabot

Rule	Path
Disallow	/

Rule

Path

Disallow

riddler

Rule	Path
Disallow	/

Rule

Path

Disallow

ltx71

Rule	Path
Disallow	/

Rule

Path

Disallow

seokicks-robot

Rule	Path
Disallow	/

Rule

Path

Disallow

seokicks

Rule	Path
Disallow	/

Rule

Path

Disallow

cliqzbot

Rule	Path
Disallow	/

Rule

Path

Disallow

seoscanners.net

Rule	Path
Disallow	/

Rule

Path

Disallow

searchmetricsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

ahrefsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

sogou spider

Rule	Path
Disallow	/

Rule

Path

Disallow

sogou web spider

Rule	Path
Disallow	/

Rule

Path

Disallow

sogou

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-sa

Rule	Path
Disallow	/

Rule

Path

Disallow

bubing

Rule	Path
Disallow	/

Rule

Path

Disallow

barkrowler

Rule	Path
Disallow	/

Rule

Path

Disallow

screaming frog seo spider

Rule	Path
Disallow	/

Rule

Path

Disallow

seznambot

Rule	Path
Disallow	/

Rule

Path

Disallow

grapeshot

Rule	Path
Disallow	/

Rule

Path

Disallow

mj12bot

Rule	Path
Disallow	/

Rule

Path

Disallow

seekport crawler

Rule	Path
Disallow	/

Rule

Path

Disallow

seekbot

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-sa

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-ba

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-si

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-swa

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-ct

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-bm

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-seoab

Rule	Path
Disallow	/

Rule

Path

Disallow

Comments

robots.txt
For more information about the robots.txt standard, see:
http://www.robotstxt.org/wc/robots.html
For syntax checking, see:
http://www.sxw.org.uk/computing/robots/check.html
Common Crawlers
Disallow: DownloadBot HTTrack zum offline Browsen ausschließen

aphorismen.derobots.txt

Resource Scan

Scan Details

Last Scan

Groups

gptbot

ccbot

dataforseobot

velenpublicwebcrawler

httrack 3.0

blexbot

zoominfobot

exabot

riddler

ltx71

seokicks-robot

seokicks

cliqzbot

seoscanners.net

searchmetricsbot

ahrefsbot

sogou spider

sogou web spider

sogou

semrushbot-sa

bubing

barkrowler

screaming frog seo spider

seznambot

grapeshot

mj12bot

seekport crawler

seekbot

semrushbot-sa

semrushbot-ba

semrushbot-si

semrushbot-swa

semrushbot-ct

semrushbot-bm

semrushbot-seoab

Comments

aphorismen.de
robots.txt