routenplaner-karte.de
robots.txt

Robots Exclusion Standard data for routenplaner-karte.de

Archived Snapshots

Resource Scan

Scan Details

Site Domain	routenplaner-karte.de
Base Domain	routenplaner-karte.de
Scan Status	Ok
Last Scan	2024-09-16T15:15:50+00:00
Next Scan	2024-09-23T15:15:50+00:00

Last Scan

Scanned	2024-09-16T15:15:50+00:00
URL	https://routenplaner-karte.de/robots.txt
Redirect	https://www.routenplaner-karte.de/robots.txt
Redirect Domain	www.routenplaner-karte.de
Redirect Base	routenplaner-karte.de
Domain IPs	104.21.89.225, 172.67.165.186, 2606:4700:3030::6815:59e1, 2606:4700:3036::ac43:a5ba
Redirect IPs	104.21.89.225, 172.67.165.186, 2606:4700:3030::6815:59e1, 2606:4700:3036::ac43:a5ba
Response IP	104.21.89.225
Found	Yes
Hash	2567c884ed45d4b73009ec82762fdf42d6fecbe1e683bd1c96bb6f683d6d1da3
SimHash	b05e5853c637

Groups

baiduspider

Rule	Path
Disallow	/

Rule

Path

Disallow

msnbot

No rules defined. All paths allowed.

Other Records

Field	Value
crawl-delay	1

Field

Value

crawl-delay

rogerbot

Rule	Path
Disallow	/

Rule

Path

Disallow

exabot

Rule	Path
Disallow	/

Rule

Path

Disallow

mj12bot

Rule	Path
Disallow	/

Rule

Path

Disallow

dotbot

Rule	Path
Disallow	/

Rule

Path

Disallow

gigabot

Rule	Path
Disallow	/

Rule

Path

Disallow

ahrefsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

dotbot

Rule	Path
Disallow	/

Rule

Path

Disallow

sitebot

Rule	Path
Disallow	/

Rule

Path

Disallow

lexxebot

Rule	Path
Disallow	/

Rule

Path

Disallow

ezooms

Rule	Path
Disallow	/

Rule

Path

Disallow

ichiro

Rule	Path
Disallow	/

Rule

Path

Disallow

twiceler

Rule	Path
Disallow	/

Rule

Path

Disallow

ubicrawler

Rule	Path
Disallow	/

Rule

Path

Disallow

doc

Rule	Path
Disallow	/

Rule

Path

Disallow

zao

Rule	Path
Disallow	/

Rule

Path

Disallow

sitecheck.internetseer.com

Rule	Path
Disallow	/

Rule

Path

Disallow

zealbot

Rule	Path
Disallow	/

Rule

Path

Disallow

msiecrawler

Rule	Path
Disallow	/

Rule

Path

Disallow

sitesnagger

Rule	Path
Disallow	/

Rule

Path

Disallow

webstripper

Rule	Path
Disallow	/

Rule

Path

Disallow

webcopier

Rule	Path
Disallow	/

Rule

Path

Disallow

fetch

Rule	Path
Disallow	/

Rule

Path

Disallow

offline explorer

Rule	Path
Disallow	/

Rule

Path

Disallow

teleport

Rule	Path
Disallow	/

Rule

Path

Disallow

teleportpro

Rule	Path
Disallow	/

Rule

Path

Disallow

webzip

Rule	Path
Disallow	/

Rule

Path

Disallow

linko

Rule	Path
Disallow	/

Rule

Path

Disallow

httrack

Rule	Path
Disallow	/

Rule

Path

Disallow

xenu

Rule	Path
Disallow	/

Rule

Path

Disallow

larbin

Rule	Path
Disallow	/

Rule

Path

Disallow

libwww

Rule	Path
Disallow	/

Rule

Path

Disallow

zyborg

Rule	Path
Disallow	/

Rule

Path

Disallow

download ninja

Rule	Path
Disallow	/

Rule

Path

Disallow

wget

Rule	Path
Disallow	/

Rule

Path

Disallow

grub-client

Rule	Path
Disallow	/

Rule

Path

Disallow

k2spider

Rule	Path
Disallow	/

Rule

Path

Disallow

npbot

Rule	Path
Disallow	/

Rule

Path

Disallow

webreaper

Rule	Path
Disallow	/

Rule

Path

Disallow

ia_archiver

Rule	Path
Disallow	/

Rule

Path

Disallow

libwww-perl

Rule	Path
Disallow	/

Rule

Path

Disallow

Other Records

Field	Value
sitemap	https://www.routenplaner-karte.de/sitemap.xml

Field

Value

sitemap

https://www.routenplaner-karte.de/sitemap.xml

routenplaner-karte.derobots.txt

Resource Scan

Scan Details

Last Scan

Groups

baiduspider

msnbot

Other Records

rogerbot

exabot

mj12bot

dotbot

gigabot

ahrefsbot

dotbot

sitebot

lexxebot

ezooms

ichiro

twiceler

ubicrawler

doc

zao

sitecheck.internetseer.com

zealbot

msiecrawler

sitesnagger

webstripper

webcopier

fetch

offline explorer

teleport

teleportpro

webzip

linko

httrack

xenu

larbin

libwww

zyborg

download ninja

wget

grub-client

k2spider

npbot

webreaper

ia_archiver

libwww-perl

Other Records

routenplaner-karte.de
robots.txt