deutschlernerblog.de
robots.txt

Robots Exclusion Standard data for deutschlernerblog.de

Archived Snapshots

Resource Scan

Scan Details

Site Domain	deutschlernerblog.de
Base Domain	deutschlernerblog.de
Scan Status	Ok
Last Scan	2024-11-15T10:04:41+00:00
Next Scan	2024-11-22T10:04:41+00:00

Last Scan

Scanned	2024-11-15T10:04:41+00:00
URL	https://deutschlernerblog.de/robots.txt
Domain IPs	85.13.151.106
Response IP	85.13.151.106
Found	Yes
Hash	8d7f4ee6f0fdc8cfe63390f36c273b23207516b7f9128a0d937d533569e1e568
SimHash	51588fc2b8b6

Groups

*

Rule	Path
Disallow	/wp-admin/
Allow	/wp-admin/admin-ajax.php

Rule

Path

Disallow

/wp-admin/

Allow

/wp-admin/admin-ajax.php

bytespider

Rule	Path
Disallow	/

Rule

Path

Disallow

gptbot

Rule	Path
Disallow	/

Rule

Path

Disallow

claudebot

Rule	Path
Disallow	/

Rule

Path

Disallow

imagesiftbot

Rule	Path
Disallow	/

Rule

Path

Disallow

ccbot

Rule	Path
Disallow	/

Rule

Path

Disallow

chatgpt-nutzer

Rule	Path
Disallow	/

Rule

Path

Disallow

ahrefsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

dotbot

Rule	Path
Disallow	/

Rule

Path

Disallow

mj12bot

Rule	Path
Disallow	/

Rule

Path

Disallow

seoscanners.net

Rule	Path
Disallow	/

Rule

Path

Disallow

seokicks-robot

Rule	Path
Disallow	/

Rule

Path

Disallow

grapeshotcrawler

Rule	Path
Disallow	/

Rule

Path

Disallow

cliqzbot

Rule	Path
Disallow	/

Rule

Path

Disallow

aihitbot

Rule	Path
Disallow	/

Rule

Path

Disallow

seokicks-robot

Rule	Path
Disallow	/

Rule

Path

Disallow

searchmetricsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

icjobs

Rule	Path
Disallow	/

Rule

Path

Disallow

magpie-crawler

Rule	Path
Disallow	/

Rule

Path

Disallow

proximic

Rule	Path
Disallow	/

Rule

Path

Disallow

queryseekerspider

Rule	Path
Disallow	/

Rule

Path

Disallow

vagabondo

Rule	Path
Disallow	/

Rule

Path

Disallow

wbsearchbot

Rule	Path
Disallow	/

Rule

Path

Disallow

scooperbot

Rule	Path
Disallow	/

Rule

Path

Disallow

sentibot

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot

Rule	Path
Disallow	/

Rule

Path

Disallow

ttd-content

Rule	Path
Disallow	/

Rule

Path

Disallow

yandex

Rule	Path
Disallow	/

Rule

Path

Disallow

um-ic

Rule	Path
Disallow	/

Rule

Path

Disallow

relemindbot

Rule	Path
Disallow	/

Rule

Path

Disallow

msie

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot/1.0

Rule	Path
Disallow	/

Rule

Path

Disallow

discordbot

Rule	Path
Disallow	/

Rule

Path

Disallow

facebot twitterbot/1.0

Rule	Path
Disallow	/

Rule

Path

Disallow

barkrowler

Rule	Path
Disallow	/

Rule

Path

Disallow

barcrawler

Rule	Path
Disallow	/

Rule

Path

Disallow

facebookexternalhit/1.1

Rule	Path
Disallow	/

Rule

Path

Disallow

facebot

Rule	Path
Disallow	/

Rule

Path

Disallow

twitterbot1.0

Rule	Path
Disallow	/

Rule

Path

Disallow

facebook bot 1.1

Rule	Path
Disallow	/

Rule

Path

Disallow

Other Records

Field	Value
sitemap	https://deutschlernerblog.de/sitemap.xml
sitemap	https://deutschlernerblog.de/news-sitemap.xml

Field

Value

sitemap

https://deutschlernerblog.de/sitemap.xml

sitemap

https://deutschlernerblog.de/news-sitemap.xml

deutschlernerblog.derobots.txt

Resource Scan

Scan Details

Last Scan

Groups

*

bytespider

gptbot

claudebot

imagesiftbot

ccbot

chatgpt-nutzer

ahrefsbot

dotbot

mj12bot

seoscanners.net

seokicks-robot

grapeshotcrawler

cliqzbot

aihitbot

seokicks-robot

searchmetricsbot

icjobs

magpie-crawler

proximic

queryseekerspider

vagabondo

wbsearchbot

scooperbot

sentibot

semrushbot

ttd-content

yandex

um-ic

relemindbot

msie

semrushbot/1.0

discordbot

facebot twitterbot/1.0

barkrowler

barcrawler

facebookexternalhit/1.1

facebot

twitterbot1.0

facebook bot 1.1

Other Records

deutschlernerblog.de
robots.txt