Log In Sign Up

dbjr.de
robots.txt

Robots Exclusion Standard data for dbjr.de

Resource Scan

Scan Details

Site Domain dbjr.de
Base Domain dbjr.de
Scan Status Ok
Last Scan2024-09-20T00:37:50+00:00
Next Scan 2024-10-20T00:37:50+00:00

Last Scan

Scanned2024-09-20T00:37:50+00:00
URL https://dbjr.de/robots.txt
Redirect https://www.dbjr.de/robots.txt
Redirect Domain www.dbjr.de
Redirect Base dbjr.de
Domain IPs 2a01:4f8:d0a:663c::2, 78.46.167.129
Redirect IPs 2a01:4f8:d0a:663c::2, 78.46.167.129
Response IP 78.46.167.129
Found Yes
Hash 87ff759e5ca60a929bc610c60419291a9a450eb53a0707a37ab786109c5e82f6
SimHash 015d5d506eb2

Groups

ahrefsbot

Rule Path
Disallow /

alphaseobot

Rule Path
Disallow /

alphaseobot-sa

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

proximic

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

seoscanners.net

Rule Path
Disallow /

exabot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10
Back to top

Other Records

Field Value
sitemap https://www.dbjr.de/sitemap.xml
Back to top

Warnings

  • 2 invalid lines.
Back to top