bundesbank.de
robots.txt

Robots Exclusion Standard data for bundesbank.de

Resource Scan

Scan Details

Site Domain bundesbank.de
Base Domain bundesbank.de
Scan Status Ok
Last Scan2024-06-03T02:21:58+00:00
Next Scan 2024-06-17T02:21:58+00:00

Last Scan

Scanned2024-06-03T02:21:58+00:00
URL https://bundesbank.de/robots.txt
Redirect https://www.bundesbank.de/robots.txt
Redirect Domain www.bundesbank.de
Redirect Base bundesbank.de
Domain IPs 185.173.228.8
Redirect IPs 185.173.228.8
Response IP 185.173.228.8
Found Yes
Hash 605f4d2e92acaf5305fd1576718a7735a11e700c167a5fe01fdcaecb88f3e1a8
SimHash 62965e52c490

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 200

twitterbot

Rule Path
Disallow

ahrefsbot
baiduspider
baiduspider-render
buck
changedetection
cliqzbot
exabot
flamingo_searchengine
grobbot
jobboersebot
jobs.de-robot
linkdexbot
mail.ru_bot
mauibot
mediatoolkitbot
mega-index
megaindex.ru
mj12bot
mojeekbot
nutch
pinterestbot
pixray-seeker
rogerbot
safednsbot
seokicks
seokicks-robot
seznambot
smtbot
sogou spider
spbot
trendictionbot
tweetmemebot
vebidoobot
wonderbot
wotbox
acybot
yak
yandexantivirus
yandeximages
yandexmobilebot
yeti

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.bundesbank.de/service-sitemap-34041d60a21884ad31dcd7976ab01d50-sitemap_index.xml
sitemap https://www.bundesbank.de/service-sitemap-01a59a5d5e114f25a9a55e26583069ec-sitemap_index.xml

Warnings

  • 1 invalid line.