hochschule-bundesbank.de
robots.txt

Robots Exclusion Standard data for hochschule-bundesbank.de

Resource Scan

Scan Details

Site Domain hochschule-bundesbank.de
Base Domain hochschule-bundesbank.de
Scan Status Ok
Last Scan2024-09-23T14:03:43+00:00
Next Scan 2024-10-07T14:03:43+00:00

Last Scan

Scanned2024-09-23T14:03:43+00:00
URL https://hochschule-bundesbank.de/robots.txt
Redirect https://www.hochschule-bundesbank.de/robots.txt
Redirect Domain www.hochschule-bundesbank.de
Redirect Base hochschule-bundesbank.de
Domain IPs 185.173.228.8
Redirect IPs 185.173.228.8
Response IP 185.173.228.8
Found Yes
Hash e4922a903c8c88a4a55498e9d3f0046dee2f5ff8460f9e138453c1bfd9835a7d
SimHash e29e5e52c413

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 200

twitterbot

Rule Path
Disallow

ahrefsbot
baiduspider
baiduspider-render
buck
changedetection
cliqzbot
exabot
flamingo_searchengine
grobbot
jobboersebot
jobs.de-robot
linkdexbot
mail.ru_bot
mauibot
mediatoolkitbot
mega-index
megaindex.ru
mj12bot
mojeekbot
nutch
pinterestbot
pixray-seeker
rogerbot
safednsbot
seokicks
seokicks-robot
seznambot
smtbot
sogou spider
spbot
trendictionbot
tweetmemebot
vebidoobot
wonderbot
wotbox
acybot
yak
yandexantivirus
yandeximages
yandexmobilebot
yeti

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.hochschule-bundesbank.de/service-sitemap-c783341b9b5fced586f61dafb7db1fe6-sitemap_index.xml
sitemap https://www.hochschule-bundesbank.de/service-sitemap-1115dc0313880f2e14d04060e58db68c-sitemap_index.xml

Warnings

  • 1 invalid line.