anleihencheck.de
robots.txt

Robots Exclusion Standard data for anleihencheck.de

Resource Scan

Scan Details

Site Domain anleihencheck.de
Base Domain anleihencheck.de
Scan Status Ok
Last Scan2024-09-24T09:33:36+00:00
Next Scan 2024-10-01T09:33:36+00:00

Last Scan

Scanned2024-09-24T09:33:36+00:00
URL https://anleihencheck.de/robots.txt
Domain IPs 82.97.136.83, 82.97.160.83
Response IP 82.97.136.83
Found Yes
Hash 12ee23f5370d27824294e9930f432dd3d97739c7b3f4569608b180f815e39b1a
SimHash e0260067e693

Groups

bytespider

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

*

Rule Path
Disallow /cgi-bin/
Disallow /user/
Disallow /depot/
Disallow /blogs/
Disallow /forum/new_posting.m
Disallow /home/mb.m
Disallow /rss/alc_lang.rss2

googlebot-news

Rule Path
Disallow /
Allow /news/
Allow /analysen/
Allow /marktberichte/

Other Records

Field Value
sitemap https://www.anleihencheck.de/sitemap.xml
sitemap https://www.anleihencheck.de/sitemap_maerkte.xml
sitemap https://www.anleihencheck.de/sitemap_news.xml
sitemap https://www.anleihencheck.de/sitemap_analysen.xml