Log In Sign Up

11freunde.de
robots.txt

Robots Exclusion Standard data for 11freunde.de

Resource Scan

Scan Details

Site Domain 11freunde.de
Base Domain 11freunde.de
Scan Status Ok
Last Scan2024-10-04T20:58:40+00:00
Next Scan 2024-10-11T20:58:40+00:00

Last Scan

Scanned2024-10-04T20:58:40+00:00
URL https://11freunde.de/robots.txt
Redirect https://www.11freunde.de/robots.txt
Redirect Domain www.11freunde.de
Redirect Base 11freunde.de
Domain IPs 128.65.211.214
Redirect IPs 128.65.211.214
Response IP 128.65.211.214
Found Yes
Hash 8406fdc24113e89f7bc96b1f6a8f9be3809557f9c38cbaa525e7980a9ff09c02
SimHash e0200d5aeca3

Groups

*

Rule Path
Allow /
Disallow /*CR-Dokumentation.pdf$

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

sirdatabot

Rule Path
Disallow /

lcc

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /
Disallow /

claudebot

Rule Path
Disallow /

timpibot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.11freunde.de/sitemaps/news-de.xml
sitemap https://www.11freunde.de/sitemap.xml
Back to top

Comments

  • Legal notice: 11freunde.de expressly reserves the right to use its content for commercial text and data mining (§ 44b Urheberrechtsgesetz).
  • The use of robots or other automated means to access 11freunde.de or collect or mine data without the express permission of spiegel.de is strictly prohibited.
  • 11freunde.de may, in its discretion, permit certain automated access to certain spiegel.de pages,
  • If you would like to apply for permission to crawl 11freunde.de, collect or use data, please email syndication@11freunde.de
Back to top

Warnings

  • `‍user-agent` is not a known field.
Back to top