Log In Sign Up

rn.de
robots.txt

Robots Exclusion Standard data for rn.de

Resource Scan

Scan Details

Site Domain rn.de
Base Domain rn.de
Scan Status Ok
Last Scan2024-11-13T13:18:08+00:00
Next Scan 2024-11-20T13:18:08+00:00

Last Scan

Scanned2024-11-13T13:18:08+00:00
URL https://rn.de/robots.txt
Redirect https://www.ruhrnachrichten.de/robots.txt
Redirect Domain www.ruhrnachrichten.de
Redirect Base ruhrnachrichten.de
Domain IPs 91.204.44.34
Redirect IPs 91.204.44.34
Response IP 91.204.44.34
Found Yes
Hash f34b5a160e81982d77fa01b000143423b16d8c0da07e90c3afe55f97c8d8fd09
SimHash 2a74490a4de4

Groups

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

facebookexternalhit

Rule Path
Allow /*?*utm_source=

twitterbot

Rule Path
Allow /*?*utm_source=

*

Rule Path
Disallow /wp-admin/
Disallow /wp-content/plugins/cyan-statify-addon/hit.php
Disallow *RetransferUrl%3D*
Disallow /login/?
Disallow /User/Modules/LoginModuleHandler.ashx
Disallow /*?s=
Disallow /author/*/feed/
Disallow /page/
Disallow /dpa-evergreen/
Disallow /dpa-infoline-mhb/
Disallow /dpa-infoline-zvr/
Disallow /dpa-infoline/
Disallow /dpa-regionale-nrw-mhb/
Disallow /dpa-regionale-nrw-zvr/
Disallow /dpa-regionale-nrw/
Disallow /dpa-sportsline-mhb/
Disallow /dpa-sportsline-zvr/
Disallow /dpa-sportsline/
Disallow /dpa-starline-mhb/
Disallow /dpa-starline-zvr/
Disallow /dpa-starline/
Disallow /schlagwort/*/feed/
Disallow /search/*/feed/
Disallow /testrn/
Disallow /media/
Disallow /storage/
Disallow /nachrichten/
Disallow /*?cmpscreencustom
Disallow /*?*utm_source=
Allow /wp-content/uploads/
Allow /wp-admin/admin-ajax.php
Back to top

Comments

  • BEGIN Block bots that feed AI models
  • END Block bots that feed AI models
  • Legal notice: We expressly reserve the right to use our content for commercial text and data mining (Section 44b UrhG).
  • The use of robots or other automated means to access this site or to collect or mine data without the express permission is strictly prohibited.
  • At our discretion, we may permit certain automated access to certain pages.
Back to top