moebelkultur.de
robots.txt

Robots Exclusion Standard data for moebelkultur.de

Resource Scan

Scan Details

Site Domain moebelkultur.de
Base Domain moebelkultur.de
Scan Status Ok
Last Scan2024-09-21T03:23:36+00:00
Next Scan 2024-09-28T03:23:36+00:00

Last Scan

Scanned2024-09-21T03:23:36+00:00
URL https://www.moebelkultur.de/robots.txt
Domain IPs 116.202.55.216, 2a01:4f8:10b:4402::3
Response IP 116.202.55.216
Found Yes
Hash 121ebf14e831af1ba3e6dd45dcc2033c962f519ee78567ad7c9d21b9bbb68331
SimHash 31120d584fb5

Groups

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

*

Rule Path
Allow /
Disallow /newsletter/*
Disallow /emag/*
Disallow /news/oberstaatsanwalt-in-rage-1/
Disallow /news/mehr-als-zwei-jahre-haft-fuer-rolf-demuth/

Other Records

Field Value
sitemap https://www.moebelkultur.de/sitemap.xml

Comments

  • Legal notice: This domain expressly reserves the right to use its content for commercialtext and data mining (ยง 44b UrhG).
  • The use of robots or other automated means to access this Domain or collect or mine data without the express permission of Vincentz Network is strictly prohibited.
  • If you would like to apply for permission to crawl thei Domain, collect or use data, please contact Vincentz Network