Log In Sign Up

shz.de
robots.txt

Robots Exclusion Standard data for shz.de

Resource Scan

Scan Details

Site Domain shz.de
Base Domain shz.de
Scan Status Ok
Last Scan2025-03-11T12:34:25+00:00
Next Scan 2025-03-18T12:34:25+00:00

Last Scan

Scanned2025-03-11T12:34:25+00:00
URL https://shz.de/robots.txt
Redirect https://www.shz.de/robots.txt
Redirect Domain www.shz.de
Redirect Base shz.de
Domain IPs 18.159.179.202, 18.193.59.2, 3.127.34.154
Redirect IPs 2600:9000:25ef:1c00:1b:985d:9e40:93a1, 2600:9000:25ef:1e00:1b:985d:9e40:93a1, 2600:9000:25ef:2c00:1b:985d:9e40:93a1, 2600:9000:25ef:2e00:1b:985d:9e40:93a1, 2600:9000:25ef:3e00:1b:985d:9e40:93a1, 2600:9000:25ef:6a00:1b:985d:9e40:93a1, 2600:9000:25ef:7600:1b:985d:9e40:93a1, 2600:9000:25ef:cc00:1b:985d:9e40:93a1, 3.169.71.40, 3.169.71.74, 3.169.71.86, 3.169.71.96
Response IP 3.164.68.68
Found Yes
Hash ab03f7ee5b15cab2523749a23bd63f8c17dff33a67ca3f57f7ae6fbcee0d81b0
SimHash 21301d00dda1

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /pagebuilding/
Disallow /new-articles/
Disallow /files/
Disallow /cre-1.0/tracking/
Disallow

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

bytespider

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.shz.de/sitemap.xml
sitemap https://www.shz.de/sitemap/googleNewsList.xml
sitemap https://www.shz.de/sitemap/artikel/sitemap-current.xml
Back to top

Comments

  • Legal notice: shz.de expressly reserves the right to use its content for commercial text and data mining (§ 44b UrhG).
  • The use of robots or other automated means to access shz.de or collect or mine data without the express permission of shz.de is strictly prohibited.
  • If you would like to apply for permission to crawl shz.de, collect or use data, please contact info+nutzungsrecht@noz-digital.de
Back to top