peek-cloppenburg.de
robots.txt

Robots Exclusion Standard data for peek-cloppenburg.de

Resource Scan

Scan Details

Site Domain peek-cloppenburg.de
Base Domain peek-cloppenburg.de
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-16T22:27:40+00:00
Next Scan 2025-11-30T22:27:40+00:00

Last Successful Scan

Scanned2025-03-13T10:42:05+00:00
URL https://peek-cloppenburg.de/robots.txt
Redirect https://www.peek-cloppenburg.de/robots.txt
Redirect Domain www.peek-cloppenburg.de
Redirect Base peek-cloppenburg.de
Domain IPs 104.18.34.213, 172.64.153.43, 2606:4700:4400::6812:22d5, 2606:4700:4400::ac40:992b
Redirect IPs 104.18.34.213, 172.64.153.43, 2606:4700:4400::6812:22d5, 2606:4700:4400::ac40:992b
Response IP 172.64.153.43
Found Yes
Hash 078cd51553a7102c7627dbd4277d7c5289880ecb0986e079c6554ba8bfb10645
SimHash 680cde50ac03

Groups

*

Rule Path
Allow /.well-known/assetlinks.json
Allow /.well-known/apple-app-site-association
Disallow /cdn-cgi/

adsbot-google

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.peek-cloppenburg.de/sitemaps/de/spider-sitemapindex.xml.gz
sitemap https://www.peek-cloppenburg.de/sitemaps-cms/de/cms-sitemapindex.xml.gz

Comments

  • app links into android app
  • universal links into ios app
  • cloudflare internals