labbe.de
robots.txt

Robots Exclusion Standard data for labbe.de

Resource Scan

Scan Details

Site Domain labbe.de
Base Domain labbe.de
Scan Status Ok
Last Scan2025-09-27T01:34:20+00:00
Next Scan 2025-10-27T01:34:20+00:00

Last Scan

Scanned2025-09-27T01:34:20+00:00
URL https://labbe.de/robots.txt
Redirect https://www.labbe.de/robots.txt
Redirect Domain www.labbe.de
Redirect Base labbe.de
Domain IPs 104.21.37.151, 172.67.209.187, 2606:4700:3031::6815:2597, 2606:4700:3037::ac43:d1bb
Redirect IPs 104.21.37.151, 172.67.209.187, 2606:4700:3031::6815:2597, 2606:4700:3037::ac43:d1bb
Response IP 104.21.37.151
Found Yes
Hash 47aa286c7cc1e9b2b81fcc773795df72c00dd858fe37a582227f9215798192f0
SimHash 612888644103

Groups

*

Rule Path
Disallow /checkout
Disallow /register
Disallow /account
Disallow /widget
Disallow /navigation
Disallow /detail
Disallow /*?order=*
Disallow /*%26order%3D*
Disallow /*?properties=*
Disallow /*%26properties%3D*

Other Records

Field Value
crawl-delay 30

Other Records

Field Value
sitemap https://www.labbe.de/sitemap/salesChannel-19f6ca2712cd4fffb99bc32a536698ab-643754e2e31548bf850785cef82f9c0d/19f6ca2712cd4fffb99bc32a536698ab-sitemap-www-labbe-de-kinderideen-1.xml.gz
sitemap https://www.labbe.de/sitemap/salesChannel-849f96aee7d144d68b875fd236ce5abf-643754e2e31548bf850785cef82f9c0d/849f96aee7d144d68b875fd236ce5abf-sitemap-www-labbe-de-1.xml.gz

Comments

  • Sitemap
  • Crawlers
  • Rules
  • Parameters