deubaxxl.de
robots.txt

Robots Exclusion Standard data for deubaxxl.de

Resource Scan

Scan Details

Site Domain deubaxxl.de
Base Domain deubaxxl.de
Scan Status Ok
Last Scan2025-11-06T01:28:54+00:00
Next Scan 2025-12-06T01:28:54+00:00

Last Scan

Scanned2025-11-06T01:28:54+00:00
URL https://deubaxxl.de/robots.txt
Redirect https://www.deubaxxl.de/robots.txt
Redirect Domain www.deubaxxl.de
Redirect Base deubaxxl.de
Domain IPs 104.26.4.156, 104.26.5.156, 172.67.70.8
Redirect IPs 104.26.4.156, 104.26.5.156, 172.67.70.8
Response IP 104.26.4.156
Found Yes
Hash 2ec468bc4bbf15922a7f3569def9404f8362c0f460be34fc3599d21a9a011936
SimHash cb081ef3faf9

Groups

pinterestbot

Rule Path
Disallow /

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /awin/
Disallow /awin/htlp.html
Disallow /*?*filter=*
Disallow /*?*query=*
Disallow /compare/
Disallow /note/
Disallow /ticket/
Disallow /tracking/
Disallow /wishlist/
Disallow /*account/
Disallow /*checkout/
Disallow /*navigation/
Disallow /register/
Disallow /address/
Allow /thumbnail/
Allow /media/
Allow /bundles/
Allow /*/loader.js

Other Records

Field Value
sitemap https://www.deubaxxl.de/sitemap.xml