we-online.de
robots.txt

Robots Exclusion Standard data for we-online.de

Resource Scan

Scan Details

Site Domain we-online.de
Base Domain we-online.de
Scan Status Ok
Last Scan2024-09-24T21:35:11+00:00
Next Scan 2024-10-08T21:35:11+00:00

Last Scan

Scanned2024-09-24T21:35:11+00:00
URL https://we-online.de/robots.txt
Redirect https://www.we-online.com/robots.txt
Redirect Domain www.we-online.com
Redirect Base we-online.com
Domain IPs 80.149.91.199
Redirect IPs 23.215.7.21, 23.215.7.9, 2600:1417:3f::b81c:eb69, 2600:1417:3f::b81c:eb71
Response IP 23.215.7.9
Found Yes
Hash 009d6bf6b272aea80a59e3eb9ad79cdbd2d78bc08cde797c58395212400c5f70
SimHash 659c1074c773

Groups

*

Rule Path
Disallow /hidden/
Disallow /interfaces/
Disallow /katalog/download/article/
Disallow /catalog/download/article/
Disallow /components/products/download/article/
Disallow /__external/

bingbot

Rule Path
Disallow /media/images/
Disallow /katalog/download/article/
Disallow /catalog/download/article/
Disallow /components/products/download/article/
Disallow /__external/

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.we-online.com/en/sitemap-index.xml
sitemap https://www.we-online.com/de/sitemap-index.xml