segmueller.de
robots.txt

Robots Exclusion Standard data for segmueller.de

Resource Scan

Scan Details

Site Domain segmueller.de
Base Domain segmueller.de
Scan Status Ok
Last Scan2024-11-08T05:21:52+00:00
Next Scan 2024-11-22T05:21:52+00:00

Last Scan

Scanned2024-11-08T05:21:52+00:00
URL https://segmueller.de/robots.txt
Redirect https://www.segmueller.de/robots.txt
Redirect Domain www.segmueller.de
Redirect Base segmueller.de
Domain IPs 128.65.210.38
Redirect IPs 128.65.210.38
Response IP 128.65.210.38
Found Yes
Hash 45e34ecde077554ea5aca25e4c588e50b1f2fdb3e2182e8a92731be9440af330
SimHash b9105b54f808

Groups

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1.0

*

Rule Path
Disallow /customer
Disallow /checkout
Disallow /search
Disallow /cart
Disallow *?extcid
Disallow *?gclid
Disallow /magazin/typo3/
Disallow /magazin/?id=*
Disallow */1000$

semrushbot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

semrushbot-coub

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.segmueller.de/sitemap-index.xml
sitemap https://www.segmueller.de/magazin/sitemap.xml