butlertechnik.com
robots.txt

Robots Exclusion Standard data for butlertechnik.com

Resource Scan

Scan Details

Site Domain butlertechnik.com
Base Domain butlertechnik.com
Scan Status Ok
Last Scan2024-10-21T09:29:49+00:00
Next Scan 2024-11-20T09:29:49+00:00

Last Scan

Scanned2024-10-21T09:29:49+00:00
URL https://butlertechnik.com/robots.txt
Redirect https://www.butlertechnik.com/robots.txt
Redirect Domain www.butlertechnik.com
Redirect Base butlertechnik.com
Domain IPs 35.189.212.215
Redirect IPs 35.189.212.215
Response IP 35.189.212.215
Found Yes
Hash 3494372eb31ad04c78a072dd64d9ee84b09de921746073506a53349a3608c680
SimHash 6ca0dbb0ea12

Groups

*

Rule Path
Allow /
Disallow /basket
Disallow /login
Disallow /logout
Disallow /search
Disallow /json_account
Disallow /json_basket
Disallow /json_listing
Disallow /json_order
Disallow /json_subscribe
Disallow /json_wishlist

baiduspider

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-news

Rule Path
Disallow /

baiduspider-favo

Rule Path
Disallow /

baiduspider-cpro

Rule Path
Disallow /

baiduspider-ads

Rule Path
Disallow /

baidu

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.butlertechnik.com/sitemap.xml