Log In Sign Up

we-online.com
robots.txt

Robots Exclusion Standard data for we-online.com

Resource Scan

Scan Details

Site Domain we-online.com
Base Domain we-online.com
Scan Status Ok
Last Scan2024-06-18T00:09:47+00:00
Next Scan 2024-07-02T00:09:47+00:00

Last Scan

Scanned2024-06-18T00:09:47+00:00
URL https://we-online.com/robots.txt
Redirect https://www.we-online.com/robots.txt
Redirect Domain www.we-online.com
Redirect Base we-online.com
Domain IPs 80.149.91.224
Redirect IPs 23.52.40.26, 23.52.40.27, 2600:1413:b000:6::17d5:2bcf, 2600:1413:b000:6::17d5:2bdd
Response IP 23.32.29.9
Found Yes
Hash f91297d5a1ea18a8a3883e2085c31681f694d3f66f302580c21f550bc4c5a4b0
SimHash bd83d914e549

Groups

*

Rule Path
Disallow /hidden/
Disallow /interfaces/
Disallow /katalog/download/article/
Disallow /catalog/download/article/
Disallow /components/products/download/article/
Disallow /__external/

bingbot

Rule Path
Disallow /media/images/
Disallow /katalog/download/article/
Disallow /catalog/download/article/
Disallow /components/products/download/article/
Disallow /__external/

Other Records

Field Value
crawl-delay 5
Back to top

Comments

  • Disallow: /restats/
  • testing uploading
  • Disallow: /re/
  • Disallow: /web/de/wuerth_elektronik/admin_form_test.php
  • Disallow: /*.wrl$
  • Disallow: /*.igs$
  • Disallow: /*.iges$
  • Disallow: /*.dxf$
  • Disallow: /*.s2p$
  • Disallow: /*.lbr$
  • Disallow: /*.intlib$
  • Disallow: /*.IntLib$
  • Disallow: /*.stp$
  • Disallow: /*.zip$
  • Disallow: /files/
  • Disallow: /*.wrl$
  • Disallow: /*.igs$
  • Disallow: /*.iges$
  • Disallow: /*.dxf$
  • Disallow: /*.s2p$
  • Disallow: /*.lbr$
  • Disallow: /*.intlib$
  • Disallow: /*.IntLib$
  • Disallow: /*.stp$
  • Disallow: /*.zip$
  • Disallow: /files/
Back to top