Log In Sign Up

automatic-spring.com
robots.txt

Robots Exclusion Standard data for automatic-spring.com

Resource Scan

Scan Details

Site Domain automatic-spring.com
Base Domain automatic-spring.com
Scan Status Ok
Last Scan2025-07-19T11:10:55+00:00
Next Scan 2025-07-26T11:10:55+00:00

Last Scan

Scanned2025-07-19T11:10:55+00:00
URL http://automatic-spring.com/robots.txt
Redirect https://www.mwcomponents.com/robots.txt
Redirect Domain www.mwcomponents.com
Redirect Base mwcomponents.com
Domain IPs 2607:f1c0:100f:f000::24c, 74.208.236.50
Redirect IPs 18.155.68.117, 18.155.68.124, 18.155.68.30, 18.155.68.94, 2600:9000:23d2:1200:3:6b59:e80:93a1, 2600:9000:23d2:6400:3:6b59:e80:93a1, 2600:9000:23d2:7e00:3:6b59:e80:93a1, 2600:9000:23d2:8800:3:6b59:e80:93a1, 2600:9000:23d2:9200:3:6b59:e80:93a1, 2600:9000:23d2:a00:3:6b59:e80:93a1, 2600:9000:23d2:be00:3:6b59:e80:93a1, 2600:9000:23d2:f800:3:6b59:e80:93a1
Response IP 18.155.68.94
Found Yes
Hash 05d4fd09a5a6faa877c9dbd440fb5d7a91a1ebefcabed1cf20f702c04335d013
SimHash 41680a122532

Groups

*

Rule Path
Disallow */autocomplete?*
Disallow /cache/
Disallow /catalog*
Disallow /checkout/*
Disallow /cpresources/
Disallow /.env
Disallow /*frt%3D*
Disallow /*hyperco*
Disallow /*location%3D*
Disallow */login?redirect=*
Disallow /*microsite%3D*
Disallow /parts-kit/
Disallow /quick-view*
Disallow /*.php*
Disallow /*referrer%3D*
Disallow /*render-template?template=*
Disallow /search?*
Disallow /site.webmanifest
Disallow /skin/*
Disallow /*wlwmanifest.xml*
Disallow /vendor/
Back to top

Other Records

Field Value
sitemap https://www.mwcomponents.com/sitemaps-1-sitemap.xml
Back to top

Comments

  • robots.txt for https://www.mwcomponents.com/
  • live - don't allow web crawlers to index cpresources/ or vendor/
  • Disallow: /shop/*/specs*
Back to top