Log In Sign Up

classicindustries.com
robots.txt

Robots Exclusion Standard data for classicindustries.com

Resource Scan

Scan Details

Site Domain classicindustries.com
Base Domain classicindustries.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-06-16T18:09:24+00:00
Next Scan 2025-09-14T18:09:24+00:00

Last Successful Scan

Scanned2022-11-06T14:18:57+00:00
URL https://classicindustries.com/robots.txt
Redirect https://www.classicindustries.com/robots.txt
Redirect Domain www.classicindustries.com
Redirect Base classicindustries.com
Response IP 104.18.18.14, 104.18.19.14
Found Yes
Hash 5d61397da3fc6559d5761b43704e4ee792ddebcbfaa8f3b7f83b4d96c84021df
SimHash 401d1d855590

Groups

*

Rule Path
Disallow /resource-busy/
Disallow /shoppingcart/
Disallow /admin/

googlebot
slurp

Rule Path
Disallow *.swf$
Disallow /controller.cfm?type=product&action=getProductCatalog
Disallow /controller.cfm?type=product&action=productDetail

msnbot

Rule Path
Disallow *.swf$
Disallow /controller.cfm?type=product&action=getProductCatalog
Disallow /controller.cfm?type=product&action=productDetail
Back to top

Other Records

Field Value
sitemap https://www.classicindustries.com/sitemap.xml
Back to top

Comments

  • Robots.txt file for http://www.classicindustries.com
  • Disallow: /
  • Disallow: /
Back to top