Log In Sign Up

mrclab.com
robots.txt

Robots Exclusion Standard data for mrclab.com

Resource Scan

Scan Details

Site Domain mrclab.com
Base Domain mrclab.com
Scan Status Ok
Last Scan2025-04-09T18:18:39+00:00
Next Scan 2025-05-09T18:18:39+00:00

Last Scan

Scanned2025-04-09T18:18:39+00:00
URL https://mrclab.com/robots.txt
Domain IPs 104.21.61.102, 172.67.208.240, 2606:4700:3030::6815:3d66, 2606:4700:3030::ac43:d0f0
Response IP 104.21.61.102
Found Yes
Hash 6333d8ae95b7b82e9b00651ef17f573fcdab35bde1772824196ba3c69145f493
SimHash b3cdc78d6ee4

Groups

*

Rule Path
Disallow /index.html
Disallow /*.doc$
Disallow /*.docx$
Disallow /*.pdf$
Disallow /*.xls$
Disallow /*.xlsx$
Disallow /BSMART/
Disallow /HTMLS/PopUpProd.aspx/?*
Disallow /HTMLS/Popup.aspx/?*
Disallow /HTMLS/PrintCart.aspx/?*
Disallow /HTMLS/advancedsearch.aspx/?*
Disallow /HTMLS/advancedsearch.aspx/?*
Disallow /HTMLS/advancedsearchart.aspx/?*
Disallow /HTMLS/advancedsearchart.aspx/?*
Disallow /HTMLS/advancedsearchevent.aspx/?*
Disallow /HTMLS/advancedsearchevent.aspx/?*
Disallow /HTMLS/cart_iframe.aspx/?*
Disallow /HTMLS/print.aspx/?*
Disallow /HTMLS/product_print.aspx/?*
Disallow /HTMLS/rotator.aspx/?*
Disallow /HTMLS/sapAfterlogin.aspx/?*
Disallow /HTMLS/sapacc.aspx/?*
Disallow /HTMLS/saporder.aspx/?*
Disallow /HTMLS/saporders.aspx/?*
Disallow /HTMLS/saprow.aspx/?*
Disallow /HTMLS/signup.aspx/?*
Disallow /HTMLs/PopUpProd.aspx/?*
Disallow /HTMLs/Popup.aspx/?*
Disallow /HTMLs/PrintCart.aspx/?*
Disallow /HTMLs/cart_iframe.aspx/?*
Disallow /HTMLs/print.aspx/?*
Disallow /HTMLs/product_print.aspx/?*
Disallow /HTMLs/rotator.aspx/?*
Disallow /HTMLs/sapAfterlogin.aspx/?*
Disallow /HTMLs/sapacc.aspx/?*
Disallow /HTMLs/saporder.aspx/?*
Disallow /HTMLs/saporders.aspx/?*
Disallow /HTMLs/saprow.aspx/?*
Disallow /HTMLs/signup.aspx/?*
Disallow /PopUpProd.aspx/?*
Disallow /PopUpProd/?*
Disallow /popupprod.aspx/?*
Disallow /popupprod/?*
Disallow /Popup.aspx/?*
Disallow /Popup/?*
Disallow /PrintCart.aspx/?*
Disallow /PrintCart/?*
Disallow /advancedsearch.aspx/?*
Disallow /advancedsearch/?*
Disallow /advancedsearchart.aspx/?*
Disallow /advancedsearchart/?*
Disallow /advancedsearchevent.aspx/?*
Disallow /advancedsearchevent/?*
Disallow /bsmart/
Disallow /cart_iframe.aspx/?*
Disallow /cart_iframe/?*
Disallow /compare_data.aspx/?*
Disallow /htmls/PopUpProd.aspx/?*
Disallow /htmls/Popup.aspx/?*
Disallow /htmls/PrintCart.aspx/?*
Disallow /htmls/advancedsearch.aspx/?*
Disallow /htmls/advancedsearchart.aspx/?*
Disallow /htmls/advancedsearchevent.aspx/?*
Disallow /htmls/cart_iframe.aspx/?*
Disallow /htmls/compare_data.aspx/?*
Disallow /htmls/print.aspx/?*
Disallow /htmls/product_print.aspx/?*
Disallow /htmls/rotator.aspx/?*
Disallow /htmls/sapAfterlogin.aspx/?*
Disallow /htmls/sapacc.aspx/?*
Disallow /htmls/saporder.aspx/?*
Disallow /htmls/saporders.aspx/?*
Disallow /htmls/saprow.aspx/?*
Disallow /htmls/signup.aspx/?*
Disallow /listprint/?*
Disallow /print.aspx/?*
Disallow /print/?*
Disallow /product_print.aspx/?*
Disallow /product_print/?*
Disallow /rotator.aspx/?*
Disallow /rotator/?*
Disallow /sapAfterlogin.aspx/?*
Disallow /sapAfterlogin/?*
Disallow /sapacc.aspx/?*
Disallow /sapacc/?*
Disallow /saporder.aspx/?*
Disallow /saporder/?*
Disallow /saporders.aspx/?*
Disallow /saporders/?*
Disallow /saprow.aspx/?*
Disallow /saprow/?*
Disallow /signup.aspx/?*
Disallow /signup/?*
Disallow /ALLresults/?*
Back to top

Comments

  • Robots.txt file from http://www.searchengineworld.com
  • All robots will spider the domain
Back to top