mindjiro.com
robots.txt

Robots Exclusion Standard data for mindjiro.com

Resource Scan

Scan Details

Site Domain mindjiro.com
Base Domain mindjiro.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2/25/2025, 11:25:57 PM
Next Scan 5/26/2025, 11:25:57 PM

Last Successful Scan

Scanned10/17/2022, 1:23:15 PM
URL https://www.mindjiro.com/robots.txt
Response IP 104.21.82.183, 172.67.161.114
Found Yes
Hash ea3ecd8f5f32c2590431fee40d41fb86414c2dd08ea5e98114c7031098e8eee1
SimHash 485c69a24752

Groups

*

Rule Path
Disallow /*?sort
Disallow /*?route=checkout%2F
Disallow /*?route=account%2F
Disallow /*?route=product%2F
Disallow /*?page=1
Disallow /*%26create%3D1
Disallow /*?route=information%2F*
Disallow /*?route=*
Disallow /*?route=product%2Fproduct*&manufacturer_id=
Disallow /*?route=account%2Freturn%2Fadd
Disallow /*?route=information%2Fcontact
Disallow /admin/
Disallow /system/
Disallow /.well-known/
Disallow /cgi-bin/
Disallow /privacy.html
Disallow /gv_faq.html
Disallow /shippinginfo.html
Disallow /conditions.html
Disallow /about_us.html
Disallow /about_us
Disallow /frequently_asked_questions.html
Disallow /contact_us.html
Disallow /contact
Disallow /shopping_cart.html
Disallow /account.html
Disallow /privacy-policy
Disallow /create_account.html
Disallow /discount_coupon.html
Disallow /catalog/
Disallow /vqmod/
Disallow /themeinstall/
Allow /

baiduspider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

googlebot

Rule Path
Disallow /admin/
Disallow /system/
Disallow /catalog/
Disallow /vqmod/
Disallow /themeinstall/

googlebot-image

Rule Path
Disallow /admin/
Disallow /system/
Disallow /catalog/
Disallow /vqmod/
Disallow /themeinstall/
Disallow /.well-known/
Disallow /cgi-bin/

Other Records

Field Value
sitemap https://www.mindjiro.com/site_map.xml

Warnings

  • 1 invalid line.