buhatala.com
robots.txt

Robots Exclusion Standard data for buhatala.com

Resource Scan

Scan Details

Site Domain buhatala.com
Base Domain buhatala.com
Scan Status Ok
Last Scan2025-11-04T06:46:38+00:00
Next Scan 2025-12-04T06:46:38+00:00

Last Scan

Scanned2025-11-04T06:46:38+00:00
URL https://buhatala.com/robots.txt
Redirect https://www.buhatala.com/robots.txt/?SID=9bhqesubnl448m6cfaonbvj6jn
Redirect Domain www.buhatala.com
Redirect Base buhatala.com
Domain IPs 104.21.19.248, 172.67.190.135, 2606:4700:3034::6815:13f8, 2606:4700:3034::ac43:be87
Redirect IPs 104.21.19.248, 172.67.190.135, 2606:4700:3034::6815:13f8, 2606:4700:3034::ac43:be87
Response IP 104.21.19.248
Found Yes
Hash 4a52f1bba243d28c990beaed32953f8b25f83dfcc24bc02c227add1ae4a33130
SimHash 2534d956cb87

Groups

*

Rule Path
Disallow /*?
Disallow /index.php/
Disallow /catalog/product_compare/
Disallow /catalog/category/view/
Disallow /catalog/product/view/
Disallow /wishlist/
Disallow /admin/
Disallow /catalogsearch/
Disallow /checkout/
Disallow /onestepcheckout/
Disallow /customer/
Disallow /review/product/
Disallow /sendfriend/
Disallow /enable-cookies/
Disallow /LICENSE.txt
Disallow /LICENSE.html
Disallow /skin/
Disallow /js/
Disallow /directory/
Disallow /easypa*
Disallow /easypay*
Disallow /jazzcash/*
Disallow /checkout/
Disallow /onestepcheckout/
Disallow /customer/
Disallow /customer/account/
Disallow /customer/account/login/
Disallow /marketplace/
Disallow /marketplace/account/
Disallow /catalogsearch/
Disallow /catalog/product_compare/
Disallow /catalog/category/view/
Disallow /catalog/product/view/
Disallow /*?dir*
Disallow /*?dir=desc
Disallow /*?dir=asc
Disallow /*?limit=all
Disallow /*?mode*
Disallow /app/
Disallow /bin/
Disallow /dev/
Disallow /lib/
Disallow /phpserver/
Disallow /pub/

Other Records

Field Value
sitemap https://www.buhatala.com/pub/sitemap_category.xml
sitemap https://www.buhatala.com/pub/sitemap_product.xml
sitemap https://www.buhatala.com/pub/sitemap_cms.xml
sitemap https://www.buhatala.com/pub/sitemap_additional_link.xml

Comments

  • Stop crawling user account and checkout pages by search engine robot:
  • Blocking native catalog and search pages:
  • Sometimes Webmasters block pages with filters..
  • More reasonable to use canonical tag on these pages.
  • Blocking CMS directories.