Log In Sign Up

megasmart.ge
robots.txt

Robots Exclusion Standard data for megasmart.ge

Resource Scan

Scan Details

Site Domain megasmart.ge
Base Domain megasmart.ge
Scan Status Ok
Last Scan2025-11-15T09:24:18+00:00
Next Scan 2025-12-15T09:24:18+00:00

Last Scan

Scanned2025-11-15T09:24:18+00:00
URL https://megasmart.ge/robots.txt
Domain IPs 104.21.7.18, 172.67.155.98, 2606:4700:3030::6815:712, 2606:4700:3035::ac43:9b62
Response IP 172.67.155.98
Found Yes
Hash ee132f17ed9ed3e4606dd3d77290884a1bc108a551e955544799f6a712c5fe32
SimHash b4625951a72b

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-login.php
Disallow /.git/
Disallow /cart/
Disallow /checkout/
Disallow /my-account/
Disallow /wc-api/
Disallow /?wc-ajax=*
Disallow /wp-json/
Disallow /feed/
Disallow /search/
Disallow /comments/
Disallow /?s=*
Disallow /?attachment_id=*
Disallow /*?add-to-cart=*
Disallow /*?add-to-compare=*
Disallow /*?orderby=*
Disallow /*?filter_*
Allow /product/
Allow /product-category/
Allow /wp-content/
Allow /wp-includes/
Back to top

Other Records

Field Value
sitemap https://megasmart.ge/sitemap.xml
Back to top

Comments

  • Allow all bots to crawl the site, except for areas specified below
  • Block WordPress admin and login pages
  • Block WooCommerce cart, checkout, and account pages
  • Block AJAX and REST API endpoints
  • Block feeds, search, and comments
  • Block unnecessary WordPress core files
  • Block parameters often used by bots
  • Allow WooCommerce product and category pages
  • Allow CSS, JS, and images for rendering
  • Sitemap reference for search engines
Back to top