Log In Sign Up

lalithatraders.com
robots.txt

Robots Exclusion Standard data for lalithatraders.com

Resource Scan

Scan Details

Site Domain lalithatraders.com
Base Domain lalithatraders.com
Scan Status Ok
Last Scan2025-11-02T04:05:29+00:00
Next Scan 2025-12-02T04:05:29+00:00

Last Scan

Scanned2025-11-02T04:05:29+00:00
URL https://lalithatraders.com/robots.txt
Domain IPs 174.138.177.173
Response IP 174.138.177.173
Found Yes
Hash 71fa81e7483bf9306209dd4e74bb823c8fdd9f1e37185e1c2b1bbd53031537e0
SimHash 221d4a70a293

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /cgi-bin/
Disallow /trackback/
Disallow /xmlrpc.php
Disallow /feed/
Disallow /comments/
Disallow /cart/
Disallow /my-account/
Disallow /checkout/
Disallow /wishlist/
Disallow /thank-you/
Disallow /wp-content/uploads/wc-logs/
Disallow /wp-content/uploads/woocommerce_transient_files/
Disallow /wp-content/uploads/woocommerce_uploads/
Disallow /*?add-to-cart=
Disallow /*?*add-to-cart=
Disallow /*add_to_wishlist*
Disallow /*?orderby=
Disallow /*?filter_
Disallow /*?rating=
Disallow /*?min_price=
Disallow /*?max_price=
Disallow /*add-to-cart%3D*
Disallow /*replytocom%3D*
Disallow /*add_review%3D*
Disallow /?s=*
Allow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://lalithatraders.com/sitemap_index.xml
Back to top

Comments

  • ============================================================
  • Robots.txt for https://lalithatraders.com
  • Advanced SEO & Security Optimized for WordPress + WooCommerce + Yoast
  • ============================================================
  • --------------------------------------------
  • GLOBAL CRAWL DIRECTIVES
  • --------------------------------------------
  • Block unnecessary system and duplicate URLs
  • Allow everything else
  • --------------------------------------------
  • BLOCK BAD / AGGRESSIVE BOTS
  • --------------------------------------------
  • --------------------------------------------
  • SITEMAP DECLARATION
  • --------------------------------------------
  • --------------------------------------------
  • NOTES
  • --------------------------------------------
  • âœ
  • 🚫 Checkout, cart, login, and internal system pages are safely blocked.
  • 🤖 Known AI/data scrapers & spammy bots are denied.
  • 🔍 Search engines focus on valuable content — improving crawl budget & SEO ranking efficiency.
  • ðŸ“
  • ============================================================
Back to top

Warnings

  • 1 invalid line.
  • `last updated` is not a known field.
Back to top