mitrakantor.com
robots.txt

Robots Exclusion Standard data for mitrakantor.com

Resource Scan

Scan Details

Site Domain mitrakantor.com
Base Domain mitrakantor.com
Scan Status Ok
Last Scan2025-11-11T15:19:23+00:00
Next Scan 2025-12-11T15:19:23+00:00

Last Scan

Scanned2025-11-11T15:19:23+00:00
URL https://mitrakantor.com/robots.txt
Domain IPs 104.21.65.210, 172.67.167.17, 2606:4700:3036::6815:41d2, 2606:4700:3036::ac43:a711
Response IP 104.21.65.210
Found Yes
Hash 7979e8c6ddb6115406b7b329547f0282e892d736b53ef8fe024af475957cc208
SimHash 27d2cb4f660b

Groups

*

Rule Path
Allow /wp-content/uploads/
Allow /wp-content/themes/
Allow /wp-content/plugins/
Allow /wp-json/oembed/
Allow /product/
Allow /category/
Allow /page/
Allow /tag/
Allow /brand/
Allow /?s=
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /cgi-bin/
Disallow /xmlrpc.php
Disallow /readme.html
Disallow /license.txt
Disallow /cart/
Disallow /checkout/
Disallow /my-account/
Disallow /wishlist/
Disallow /order/
Disallow /thank-you/
Disallow /lost-password/
Disallow /search/
Disallow /?s=*
Disallow /*add-to-cart%3D*
Disallow /*filter_*
Disallow /*orderby%3D*
Disallow /*min_price%3D*
Disallow /*max_price%3D*
Disallow /*attribute_*
Disallow /*product_tag%3D*
Disallow *utm_*
Disallow *preview%3Dtrue
Disallow *replytocom
Disallow /feed/
Disallow /comments/
Disallow /author/
Disallow /archives/
Disallow /tag/
Disallow /category/*/feed/
Disallow /wp-json/
Disallow /?rest_route=*
Disallow /trackback/
Disallow /*?fbclid=*
Disallow /*?gclid=*

Other Records

Field Value
sitemap https://mitrakantor.com/sitemap_index.xml

Comments

  • ==========================================================
  • Robots.txt - Optimized for mitrakantor.com
  • Platform: WordPress + WooCommerce + Yoast SEO
  • ==========================================================
  • ================= ALLOW =================
  • ================= DISALLOW =================
  • WordPress core & admin
  • WooCommerce non-SEO pages
  • Internal search, filters & tracking
  • Feeds & archives (optional - save crawl budget)
  • API & crawl optimization cleanup
  • ================= SITEMAPS =================
  • ==========================================================
  • Tips:
  • 1. Pastikan sitemap aktif di Yoast SEO (General > Features > XML sitemaps)
  • 2. Submit sitemap ke Google Search Console
  • 3. Cek hasil robots.txt di https://mitrakantor.com/robots.txt
  • ==========================================================