scmdojo.com
robots.txt

Robots Exclusion Standard data for scmdojo.com

Resource Scan

Scan Details

Site Domain scmdojo.com
Base Domain scmdojo.com
Scan Status Ok
Last Scan2025-09-24T15:41:46+00:00
Next Scan 2025-10-24T15:41:46+00:00

Last Scan

Scanned2025-09-24T15:41:46+00:00
URL https://scmdojo.com/robots.txt
Domain IPs 104.21.11.7, 172.67.147.107, 2606:4700:3035::ac43:936b, 2606:4700:3036::6815:b07
Response IP 104.21.11.7
Found Yes
Hash 41725377cd5471e59cf013164a2e9142afb6fdce1073cfb721659def9cb75bf4
SimHash 0b080b8167b3

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /wp-content/uploads/wc-logs/
Disallow /wp-content/uploads/woocommerce_transient_files/
Disallow /wp-content/uploads/woocommerce_uploads/
Disallow /wp-login.php
Disallow /register
Disallow /login
Disallow /register?redirect_to=
Disallow /login?redirect_to=
Disallow /*redirect_to%3D
Disallow /secure-checkout
Disallow /?s=
Disallow /experts/search/
Disallow /*?level=
Disallow /*?type=
Disallow /*?sort=
Disallow /*?page=
Disallow /*?country=
Disallow /tag/
Disallow /*?utm_
Disallow /*?fbclid
Disallow /*?ml_sub
Disallow /*?ml_sub_hash

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

adsbot

Rule Path
Allow /
Disallow /wp-content/uploads/servento_attachments/*

Other Records

Field Value
sitemap https://www.scmdojo.com/sitemap_index.xml

Comments

  • --- WP Admin & AJAX ---
  • --- WooCommerce Logs & Uploads ---
  • --- Login & Register Redirect Loops ---
  • --- Checkout ---
  • --- Search & Filters ---
  • --- Tags (if noindexed) ---
  • --- Static Assets ---
  • Disallow: /_next/
  • Disallow: /next/
  • --- Tracking Parameters ---
  • --- AI Bots ---
  • --- AdsBot Allowed ---
  • --- Sitemap ---