Log In Sign Up

persianmizban.com
robots.txt

Robots Exclusion Standard data for persianmizban.com

Resource Scan

Scan Details

Site Domain persianmizban.com
Base Domain persianmizban.com
Scan Status Ok
Last Scan2026-03-15T10:24:42+00:00
Next Scan 2026-03-29T10:24:42+00:00

Last Scan

Scanned2026-03-15T10:24:42+00:00
URL https://persianmizban.com/robots.txt
Redirect https://www.persianmizban.com/robots.txt
Redirect Domain www.persianmizban.com
Redirect Base persianmizban.com
Domain IPs 104.21.71.16, 172.67.168.254, 2606:4700:3032::6815:4710, 2606:4700:3036::ac43:a8fe
Redirect IPs 104.21.71.16, 172.67.168.254, 2606:4700:3032::6815:4710, 2606:4700:3036::ac43:a8fe
Response IP 172.67.168.254
Found Yes
Hash 8824ee152774b24ec136f849abe687cc5d5599e8d642b2f8d0ff0da2fe17452d
SimHash 09276a7767e4

Groups

*

Rule Path
Allow /assets/
Allow /blog/wp-content/uploads/
Disallow /includes/
Disallow /vendor/
Disallow /tmp/
Disallow /old/
Disallow /backup/
Disallow /draft/
Disallow /error_log.txt
Disallow /README.txt
Disallow /LICENSE.txt
Disallow /blog/wp-admin/
Disallow /blog/wp-includes/
Disallow /blog/xmlrpc.php
Disallow /blog/*/feed/
Disallow /blog/*/feed$
Disallow /blog/comments/feed/
Disallow /blog/trackback/
Disallow /*?replytocom=
Disallow /*?sort_by=
Disallow /*?currency=
Disallow /*.kml$
Disallow /*.kml
Disallow /cart.php
Disallow /login.php
Disallow /clientarea.php
Disallow /submitticket.php
Disallow /aff.php
Back to top

Other Records

Field Value
sitemap https://www.persianmizban.com/sitemap.xml
Back to top

Comments

  • ===================================================
  • robots.txt for www.persianmizban.com
  • Structure: Custom Assets + WordPress Blog
  • Final Verified Version - Jan 2026
  • ===================================================
  • 1. Allow Assets (CSS, JS, Fonts, Images)
  • 2. Block System & Backup Files (Root)
  • 3. Block WordPress System Paths (Inside /blog/)
  • 4. Block Feeds & Trackbacks (The main cause of "Crawled - not indexed")
  • 5. Block Junk Parameters & Files
  • 6. Block Legacy WHMCS Pages (Redirected to my. subdomain)
  • Sitemap
Back to top