Log In Sign Up

webdarsi.ir
robots.txt

Robots Exclusion Standard data for webdarsi.ir

Resource Scan

Scan Details

Site Domain webdarsi.ir
Base Domain webdarsi.ir
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2026-01-10T02:12:27+00:00
Next Scan 2026-02-09T02:12:27+00:00

Last Successful Scan

Scanned2025-11-17T14:01:04+00:00
URL https://www.webdarsi.ir/robots.txt
Domain IPs 198.251.88.32
Response IP 198.251.88.32
Found Yes
Hash 3cd4a1fbc30c08117acaa09b5519152a4b15ac95eead766340971099952b7f1a
SimHash d27eed4a6e1f

Groups

*

Rule Path
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Disallow /wp-includes/
Disallow /wp-content/cache/
Disallow /*?s=*
Disallow /*?attachment_id=*
Disallow /*?author=*
Disallow /*?cat=*
Disallow /*?tag=*
Disallow /*?page_id=*
Disallow /*?paged=*
Disallow /*?archive=*
Disallow /*?replytocom=*
Disallow /*/page/
Disallow /comments/
Disallow /trackback/
Disallow /feed/
Disallow /search/
Disallow /404/
Back to top

Comments

  • Generated for domain: webdarsi.ir
  • Restricting plugin access.
  • Themes directory is off-limits.
  • Disallowing includes directory for security.
  • Caching is disabled.
  • Prevent bots from accessing common WordPress entry points.
  • Blocking pagination for bots.
  • Blocking unnecessary query strings.
Back to top