Log In Sign Up

tarde.ir
robots.txt

Robots Exclusion Standard data for tarde.ir

Resource Scan

Scan Details

Site Domain tarde.ir
Base Domain tarde.ir
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2026-01-29T12:23:50+00:00
Next Scan 2026-04-29T12:23:50+00:00

Last Successful Scan

Scanned2025-09-25T07:27:58+00:00
URL https://tarde.ir/robots.txt
Domain IPs 104.21.81.120, 172.67.189.83, 2606:4700:3030::6815:5178, 2606:4700:3034::ac43:bd53
Response IP 104.21.81.120
Found Yes
Hash 8554b8b2656c5f9f15b14c33a76592a2579960c9c33ccb80fb434e3dbcfc5d46
SimHash 722aed486e8f

Groups

*

Rule Path
Disallow /*/page/
Disallow /*?s=*
Disallow /*?attachment_id=*
Disallow /*?author=*
Disallow /*?cat=*
Disallow /*?tag=*
Disallow /*?page_id=*
Disallow /*?paged=*
Disallow /*?archive=*
Disallow /*?replytocom=*
Disallow /comments/
Disallow /trackback/
Disallow /feed/
Disallow /search/
Disallow /404/
Disallow /wp-content/themes/
Disallow /wp-content/cache/
Disallow /wp-includes/
Disallow /wp-content/plugins/
Back to top

Comments

  • Generated for domain: tarde.ir
  • Blocking pagination for bots.
  • Prevent bots from accessing common WordPress entry points.
  • Blocking unnecessary query strings.
  • Themes directory is off-limits.
  • Caching is disabled.
  • Disallowing includes directory for security.
  • Restricting plugin access.
Back to top