Log In Sign Up

24lancer.ir
robots.txt

Robots Exclusion Standard data for 24lancer.ir

Resource Scan

Scan Details

Site Domain 24lancer.ir
Base Domain 24lancer.ir
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-12-03T04:12:25+00:00
Next Scan 2026-02-01T04:12:25+00:00

Last Successful Scan

Scanned2025-09-27T06:11:04+00:00
URL https://24lancer.ir/robots.txt
Domain IPs 104.21.9.26, 172.67.141.45, 2606:4700:3031::6815:91a, 2606:4700:3032::ac43:8d2d
Response IP 104.21.9.26
Found Yes
Hash eca34f86481a245515fd6d33f5cb9dcaaaf9a00f3a19880385ec6d5f4810dfb1
SimHash d23ae94a6e8f

Groups

*

Rule Path
Disallow /*?s=*
Disallow /*?attachment_id=*
Disallow /*?author=*
Disallow /*?cat=*
Disallow /*?tag=*
Disallow /*?page_id=*
Disallow /*?paged=*
Disallow /*?archive=*
Disallow /*?replytocom=*
Disallow /*/page/
Disallow /wp-includes/
Disallow /wp-content/themes/
Disallow /wp-content/plugins/
Disallow /wp-content/cache/
Disallow /comments/
Disallow /trackback/
Disallow /feed/
Disallow /search/
Disallow /404/
Back to top

Comments

  • Generated for domain: 24lancer.ir
  • Prevent bots from accessing common WordPress entry points.
  • Blocking pagination for bots.
  • Disallowing includes directory for security.
  • Themes directory is off-limits.
  • Restricting plugin access.
  • Caching is disabled.
  • Blocking unnecessary query strings.
Back to top