Log In Sign Up

spclass.ir
robots.txt

Robots Exclusion Standard data for spclass.ir

Resource Scan

Scan Details

Site Domain spclass.ir
Base Domain spclass.ir
Scan Status Ok
Last Scan2025-05-08T02:16:03+00:00
Next Scan 2025-06-07T02:16:03+00:00

Last Scan

Scanned2025-05-08T02:16:03+00:00
URL https://spclass.ir/robots.txt
Domain IPs 104.21.23.140, 172.67.211.84, 2606:4700:3037::6815:178c, 2606:4700:3037::ac43:d354
Response IP 172.67.211.84
Found Yes
Hash d26d4be8c21321fcc3b1b56570dd80a3ed0a1f7a7b82080107d72e96bd6cff32
SimHash 72a84901679d

Groups

*

Rule Path
Disallow /wp-includes/
Disallow /wp-content/plugins/
Disallow /wp-content/cache/
Disallow /wp-content/themes/
Disallow /wp-content/uploads/
Disallow /*?s=*
Disallow /*?attachment_id=*
Disallow /*?author=*
Disallow /*?cat=*
Disallow /*?tag=*
Disallow /*?page_id=*
Disallow /*?paged=*
Disallow /*?archive=*
Disallow /*?replytocom=*
Disallow /comments/
Disallow /trackback/
Disallow /feed/
Disallow /search/
Disallow /404/
Disallow /*/page/
Disallow /cgi-bin/
Disallow /tmp/
Disallow /private/
Disallow /old/
Disallow /backup/

*

Rule Path
Disallow /r/

googlebot

Rule Path
Disallow

googlebot

Rule Path
Allow /category/
Allow /tag/
Allow /post/
Allow /page/

googlebot

Rule Path
Allow /r/

*

Rule Path
Disallow /r/

googlebot

Rule Path
Allow /r/
Back to top

Comments

  • Generated for domain:
  • Disallowing includes directory for security.
  • Restricting plugin access.
  • Caching is disabled.
  • Themes directory is off-limits.
  • Blocking uploads to prevent unwanted access.
  • Prevent bots from accessing common WordPress entry points.
  • Blocking unnecessary query strings.
  • Blocking pagination for bots.
  • Prevent paginated content indexing.
  • Blocking specific folders for security reasons.
  • Allowing full access for Google bots to tags, categories, posts, and pages.
  • Ensure Google can access tags, categories, and posts.
  • Allowing Google access to /r/ but blocking others.
  • Ensuring Google is allowed on /r/
Back to top