Log In Sign Up

joker123ths.me
robots.txt

Robots Exclusion Standard data for joker123ths.me

Resource Scan

Scan Details

Site Domain joker123ths.me
Base Domain joker123ths.me
Scan Status Ok
Last Scan2025-10-31T23:59:41+00:00
Next Scan 2025-11-30T23:59:41+00:00

Last Scan

Scanned2025-10-31T23:59:41+00:00
URL https://joker123ths.me/robots.txt
Redirect https://joker123.org/robots.txt
Redirect Domain joker123.org
Redirect Base joker123.org
Domain IPs 104.21.17.116, 172.67.175.200, 2606:4700:3031::ac43:afc8, 2606:4700:3033::6815:1174
Redirect IPs 104.21.12.37, 172.67.193.164, 2606:4700:3031::6815:c25, 2606:4700:3037::ac43:c1a4
Response IP 172.67.193.164
Found Yes
Hash 84862adaab3c12229f933614af73d755a3a50f258766304bf38d137fe7e632ad
SimHash 6a68c9b164bf

Groups

*

Rule Path
Disallow /tag/
Disallow /feed/
Disallow /*/feed/
Disallow /?s=
Disallow /category/*/page/
Disallow /archive/*/page/
Allow /category/
Allow /archive/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Back to top

Other Records

Field Value
sitemap https://joker123.org/sitemap_index.xml
Back to top

Comments

  • START YOAST BLOCK
  • ---------------------------
  • Block all tag pages (thin content)
  • Block feeds (not useful for SEO)
  • Block search results pages
  • Block pagination of category/archive pages that are not important
  • Allow main category/archive pages and important pagination
  • Allow crawling of posts/homepage fully
  • WordPress admin - block admin but allow Ajax
  • Sitemap - point Google to sitemap
  • ---------------------------
  • END YOAST BLOCK
Back to top