theadleaf.com
robots.txt

Robots Exclusion Standard data for theadleaf.com

Resource Scan

Scan Details

Site Domain theadleaf.com
Base Domain theadleaf.com
Scan Status Ok
Last Scan2025-10-14T04:06:20+00:00
Next Scan 2025-11-13T04:06:20+00:00

Last Scan

Scanned2025-10-14T04:06:20+00:00
URL https://theadleaf.com/robots.txt
Domain IPs 192.243.110.16
Response IP 192.243.110.16
Found Yes
Hash 4ad93498709b926d6bdf1610b9678693a5ab6b426268a0fb7a3d14c03c537a3d
SimHash 57242a82adb3

Groups

*

Rule Path Comment
Disallow /wp-admin/ block access to admin section
Disallow /wp-login.php block access to admin section
Disallow /search/ block access to internal search result pages
Disallow *?s=* block access to internal search result pages
Disallow *?p=* block access to pages for which permalinks fails
Disallow *%26p%3D* block access to pages for which permalinks fails
Disallow *%26preview%3D* block access to preview pages
Disallow /tag/ block access to tag pages
Disallow /author/ block access to author pages
Disallow /404-error/ block access to 404 page
Disallow /?wordfence block access to Wordfence query pages

*

Rule Path
Disallow dev.theadleaf.com/

Other Records

Field Value
sitemap https://www.theadleaf.com/sitemap_index.xml

Comments

  • START YOAST BLOCK
  • ---------------------------
  • Block all bots from dev subdomain
  • ---------------------------
  • END YOAST BLOCK