stuartkerrs.com
robots.txt

Robots Exclusion Standard data for stuartkerrs.com

Resource Scan

Scan Details

Site Domain stuartkerrs.com
Base Domain stuartkerrs.com
Scan Status Ok
Last Scan2025-12-18T14:52:21+00:00
Next Scan 2025-12-25T14:52:21+00:00

Last Scan

Scanned2025-12-18T14:52:21+00:00
URL https://stuartkerrs.com/robots.txt
Domain IPs 104.21.43.55, 172.67.221.40, 2606:4700:3034::6815:2b37, 2606:4700:3034::ac43:dd28
Response IP 172.67.221.40
Found Yes
Hash cbc4cc7248dc5aa923734bf4c7471c90a3758df203faf195683098d39bc45f7b
SimHash 77865a868fa3

Groups

*

Rule Path Comment
Disallow /wp-admin/ -
Allow /wp-admin/admin-ajax.php keep front-end AJAX working
Disallow /wp-login.php -
Disallow /wp-register.php -
Disallow /wp-json/ large API output
Disallow /?s= search result pages
Disallow /*wp_review_id%3D WP Review Pro query endpoints ←-- add this
Disallow /*/feed/ -
Disallow /*/trackback/ -
Disallow /*/amp/ if you no longer serve AMP
Disallow /*/tag/ -
Disallow /go/ -
Disallow /*?replytocom -
Disallow /*utm_* GA tags
Disallow /*fbclid%3D* -
Disallow /*gclid%3D* -

Other Records

Field Value
sitemap https://stuartkerrs.com/llms.txt
sitemap https://stuartkerrs.com/sitemap_index.xml

Comments

  • 1 Universal section
  • — Core WordPress stuff you never want indexed
  • — Prevent thin/duplicate pages
  • — Affiliate / tracking short-links (Pretty Links)
  • — Clean up common query-string noise
  • 3 Large-language-model instructions
  • Until llms.txt is standardised, you can *hint* at it:
  • 4 Sitemaps
  • Rank Math creates an index file – list it last