| Disallow |
/wp-admin/ |
- |
| Allow |
/wp-admin/admin-ajax.php |
Essential for WordPress AJAX functionality |
| Disallow |
/wp-login.php |
- |
| Disallow |
/wp-register.php |
- |
| Disallow |
/xmlrpc.php |
Security: often targeted for attacks |
| Disallow |
/wp-json/wp/v2/users/ |
Prevents user enumeration via REST API |
| Disallow |
/readme.html |
WordPress readme file, can reveal version |
| Disallow |
/license.txt |
WordPress license file |
| Disallow |
/wp-config.php |
Should never be accessible, but good to list |
| Disallow |
/porpoiseant/ |
- |
| Disallow |
/detroitchicago/ |
- |
| Disallow |
/beardeddragon/ |
- |
| Disallow |
/trackback/ |
- |
| Disallow |
/go/ |
Redirect/affiliate links - not for direct indexing |
| Disallow |
/ezoic/ |
Ezoic-related paths if not needed for indexing |
| Allow |
/feed/ |
Main RSS feed - important for discovery |
| Allow |
/comments/feed/ |
Main comments feed |
| Disallow |
*/feed/ |
Block category/tag/author feeds to save crawl budget |
| Allow |
/category/ |
- |
| Disallow |
/category/*/page/ |
Block category pagination |
| Allow |
/tag/ |
- |
| Disallow |
/tag/*/page/ |
Block tag pagination |
| Disallow |
/author/ |
Block author archives unless they add value |
| Disallow |
/tag/*/amp/ |
Block AMP tag pages if not needed |
| Disallow |
/resources/*/page/ |
- |
| Disallow |
/blog/page/ |
- |
| Disallow |
/*?s= |
Site search results |
| Disallow |
/*?*replytocom |
WordPress comment reply links |
| Disallow |
/*?page= |
Pagination parameter |
| Disallow |
/*%26page%3D |
Pagination parameter with ampersand |
| Disallow |
/*%26preview%3Dtrue |
WordPress preview links |
| Disallow |
/*%26print%3Dtrue |
Print version pages |
| Disallow |
/*?*utm_* |
UTM tracking parameters |
| Disallow |
/*?*fbclid= |
Facebook click tracking |
| Disallow |
/*?*gclid= |
Google click tracking |
Comments