cookaxe.com
robots.txt

Robots Exclusion Standard data for cookaxe.com

Resource Scan

Scan Details

Site Domain cookaxe.com
Base Domain cookaxe.com
Scan Status Ok
Last Scan2025-11-10T18:37:39+00:00
Next Scan 2025-11-17T18:37:39+00:00

Last Scan

Scanned2025-11-10T18:37:39+00:00
URL https://cookaxe.com/robots.txt
Domain IPs 104.21.56.221, 172.67.156.32, 2606:4700:3030::ac43:9c20, 2606:4700:3033::6815:38dd
Response IP 172.67.156.32
Found Yes
Hash 4fd4a7720accc356f7198593c7d1dd6eadc17175c38b848ed8fbdf97dffcd109
SimHash 6e204a0222ba

Groups

*

Rule Path Comment
Disallow /wp-admin/ -
Disallow /wp-login.php -
Disallow /?s= -
Disallow /search/ -
Disallow /feed/ -
Disallow /*/feed/ -
Disallow /author/ -
Disallow /tag/ -
Disallow /comments/ -
Disallow /category/scholarship/ -
Disallow /wprm_print/ -
Disallow /cgi-bin/ -
Disallow /xmlrpc.php -
Disallow */embed/ -
Disallow /trackback/ -
Disallow /20*/ This blocks all URLs like /2025/04/, /2024/12/, etc.
Allow /wp-admin/admin-ajax.php -

Other Records

Field Value
sitemap https://cookaxe.com/sitemap_index.xml

Comments

  • Block internal search and feeds
  • Block low-value archives
  • Block technical/print-only pages
  • Block date archives