notetherecipe.com
robots.txt

Robots Exclusion Standard data for notetherecipe.com

Resource Scan

Scan Details

Site Domain notetherecipe.com
Base Domain notetherecipe.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-07-15T15:07:32+00:00
Next Scan 2025-09-13T15:07:32+00:00

Last Successful Scan

Scanned2025-05-17T13:15:57+00:00
URL https://notetherecipe.com/robots.txt
Domain IPs 104.21.35.49, 172.67.213.231, 2606:4700:3035::6815:2331, 2606:4700:3036::ac43:d5e7
Response IP 172.67.213.231
Found Yes
Hash f076335f378329b60e578204a49e89fcd46a9bbb02fd7dcf5520103892ab9c90
SimHash 0062b1cfcd03

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /feed/
Disallow /category/feed/
Disallow /tag/feed/
Disallow /author/feed/
Disallow /comments/feed/
Disallow /?s=
Disallow /cgi-bin/
Disallow /private/
Disallow /cart/
Disallow /checkout/
Disallow /search/
Disallow /search/page/
Disallow /tmp/
Disallow /wp-json/wp/v2/users/
Disallow /wp-json/wp/v2/themes/
Disallow /wp-json/wp/v2/settings/
Allow /wp-json/wp/v2/posts/
Allow /wp-admin/admin-ajax.php
Allow /public/
Allow /images/
Allow /css/
Allow /js/

Other Records

Field Value
sitemap https://notetherecipe.com/sitemap_index.xml

Comments

  • robots.txt for notetherecipe.com
  • General rules for all user agents
  • Allow essential WordPress AJAX functionality
  • Allow access to essential resources
  • Sitemap location