Log In Sign Up

recipechange.com
robots.txt

Robots Exclusion Standard data for recipechange.com

Resource Scan

Scan Details

Site Domain recipechange.com
Base Domain recipechange.com
Scan Status Ok
Last Scan2026-02-19T11:40:58+00:00
Next Scan 2026-02-26T11:40:58+00:00

Last Scan

Scanned2026-02-19T11:40:58+00:00
URL https://recipechange.com/robots.txt
Redirect https://www.recipechange.com/robots.txt
Redirect Domain www.recipechange.com
Redirect Base recipechange.com
Domain IPs 2a02:4780:2b:1782:0:1300:6a86:4, 88.223.85.23
Redirect IPs 2a02:4780:2b:1782:0:1300:6a86:4, 88.223.85.23
Response IP 88.223.85.23
Found Yes
Hash 269d0a07f3638cb8edd4758052e33375914406d7b7c534b31269d9e5552cc45b
SimHash 742cda9365a8

Groups

contaibot

Rule Path
Allow /

semrushbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /cgi-bin/
Disallow /trackback/
Disallow /comments/
Disallow /category/*/*/
Disallow /author/
Disallow /tag/
Disallow /feed/
Allow *.css
Allow *.js
Disallow /private/
Disallow /tmp/
Disallow /backup/
Disallow /search/
Back to top

Other Records

Field Value
sitemap https://ww.recipechange.com/sitemap.xml
Back to top

Comments

  • Block access to sensitive directories and content
  • Allow crawling of CSS and JS files for proper rendering
  • Block crawling of private and backup folders
  • Block search result pages crawling
  • Sitemap location for better indexing
Back to top