ollierecipes.com
robots.txt

Robots Exclusion Standard data for ollierecipes.com

Resource Scan

Scan Details

Site Domain ollierecipes.com
Base Domain ollierecipes.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2026-02-21T10:23:41+00:00
Next Scan 2026-03-07T10:23:41+00:00

Last Successful Scan

Scanned2026-02-06T10:06:22+00:00
URL https://ollierecipes.com/robots.txt
Redirect https://www.ollierecipes.com/robots.txt
Redirect Domain www.ollierecipes.com
Redirect Base ollierecipes.com
Domain IPs 2a02:4780:2b:1782:0:1300:6a86:7, 88.223.85.23
Redirect IPs 2a02:4780:2b:1782:0:1300:6a86:7, 88.223.85.23
Response IP 88.223.85.23
Found Yes
Hash 34de77168a86e0b1360f28997b92257dc8348c5e8a204494a0df90dde0add50e
SimHash 642cda9065a8

Groups

contaibot

Rule Path
Allow /

semrushbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /cgi-bin/
Disallow /trackback/
Disallow /comments/
Disallow /category/*/*/
Disallow /author/
Disallow /tag/
Disallow /feed/
Allow *.css
Allow *.js
Disallow /private/
Disallow /tmp/
Disallow /backup/
Disallow /search/

Other Records

Field Value
sitemap https://ollierecipes.com/sitemap.xml

Comments

  • Block access to sensitive directories and content
  • Allow crawling of CSS and JS files for proper rendering
  • Block crawling of private and backup folders
  • Block search result pages crawling
  • Sitemap location for better indexing