Log In Sign Up

bigchefrecipes.com
robots.txt

Robots Exclusion Standard data for bigchefrecipes.com

Resource Scan

Scan Details

Site Domain bigchefrecipes.com
Base Domain bigchefrecipes.com
Scan Status Ok
Last Scan2026-02-13T10:18:09+00:00
Next Scan 2026-02-20T10:18:09+00:00

Last Scan

Scanned2026-02-13T10:18:09+00:00
URL https://bigchefrecipes.com/robots.txt
Domain IPs 104.21.34.9, 172.67.194.174, 2606:4700:3033::6815:2209, 2606:4700:3036::ac43:c2ae
Response IP 104.21.34.9
Found Yes
Hash 94e092a42789dd0e7c0977d6c6d0d6e792ca247ea7f0d142d6c2b958c14ccc88
SimHash 50ea8b50dfd1

Groups

*

Rule Path
Allow /

ezoic

Rule Path
Allow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://bigchefrecipes.com/sitemap.xml
Back to top

Comments

  • Robots.txt for bigchefrecipes.com
  • Generated automatically by recipe site generator
  • Allow all bots to index the site
  • Sitemap
  • Ezoic verification (ad network compatibility)
  • Block AI training bots (optional - protects content)
Back to top