merrychef.com
robots.txt
Robots Exclusion Standard data for merrychef.com
Resource Scan
Scan Details
| Site Domain | merrychef.com |
| Base Domain | merrychef.com |
| Scan Status | Ok |
| Last Scan | 2025-11-11T01:35:40+00:00 |
| Next Scan | 2025-12-11T01:35:40+00:00 |
Last Scan
| Scanned | 2025-11-11T01:35:40+00:00 |
| URL | https://merrychef.com/robots.txt |
| Redirect | https://www.merrychef.com/robots.txt |
| Redirect Domain | www.merrychef.com |
| Redirect Base | merrychef.com |
| Domain IPs | 13.89.172.12, 40.86.99.202 |
| Redirect IPs | 13.107.213.59, 13.107.246.59, 2620:1ec:46::59, 2620:1ec:bdf::59 |
| Response IP | 13.107.213.59 |
| Found | Yes |
| Hash | 81b0a6f0f834d868207256c94b168e1a90f0c9b949feebd33b25f15f9707c038 |
| SimHash | 7a1ed150c8cb |
Groups
google
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /Global-Tools |
| Disallow | /Special-Pages |
| Disallow | /Pricebook |
| Disallow | /api |
| Disallow | /asset |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
hubspot links crawler 1.0 http://www.hubspot.com/
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /Global-Tools |
| Disallow | /Special-Pages |
| Disallow | /Pricebook |
| Disallow | /api |
| Disallow | /asset |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
hubspot crawler 1.0 http://www.hubspot.com/
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /Global-Tools |
| Disallow | /Special-Pages |
| Disallow | /Pricebook |
| Disallow | /api |
| Disallow | /asset |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
hubspot crawler
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /Global-Tools |
| Disallow | /Special-Pages |
| Disallow | /Pricebook |
| Disallow | /api |
| Disallow | /asset |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
baiduspider
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /Global-Tools |
| Disallow | /Special-Pages |
| Disallow | /Pricebook |
| Disallow | /api |
| Disallow | /asset |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
googlebot
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /Global-Tools |
| Disallow | /Special-Pages |
| Disallow | /Pricebook |
| Disallow | /api |
| Disallow | /asset |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
googlebot-image
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /Global-Tools |
| Disallow | /Special-Pages |
| Disallow | /Pricebook |
| Disallow | /api |
| Disallow | /asset |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
iaskspider
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /Global-Tools |
| Disallow | /Special-Pages |
| Disallow | /Pricebook |
| Disallow | /api |
| Disallow | /asset |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
msnbot
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /Global-Tools |
| Disallow | /Special-Pages |
| Disallow | /Pricebook |
| Disallow | /api |
| Disallow | /asset |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
sogou spider
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /Global-Tools |
| Disallow | /Special-Pages |
| Disallow | /Pricebook |
| Disallow | /api |
| Disallow | /asset |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
sosospider
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /Global-Tools |
| Disallow | /Special-Pages |
| Disallow | /Pricebook |
| Disallow | /api |
| Disallow | /asset |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
teoma
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /Global-Tools |
| Disallow | /Special-Pages |
| Disallow | /Pricebook |
| Disallow | /api |
| Disallow | /asset |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
yahoo! slurp
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /Global-Tools |
| Disallow | /Special-Pages |
| Disallow | /Pricebook |
| Disallow | /api |
| Disallow | /asset |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
yahoo! slurp china
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /Global-Tools |
| Disallow | /Special-Pages |
| Disallow | /Pricebook |
| Disallow | /api |
| Disallow | /asset |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
yahooseeker
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /Global-Tools |
| Disallow | /Special-Pages |
| Disallow | /Pricebook |
| Disallow | /api |
| Disallow | /asset |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
yandexbot
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /Global-Tools |
| Disallow | /Special-Pages |
| Disallow | /Pricebook |
| Disallow | /api |
| Disallow | /asset |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
yandeximages
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /Global-Tools |
| Disallow | /Special-Pages |
| Disallow | /Pricebook |
| Disallow | /api |
| Disallow | /asset |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
sebot-wa
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /Global-Tools |
| Disallow | /Special-Pages |
| Disallow | /Pricebook |
| Disallow | /api |
| Disallow | /asset |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
gptbot
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /Global-Tools |
| Disallow | /Special-Pages |
| Disallow | /Pricebook |
| Disallow | /api |
| Disallow | /asset |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
oai-searchbot
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /Global-Tools |
| Disallow | /Special-Pages |
| Disallow | /Pricebook |
| Disallow | /api |
| Disallow | /asset |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
chatgpt-user
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /Global-Tools |
| Disallow | /Special-Pages |
| Disallow | /Pricebook |
| Disallow | /api |
| Disallow | /asset |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
chatgpt-user/2.0
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /Global-Tools |
| Disallow | /Special-Pages |
| Disallow | /Pricebook |
| Disallow | /api |
| Disallow | /asset |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
anthropic-ai
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /Global-Tools |
| Disallow | /Special-Pages |
| Disallow | /Pricebook |
| Disallow | /api |
| Disallow | /asset |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
claudebot
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /Global-Tools |
| Disallow | /Special-Pages |
| Disallow | /Pricebook |
| Disallow | /api |
| Disallow | /asset |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
claude-web
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /Global-Tools |
| Disallow | /Special-Pages |
| Disallow | /Pricebook |
| Disallow | /api |
| Disallow | /asset |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
perplexitybot
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /Global-Tools |
| Disallow | /Special-Pages |
| Disallow | /Pricebook |
| Disallow | /api |
| Disallow | /asset |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
perplexity-
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /Global-Tools |
| Disallow | /Special-Pages |
| Disallow | /Pricebook |
| Disallow | /api |
| Disallow | /asset |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
google-extended
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /Global-Tools |
| Disallow | /Special-Pages |
| Disallow | /Pricebook |
| Disallow | /api |
| Disallow | /asset |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
bingbot
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /Global-Tools |
| Disallow | /Special-Pages |
| Disallow | /Pricebook |
| Disallow | /api |
| Disallow | /asset |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
amazonbot
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /Global-Tools |
| Disallow | /Special-Pages |
| Disallow | /Pricebook |
| Disallow | /api |
| Disallow | /asset |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
applebot
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /Global-Tools |
| Disallow | /Special-Pages |
| Disallow | /Pricebook |
| Disallow | /api |
| Disallow | /asset |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
applebot-extended
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /Global-Tools |
| Disallow | /Special-Pages |
| Disallow | /Pricebook |
| Disallow | /api |
| Disallow | /asset |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
facebookbot
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /Global-Tools |
| Disallow | /Special-Pages |
| Disallow | /Pricebook |
| Disallow | /api |
| Disallow | /asset |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
meta-externalagent
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /Global-Tools |
| Disallow | /Special-Pages |
| Disallow | /Pricebook |
| Disallow | /api |
| Disallow | /asset |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
linkedinbot
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /Global-Tools |
| Disallow | /Special-Pages |
| Disallow | /Pricebook |
| Disallow | /api |
| Disallow | /asset |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
bytespider
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /Global-Tools |
| Disallow | /Special-Pages |
| Disallow | /Pricebook |
| Disallow | /api |
| Disallow | /asset |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
duckassistbot
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /Global-Tools |
| Disallow | /Special-Pages |
| Disallow | /Pricebook |
| Disallow | /api |
| Disallow | /asset |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
ccbot
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /Global-Tools |
| Disallow | /Special-Pages |
| Disallow | /Pricebook |
| Disallow | /api |
| Disallow | /asset |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
diffbot
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /Global-Tools |
| Disallow | /Special-Pages |
| Disallow | /Pricebook |
| Disallow | /api |
| Disallow | /asset |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
timpibot
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /Global-Tools |
| Disallow | /Special-Pages |
| Disallow | /Pricebook |
| Disallow | /api |
| Disallow | /asset |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
youbot
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /Global-Tools |
| Disallow | /Special-Pages |
| Disallow | /Pricebook |
| Disallow | /api |
| Disallow | /asset |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
mistralai-user
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /Global-Tools |
| Disallow | /Special-Pages |
| Disallow | /Pricebook |
| Disallow | /api |
| Disallow | /asset |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
*
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.merrychef.com/sitemap.xml |
| sitemap | https://www.merrychef.com/sitemap.xml |
| sitemap | https://www.merrychef.com/sitemap.xml |
| sitemap | https://www.merrychef.com/sitemap.xml |
| sitemap | https://www.merrychef.com/sitemap.xml |
| sitemap | https://www.merrychef.com/sitemap.xml |
| sitemap | https://www.merrychef.com/sitemap.xml |
| sitemap | https://www.merrychef.com/sitemap.xml |
| sitemap | https://www.merrychef.com/sitemap.xml |
| sitemap | https://www.merrychef.com/sitemap.xml |
| sitemap | https://www.merrychef.com/sitemap.xml |
| sitemap | https://www.merrychef.com/sitemap.xml |
| sitemap | https://www.merrychef.com/sitemap.xml |
| sitemap | https://www.merrychef.com/sitemap.xml |
| sitemap | https://www.merrychef.com/sitemap.xml |
| sitemap | https://www.merrychef.com/sitemap.xml |
| sitemap | https://www.merrychef.com/sitemap.xml |
| sitemap | https://www.merrychef.com/sitemap.xml |
| sitemap | https://www.merrychef.com/sitemap.xml |
| sitemap | https://www.merrychef.com/sitemap.xml |
| sitemap | https://www.merrychef.com/sitemap.xml |
| sitemap | https://www.merrychef.com/sitemap.xml |
| sitemap | https://www.merrychef.com/sitemap.xml |
| sitemap | https://www.merrychef.com/sitemap.xml |
| sitemap | https://www.merrychef.com/sitemap.xml |
| sitemap | https://www.merrychef.com/sitemap.xml |
| sitemap | https://www.merrychef.com/sitemap.xml |
| sitemap | https://www.merrychef.com/sitemap.xml |
| sitemap | https://www.merrychef.com/sitemap.xml |
| sitemap | https://www.merrychef.com/sitemap.xml |
| sitemap | https://www.merrychef.com/sitemap.xml |
| sitemap | https://www.merrychef.com/sitemap.xml |
| sitemap | https://www.merrychef.com/sitemap.xml |
| sitemap | https://www.merrychef.com/sitemap.xml |
| sitemap | https://www.merrychef.com/sitemap.xml |
| sitemap | https://www.merrychef.com/sitemap.xml |
| sitemap | https://www.merrychef.com/sitemap.xml |
| sitemap | https://www.merrychef.com/sitemap.xml |
| sitemap | https://www.merrychef.com/sitemap.xml |
| sitemap | https://www.merrychef.com/sitemap.xml |
| sitemap | https://www.merrychef.com/sitemap.xml |
| sitemap | https://www.merrychef.com/sitemap.xml |