cakedeliver.com
robots.txt
Robots Exclusion Standard data for cakedeliver.com
Resource Scan
Scan Details
| Site Domain | cakedeliver.com |
| Base Domain | cakedeliver.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-07-18T06:30:47+00:00 |
| Next Scan | 2025-10-16T06:30:47+00:00 |
Last Successful Scan
| Scanned | 2023-06-29T03:42:44+00:00 |
| URL | https://cakedeliver.com/robots.txt |
| Domain IPs | 104.21.15.196, 172.67.163.207, 2606:4700:3032::6815:fc4, 2606:4700:3034::ac43:a3cf |
| Response IP | 172.67.163.207 |
| Found | Yes |
| Hash | c17e59f62bb5c6513fe633f9d007d004e7a0cbaea9b5d7784764d1b0f6b15134 |
| SimHash | 6b1fd0945447 |
Groups
facebookexternalhit
googlebot
googlebot-mobile
duckduckbot
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
twitterbot
linkedinbot
yandex
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
slurp
petalbot
msnbot
bingbot
| Rule | Path | Comment |
|---|---|---|
| Disallow | /blackhole/ | - |
| Disallow | /cgi-bin/ | MT refugees |
| Disallow | /cdn-cgi/ | cloudflare |
| Disallow | /*? | - |
| Disallow | /*%26limit | - |
| Disallow | /*%26sort | - |
| Disallow | /*/price-drop/ | - |
| Disallow | /index.php?* | - |
| Disallow | /ad/ | - |
| Disallow | /admin/ | - |
| Disallow | /account*? | - |
| Disallow | /account*? | - |
| Disallow | /checkout/ | - |
| Disallow | /search | - |
| Disallow | *search | - |
| Disallow | /index.php*? | - |
| Disallow | /*.php*? | - |
| Disallow | /?* | - |
| Disallow | /search*? | - |
| Disallow | /product/*? | - |
| Disallow | /product/search*? | - |
| Disallow | /?page_id | - |
| Disallow | /*.php$ | - |
| Disallow | /*.js$ | - |
| Disallow | /*.inc$ | - |
| Disallow | /*.css$ | - |
| Disallow | /*.gz$ | - |
| Disallow | /*.wmv$ | - |
| Disallow | /*.cgi$ | - |
| Disallow | /*.xhtml$ | - |
| Disallow | /tracking/?* | - |
| Allow | / | - |
| Allow | /image/ | - |
| Allow | /image/og/* | - |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
*
| Rule | Path | Comment |
|---|---|---|
| Allow | / | - |
| Allow | /image/og/* | - |
| Disallow | /blackhole/ | - |
| Disallow | /cgi-bin/ | MT refugees |
| Disallow | /cdn-cgi/ | cloudflare |
| Disallow | /*? | - |
| Disallow | /*%26limit | - |
| Disallow | /*%26sort | - |
| Disallow | /*/price-drop/ | - |
| Disallow | /index.php?* | - |
| Disallow | /ad/ | - |
| Disallow | /admin/ | - |
| Disallow | /account*? | - |
| Disallow | /account*? | - |
| Disallow | /checkout/ | - |
| Disallow | /search | - |
| Disallow | *search | - |
| Disallow | /index.php*? | - |
| Disallow | /*.php*? | - |
| Disallow | /?* | - |
| Disallow | /search*? | - |
| Disallow | /product/*? | - |
| Disallow | /product/search*? | - |
| Disallow | /?page_id | - |
| Disallow | /*.php$ | - |
| Disallow | /*.js$ | - |
| Disallow | /*.inc$ | - |
| Disallow | /*.css$ | - |
| Disallow | /*.gz$ | - |
| Disallow | /*.wmv$ | - |
| Disallow | /*.cgi$ | - |
| Disallow | /*.xhtml$ | - |
| Disallow | /tracking/?* | - |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://cakedeliver.com/sitemaps.xml |
| sitemap | https://cakedeliver.com/sitemaps-image.xml |
| sitemap | https://cn.cakedeliver.com/sitemaps.xml |
| sitemap | https://cn.cakedeliver.com/sitemaps-image.xml |
| sitemap | https://my.cakedeliver.com/sitemaps.xml |
| sitemap | https://my.cakedeliver.com/sitemaps-image.xml |