foodretail.es
robots.txt
Robots Exclusion Standard data for foodretail.es
Resource Scan
Scan Details
| Site Domain | foodretail.es |
| Base Domain | foodretail.es |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-06-23T05:58:37+00:00 |
| Next Scan | 2024-07-07T05:58:37+00:00 |
Last Successful Scan
| Scanned | 2024-06-08T05:58:10+00:00 |
| URL | https://foodretail.es/robots.txt |
| Redirect | https://www.foodretail.es/robots.txt |
| Redirect Domain | www.foodretail.es |
| Redirect Base | foodretail.es |
| Domain IPs | 176.34.179.218 |
| Redirect IPs | 154.47.23.177, 212.102.42.89, 2a02:6ea0:d342::4, 2a02:6ea0:d638::4 |
| Response IP | 212.102.42.89 |
| Found | Yes |
| Hash | 603490178fe507ecd592f1c392d7cf35475018fb81797e8944d558a5fd2a0d6f |
| SimHash | 6f0c4e0c6916 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /bb3comment/ |
| Disallow | /63114313/ |
| Disallow | /bbtmail/sendEntity/ |
| Disallow | /bbtstats/ |
| Disallow | /api/ |
| Disallow | */newsletter/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.foodretail.es/sitemap_index.xml |
| sitemap | https://www.foodretail.es/sitemap_google_news.xml |