foodlovers.foodretail.es
robots.txt
Robots Exclusion Standard data for foodlovers.foodretail.es
Resource Scan
Scan Details
| Site Domain | foodlovers.foodretail.es |
| Base Domain | foodretail.es |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-08-16T14:54:06+00:00 |
| Next Scan | 2024-10-15T14:54:06+00:00 |
Last Successful Scan
| Scanned | 2024-05-26T14:52:52+00:00 |
| URL | https://foodlovers.foodretail.es/robots.txt |
| Domain IPs | 154.47.23.177, 212.102.42.89, 2a02:6ea0:d342::4, 2a02:6ea0:d638::4 |
| Response IP | 212.102.42.89 |
| Found | Yes |
| Hash | d24e1abac7a784c4e3ebfa6037689feaab3ac3835e3256018ff51d0b86d845f0 |
| SimHash | 691aceae6932 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /bb3comment/ |
| Disallow | /63114313/ |
| Disallow | /bbtmail/sendEntity/ |
| Disallow | /bbtstats/ |
| Disallow | /api/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://foodlovers.foodretail.es/sitemap_index.xml |
| sitemap | https://foodlovers.foodretail.es/sitemap_google_news.xml |