obi-italia.it
robots.txt
Robots Exclusion Standard data for obi-italia.it
Resource Scan
Scan Details
| Site Domain | obi-italia.it |
| Base Domain | obi-italia.it |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-10-23T01:30:17+00:00 |
| Next Scan | 2024-11-06T01:30:17+00:00 |
Last Successful Scan
| Scanned | 2024-10-01T01:30:05+00:00 |
| URL | https://obi-italia.it/robots.txt |
| Redirect | https://www.obi-italia.it/robots.txt |
| Redirect Domain | www.obi-italia.it |
| Redirect Base | obi-italia.it |
| Domain IPs | 108.138.7.101, 108.138.7.115, 108.138.7.52, 108.138.7.86 |
| Redirect IPs | 54.230.112.110, 54.230.112.34, 54.230.112.70, 54.230.112.85 |
| Response IP | 13.226.2.68 |
| Found | Yes |
| Hash | 43e1cc475a228a8b1fe55e04950a8f5488e70b6360b7d74d5f827a0238ee658e |
| SimHash | 99428a349d96 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /decom/api/compare |
| Disallow | /decom/api/cart |
| Disallow | /decom/api/shoppinglist/size |
| Disallow | /public/services |
| Disallow | /decom/store/popup/ |
| Disallow | /decom/store/change |
| Disallow | /*?themeChoiceId |
| Disallow | /decom/customer-reviews/ |
| Disallow | /api/customerreviews/ |
| Disallow | /decom/shopping-list/add |
| Disallow | /decom/add-cart-layer |
| Disallow | /decom/search-flyout |
| Disallow | /decom/cmssearchresult-filter |
| Disallow | /decom/searchresult-filter |
| Disallow | /api/ |
| Disallow | /decom/api/ |
| Disallow | /prudsys/recommit/ |
| Disallow | /decom/authentication |
| Disallow | /decom/customer-account/registration/register |
| Disallow | /*template%3DSDP |
| Disallow | /it/contact/*?* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.obi-italia.it/sitemaps/obi_it_it/sitemap_index.xml |
Warnings
- 1 invalid line.
Comments