store.corriere.it
robots.txt
Robots Exclusion Standard data for store.corriere.it
Resource Scan
Scan Details
Site Domain | store.corriere.it |
Base Domain | corriere.it |
Scan Status | Ok |
Last Scan | 2025-03-03T18:58:52+00:00 |
Next Scan | 2025-04-02T18:58:52+00:00 |
Last Scan
Scanned | 2025-03-03T18:58:52+00:00 |
URL | https://store.corriere.it/robots.txt |
Redirect | https://store.corriere.it/is-bin/INTERSHOP.enfinity/WFS/RCS-RCS_CStore-Site/it_IT/-/EUR/Robots-Start |
Domain IPs | 185.53.36.209 |
Response IP | 185.53.36.209 |
Found | Yes |
Hash | 7a9ee52d2af31f27f2ec71b03d00eb495b2a42617f002c0b09b480433d2b0478 |
SimHash | 732588e321bb |
Groups
*
Rule | Path |
---|---|
Allow | / |
Other Records
Field | Value |
---|---|
crawl-delay | 6 |
Other Records
Field | Value |
---|---|
sitemap | https://store.corriere.it/is-bin/INTERSHOP.enfinity/WFS/RCS-RCS_CStore-Site/it_IT/-/EUR/ViewSiteMap-XML |
Warnings
- 28 invalid lines.
Comments