style.corriere.it
robots.txt
Robots Exclusion Standard data for style.corriere.it
Resource Scan
Scan Details
Site Domain | style.corriere.it |
Base Domain | corriere.it |
Scan Status | Ok |
Last Scan | 2024-11-16T19:50:34+00:00 |
Next Scan | 2024-11-23T19:50:34+00:00 |
Last Scan
Scanned | 2024-11-16T19:50:34+00:00 |
URL | https://style.corriere.it/robots.txt |
Domain IPs | 13.226.2.4, 13.226.2.48, 13.226.2.54, 13.226.2.98, 2600:9000:2175:1400:1:cedf:bb80:93a1, 2600:9000:2175:2e00:1:cedf:bb80:93a1, 2600:9000:2175:4000:1:cedf:bb80:93a1, 2600:9000:2175:5a00:1:cedf:bb80:93a1, 2600:9000:2175:6200:1:cedf:bb80:93a1, 2600:9000:2175:8c00:1:cedf:bb80:93a1, 2600:9000:2175:9000:1:cedf:bb80:93a1, 2600:9000:2175:a600:1:cedf:bb80:93a1 |
Response IP | 108.156.22.69 |
Found | Yes |
Hash | 01bb831e70741d4b9de97fe175e686d27ad232efa1146fac35fbb934e920d790 |
SimHash | 621cd851e373 |
Groups
*
Rule | Path |
---|---|
Disallow | */?app_v2= |
Other Records
Field | Value |
---|---|
crawl-delay | 5 |
Other Records
Field | Value |
---|---|
sitemap | https://style.corriere.it/sitemaps/sitemap.xml/ |
sitemap | https://style.corriere.it/sitemaps/sitemap-news.xml/ |