foggia.corriere.it
robots.txt
Robots Exclusion Standard data for foggia.corriere.it
Resource Scan
Scan Details
Site Domain | foggia.corriere.it |
Base Domain | corriere.it |
Scan Status | Ok |
Last Scan | 2025-01-06T20:07:01+00:00 |
Next Scan | 2025-01-13T20:07:01+00:00 |
Last Scan
Scanned | 2025-01-06T20:07:01+00:00 |
URL | https://foggia.corriere.it/robots.txt |
Domain IPs | 199.232.193.50, 199.232.197.50 |
Response IP | 151.101.197.50 |
Found | Yes |
Hash | 0bae5bdd3155056a5952698c734684f2a2529e08c7da6e9be6e00723769641cc |
SimHash | b21d41d28455 |
Groups
*
Rule | Path |
---|---|
Disallow | */localwebapp |
Disallow | /cronistipercaso/loadArg.do* |
Disallow | /ricerca/ |
Disallow | /*_print.html$ |
Disallow | /ultima_ora/ |
Disallow | /notizie-ultima-ora/ |
Disallow | /communityLocal/ |
Disallow | /_template/ |
Disallow | /apw.js? |
Disallow | /*app_v2 |
Disallow | /*app_v1 |
Other Records
Field | Value |
---|---|
sitemap | https://www.corriere.it/dynamic-sitemap/sitemap-last-100/Foggia.xml |
Warnings
- 1 invalid line.
- `acap-crawler` is not a known field.
- `acap-disallow-crawl` is not a known field.
Comments