derbyderbyderby.it
robots.txt
Robots Exclusion Standard data for derbyderbyderby.it
Resource Scan
Scan Details
Site Domain | derbyderbyderby.it |
Base Domain | derbyderbyderby.it |
Scan Status | Ok |
Last Scan | 2024-06-03T14:48:42+00:00 |
Next Scan | 2024-06-10T14:48:42+00:00 |
Last Scan
Scanned | 2024-06-03T14:48:42+00:00 |
URL | https://www.derbyderbyderby.it/robots.txt |
Response IP | 34.90.132.17 |
Found | Yes |
Hash | 3c9fcb9f11d332a54a32b3a52801285441f968f673c85d5772c87294d95fbf4c |
SimHash | 231d5060c3f1 |
Groups
*
Rule | Path |
---|---|
Disallow | */commenti/$ |
Disallow | /rcs-community-comments-rest-api/ |
Disallow | /archivio/pagina-*/pagina- |
Disallow | /archivio/page/ |
Disallow | /archivio/categoria/ |
Disallow | /archivio/gallery/ |
Disallow | /archivio/video/ |
Disallow | /*commenti/ |
Disallow | /*?app_v2 |
Disallow | /*?app_v1 |
Other Records
Field | Value |
---|---|
sitemap | https://www.derbyderbyderby.it/sitemaps/sitemap.xml |
sitemap | https://www.derbyderbyderby.it/sitemaps/sitemap-news.xml |