delfi.lt
robots.txt
Robots Exclusion Standard data for delfi.lt
Resource Scan
Scan Details
| Site Domain | delfi.lt |
| Base Domain | delfi.lt |
| Scan Status | Ok |
| Last Scan | 2024-04-27T03:19:58+00:00 |
| Next Scan | 2024-05-04T03:19:58+00:00 |
Last Scan
| Scanned | 2024-04-27T03:19:58+00:00 |
| URL | https://delfi.lt/robots.txt |
| Redirect | https://www.delfi.lt/robots.txt |
| Redirect Domain | www.delfi.lt |
| Redirect Base | delfi.lt |
| Domain IPs | 104.22.26.85, 104.22.27.85, 172.67.11.70 |
| Redirect IPs | 104.22.26.85, 104.22.27.85, 172.67.11.70 |
| Response IP | 104.22.26.85 |
| Found | Yes |
| Hash | 97ec20dcb9fea39da5e08b0980d2eb1878e4f9eab796f0c7e37905ad7d7b4c71 |
| SimHash | c80d9200ca10 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /search?* |
| Disallow | /paieska?* |
| Disallow | /poisk* |
| Disallow | /*diskusija |
| Disallow | /*comments |
| Disallow | /*kommentarii |
| Disallow | /*napo |
| Disallow | /*%26com%3D* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.delfi.lt/news/sitemap/index.xml |