cristal.lv
robots.txt
Robots Exclusion Standard data for cristal.lv
Resource Scan
Scan Details
| Site Domain | cristal.lv |
| Base Domain | cristal.lv |
| Scan Status | Ok |
| Last Scan | 4/10/2025, 9:57:03 AM |
| Next Scan | 5/10/2025, 9:57:03 AM |
Last Scan
| Scanned | 4/10/2025, 9:57:03 AM |
| URL | https://cristal.lv/robots.txt |
| Redirect | https://www.cristal.lv/robots.txt |
| Redirect Domain | www.cristal.lv |
| Redirect Base | cristal.lv |
| Domain IPs | 104.21.82.242, 172.67.209.137, 2606:4700:3034::6815:52f2, 2606:4700:3037::ac43:d189 |
| Redirect IPs | 104.21.82.242, 172.67.209.137, 2606:4700:3034::6815:52f2, 2606:4700:3037::ac43:d189 |
| Response IP | 172.67.209.137 |
| Found | Yes |
| Hash | e45660b77639d45a4079ff5d6a5337bc16fca8d7e9eb20b5f40964f0ae2c0367 |
| SimHash | 4a1cdcd54731 |
Groups
*
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.cristal.lv/sitemap.xml |