crystalworld.gr
robots.txt
Robots Exclusion Standard data for crystalworld.gr
Resource Scan
Scan Details
| Site Domain | crystalworld.gr |
| Base Domain | crystalworld.gr |
| Scan Status | Ok |
| Last Scan | 2025-12-28T07:38:07+00:00 |
| Next Scan | 2026-01-27T07:38:07+00:00 |
Last Scan
| Scanned | 2025-12-28T07:38:07+00:00 |
| URL | https://crystalworld.gr/robots.txt |
| Domain IPs | 70.32.23.103 |
| Response IP | 70.32.23.103 |
| Found | Yes |
| Hash | b289188880efd92451673314454633c404e55870954ff14332c0e9eaa1e6a1cd |
| SimHash | 650898f243a1 |
Groups
*
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 20 |