svetlo.media
robots.txt
Robots Exclusion Standard data for svetlo.media
Resource Scan
Scan Details
| Site Domain | svetlo.media |
| Base Domain | svetlo.media |
| Scan Status | Ok |
| Last Scan | 2024-11-09T19:18:40+00:00 |
| Next Scan | 2024-11-16T19:18:40+00:00 |
Last Scan
| Scanned | 2024-11-09T19:18:40+00:00 |
| URL | https://svetlo.media/robots.txt |
| Domain IPs | 104.26.2.5, 104.26.3.5, 172.67.68.225, 2606:4700:20::681a:205, 2606:4700:20::681a:305, 2606:4700:20::ac43:44e1 |
| Response IP | 104.26.3.5 |
| Found | Yes |
| Hash | 0cf95927845805e026e018896157d2a29422993ba8d382e6958382a6b6a9fd58 |
| SimHash | 5d40ce408791 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /search?query=* |
| Disallow | /? |
| Disallow | /profile |
| Disallow | /frontend/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://svetlo.media/sitemaps.xml |
Warnings
- `host` is not a known field.