gdz.ru
robots.txt
Robots Exclusion Standard data for gdz.ru
Resource Scan
Scan Details
| Site Domain | gdz.ru |
| Base Domain | gdz.ru |
| Scan Status | Ok |
| Last Scan | 2024-11-03T00:32:26+00:00 |
| Next Scan | 2024-11-10T00:32:26+00:00 |
Last Scan
| Scanned | 2024-11-03T00:32:26+00:00 |
| URL | https://gdz.ru/robots.txt |
| Domain IPs | 104.22.76.173, 104.22.77.173, 172.67.11.130, 2606:4700:10::6816:4cad, 2606:4700:10::6816:4dad, 2606:4700:10::ac43:b82 |
| Response IP | 104.22.76.173 |
| Found | Yes |
| Hash | a43f2946f29d46577c60a21155d8ea96c4edda98d54e45a4a1a98f1287a49d5c |
| SimHash | 4f408ec1c352 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | */pay |
| Disallow | */user |
| Disallow | /search/* |
| Disallow | /video/* |
| Disallow | /test* |
| Disallow | /about* |
| Disallow | /privacy.html |
Other Records
| Field | Value |
|---|---|
| sitemap | https://gdz.ru/sitemap.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.