may.u-zonta.ru
robots.txt
Robots Exclusion Standard data for may.u-zonta.ru
Resource Scan
Scan Details
| Site Domain | may.u-zonta.ru |
| Base Domain | u-zonta.ru |
| Scan Status | Ok |
| Last Scan | 2024-09-22T19:13:21+00:00 |
| Next Scan | 2024-10-22T19:13:21+00:00 |
Last Scan
| Scanned | 2024-09-22T19:13:21+00:00 |
| URL | https://may.u-zonta.ru/robots.txt |
| Domain IPs | 104.21.46.16, 172.67.222.137, 2606:4700:3031::6815:2e10, 2606:4700:3031::ac43:de89 |
| Response IP | 104.21.46.16 |
| Found | Yes |
| Hash | 64d7a6035a0bb5acd650587af062e8265b8464ccf84d9e05c924e3b7272d5b29 |
| SimHash | 5245d4d1ce33 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /pogoda-na-nedelu* |
| Disallow | /pogoda-na-3-* |
| Disallow | /pogoda-na-10-* |
| Disallow | /pogoda-na-mesyac* |
| Disallow | /pogoda-na-14-* |
| Disallow | /strany* |
| Disallow | /123.php* |
| Disallow | /strany* |
| Disallow | /123.php* |
| Disallow | *.php |
| Disallow | *.html |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 133 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://may.u-zonta.ru/main_cities_2020.xml |
Warnings
- `host` is not a known field.