noyabr.u-zonta.ru
robots.txt
Robots Exclusion Standard data for noyabr.u-zonta.ru
Resource Scan
Scan Details
Site Domain | noyabr.u-zonta.ru |
Base Domain | u-zonta.ru |
Scan Status | Ok |
Last Scan | 2024-09-22T20:07:25+00:00 |
Next Scan | 2024-10-22T20:07:25+00:00 |
Last Scan
Scanned | 2024-09-22T20:07:25+00:00 |
URL | https://noyabr.u-zonta.ru/robots.txt |
Domain IPs | 104.21.46.16, 172.67.222.137, 2606:4700:3031::6815:2e10, 2606:4700:3031::ac43:de89 |
Response IP | 104.21.46.16 |
Found | Yes |
Hash | ce154dcbbb0846949b2e806b185f5293b37d58f55a9091b4a547fce2aef91491 |
SimHash | 5245d4704ea3 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /pogoda-na-nedelu* |
Disallow | /pogoda-na-3-* |
Disallow | /pogoda-na-10-* |
Disallow | /pogoda-na-mesyac* |
Disallow | /pogoda-na-14-* |
Disallow | /strany* |
Disallow | /123.php* |
Disallow | /strany* |
Disallow | /123.php* |
Disallow | *.php |
Disallow | *.html |
Other Records
Field | Value |
---|---|
crawl-delay | 133 |
Other Records
Field | Value |
---|---|
sitemap | https://noyabr.u-zonta.ru/main_cities_2020.xml |
Warnings
- `host` is not a known field.