afisha65.ru
robots.txt
Robots Exclusion Standard data for afisha65.ru
Resource Scan
Scan Details
Site Domain | afisha65.ru |
Base Domain | afisha65.ru |
Scan Status | Ok |
Last Scan | 2024-11-10T16:27:47+00:00 |
Next Scan | 2024-11-17T16:27:47+00:00 |
Last Scan
Scanned | 2024-11-10T16:27:47+00:00 |
URL | https://afisha65.ru/robots.txt |
Domain IPs | 104.26.14.186, 104.26.15.186, 172.67.70.76, 2606:4700:20::681a:eba, 2606:4700:20::681a:fba, 2606:4700:20::ac43:464c |
Response IP | 172.67.70.76 |
Found | Yes |
Hash | 51fb3f2779029d05c6f222600d19cdec3fc1b1274cde757ff1840944e716dce3 |
SimHash | 21503c6740b1 |
Groups
*
Rule | Path |
---|---|
Disallow | /files/ |
Disallow | /static/ |
Disallow | ajax.php |
Other Records
Field | Value |
---|---|
crawl-delay | 20 |
Warnings
- `host` is not a known field.