kam24.ru
robots.txt
Robots Exclusion Standard data for kam24.ru
Resource Scan
Scan Details
Site Domain | kam24.ru |
Base Domain | kam24.ru |
Scan Status | Ok |
Last Scan | 2024-06-19T18:35:31+00:00 |
Next Scan | 2024-06-26T18:35:31+00:00 |
Last Scan
Scanned | 2024-06-19T18:35:31+00:00 |
URL | https://kam24.ru/robots.txt |
Domain IPs | 104.21.25.247, 172.67.134.240, 2606:4700:3032::ac43:86f0, 2606:4700:3035::6815:19f7 |
Response IP | 104.21.25.247 |
Found | Yes |
Hash | 70a1d75680bbf747e8d4fb40f5575a15e2f9a1a132bc2cf2d3bf332315fbf2f7 |
SimHash | ecd2de21d330 |
Groups
*
Rule | Path |
---|---|
Disallow | /themes/ |
Disallow | /assets/ |
Disallow | /protected/ |
Disallow | /forum/ |
Disallow | /Content/forum |
Disallow | /uploads/ |
Other Records
Field | Value |
---|---|
crawl-delay | 0.5 |
Warnings
- `host` is not a known field.