onli-vk.ru
robots.txt
Robots Exclusion Standard data for onli-vk.ru
Resource Scan
Scan Details
Site Domain | onli-vk.ru |
Base Domain | onli-vk.ru |
Scan Status | Ok |
Last Scan | 2024-06-03T15:36:49+00:00 |
Next Scan | 2024-06-10T15:36:49+00:00 |
Last Scan
Scanned | 2024-06-03T15:36:49+00:00 |
URL | https://onli-vk.ru/robots.txt |
Domain IPs | 104.21.24.192, 172.67.220.29, 2606:4700:3033::ac43:dc1d, 2606:4700:3035::6815:18c0 |
Response IP | 104.21.24.192 |
Found | Yes |
Hash | b2e27005b1f0b2424cc2839d2892235c6ec8f27fb116ffbc3a6cc8e65eb1e78f |
SimHash | d5c1c972e390 |
Groups
*
Rule | Path |
---|---|
Disallow | /id951521 |
Disallow | /id62325616 |
Disallow | /id10386331 |
Disallow | /tg.php |
Other Records
Field | Value |
---|---|
crawl-delay | 0.33 |