ruborg.ru
robots.txt
Robots Exclusion Standard data for ruborg.ru
Resource Scan
Scan Details
| Site Domain | ruborg.ru |
| Base Domain | ruborg.ru |
| Scan Status | Ok |
| Last Scan | 4/21/2025, 4:07:42 AM |
| Next Scan | 5/21/2025, 4:07:42 AM |
Last Scan
| Scanned | 4/21/2025, 4:07:42 AM |
| URL | https://ruborg.ru/robots.txt |
| Domain IPs | 104.21.85.107, 172.67.204.160, 2606:4700:3033::ac43:cca0, 2606:4700:3035::6815:556b |
| Response IP | 104.21.85.107 |
| Found | Yes |
| Hash | f1d33d2988af5092d31098c8d1bbe15b729513a3250b2002fc032bb550b56a62 |
| SimHash | 4931f0c3c333 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*_openstat |
| Disallow | /*utm_ |
| Disallow | /*yclid |
| Disallow | /admin/ |
| Disallow | /about/ |
| Disallow | /contacts/ |
| Disallow | /agreement/ |
| Disallow | /search/ |
Warnings
- `host` is not a known field.