westro.ru
robots.txt
Robots Exclusion Standard data for westro.ru
Resource Scan
Scan Details
| Site Domain | westro.ru |
| Base Domain | westro.ru |
| Scan Status | Ok |
| Last Scan | 2024-06-04T10:44:41+00:00 |
| Next Scan | 2024-06-11T10:44:41+00:00 |
Last Scan
| Scanned | 2024-06-04T10:44:41+00:00 |
| URL | https://westro.ru/robots.txt |
| Domain IPs | 138.201.138.49 |
| Response IP | 138.201.138.49 |
| Found | Yes |
| Hash | 1bc5c4f28d1f61a6770575b435a407e429efae19ec53412bdc35ea99e2e5af87 |
| SimHash | ad308b00cd32 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /assets/ |
| Disallow | /bots/ |
| Disallow | /documents/ |
| Disallow | /games/ |
| Disallow | /webapps/ |
| Disallow | /quicklinks/ |
| Disallow | /apps/ |
| Disallow | /redirect/ |
| Disallow | /news/admins/ |
| Disallow | /test/ |
| Allow | /$ |
| Allow | /index.html |
| Allow | /games/index.html |
| Allow | /apps/games/ |
| Allow | /news/ |