21one.ru
robots.txt
Robots Exclusion Standard data for 21one.ru
Resource Scan
Scan Details
| Site Domain | 21one.ru |
| Base Domain | 21one.ru |
| Scan Status | Ok |
| Last Scan | 2024-06-28T06:43:39+00:00 |
| Next Scan | 2024-07-05T06:43:39+00:00 |
Last Scan
| Scanned | 2024-06-28T06:43:39+00:00 |
| URL | https://21one.ru/robots.txt |
| Domain IPs | 87.236.16.43 |
| Response IP | 87.236.16.43 |
| Found | Yes |
| Hash | a8f060797c56932eccd9673203f57e3a3bb1dc833cc6b6d59ab742af9be8d96a |
| SimHash | ab1cc5606191 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /cli/ |
| Disallow | /components/ |
| Disallow | /images/ |
| Disallow | /includes/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /logs/ |
| Disallow | /media/ |
| Disallow | /modules/ |
| Disallow | /plugins/ |
| Disallow | /templates/ |
| Disallow | /tmp/ |
Warnings
- `host` is not a known field.