novamett.ru
robots.txt
Robots Exclusion Standard data for novamett.ru
Resource Scan
Scan Details
| Site Domain | novamett.ru |
| Base Domain | novamett.ru |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-10-14T09:29:52+00:00 |
| Next Scan | 2025-01-12T09:29:52+00:00 |
Last Successful Scan
| Scanned | 2024-06-17T09:28:22+00:00 |
| URL | https://novamett.ru/robots.txt |
| Domain IPs | 104.21.42.6, 172.67.197.225, 2606:4700:3033::6815:2a06, 2606:4700:3037::ac43:c5e1 |
| Response IP | 104.21.42.6 |
| Found | Yes |
| Hash | 1b052e5c56afc9bfc98592e269bd4f8f65fb91f6e070ad915f75d6cbed36905f |
| SimHash | a93df5d44331 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /cli/ |
| Disallow | /components/ |
| Disallow | /includes/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /logs/ |
| Disallow | /modules/ |
| Disallow | /plugins/ |
| Disallow | /templates/ |
| Disallow | /tmp/ |
| Disallow | */author/* |
| Disallow | *itemlist?* |
| Disallow | */brib/* |
| Disallow | /content/ |
| Disallow | *?* |
| Disallow | *%26* |
Warnings
- `host` is not a known field.