cinematext.ru
robots.txt
Robots Exclusion Standard data for cinematext.ru
Resource Scan
Scan Details
| Site Domain | cinematext.ru |
| Base Domain | cinematext.ru |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-08-23T13:18:42+00:00 |
| Next Scan | 2024-11-21T13:18:42+00:00 |
Last Successful Scan
| Scanned | 2023-05-02T11:22:10+00:00 |
| URL | https://cinematext.ru/robots.txt |
| Domain IPs | 91.236.136.45 |
| Response IP | 91.236.136.45 |
| Found | Yes |
| Hash | 403ed01dad69bae1d33989b58b1f868ec6551b62502c0e13a0facfee94bc9f80 |
| SimHash | 0d09ce806b11 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /add-movie/ |
| Disallow | /doubles/ |
| Disallow | /edit-movie/ |
| Disallow | /profile/ |
| Disallow | /users/ |
| Disallow | /*?done |
| Disallow | /discuss/* |
| Disallow | /actors/* |
| Disallow | /countries/* |
| Disallow | /directors/* |
| Disallow | /years/* |
| Disallow | /genres/* |
| Disallow | /m/* |
| Disallow | /mobile/* |
| Disallow | /movie/prestupnik-offender-2012/ |
| Disallow | /404/ |
Warnings
- `host` is not a known field.