filmpro.ru
robots.txt
Robots Exclusion Standard data for filmpro.ru
Resource Scan
Scan Details
| Site Domain | filmpro.ru |
| Base Domain | filmpro.ru |
| Scan Status | Ok |
| Last Scan | 2024-11-10T23:38:15+00:00 |
| Next Scan | 2024-11-17T23:38:15+00:00 |
Last Scan
| Scanned | 2024-11-10T23:38:15+00:00 |
| URL | https://filmpro.ru/robots.txt |
| Redirect | https://www.filmpro.ru/robots.txt |
| Redirect Domain | www.filmpro.ru |
| Redirect Base | filmpro.ru |
| Domain IPs | 80.247.33.214 |
| Redirect IPs | 80.247.33.214 |
| Response IP | 80.247.33.214 |
| Found | Yes |
| Hash | 3939ed030ac3bdd7c215706ee985cd5ec1a0390b748f313965e976aadb45c3ce |
| SimHash | e114ca51c637 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*? |
| Disallow | /*feed |
| Disallow | *?form=club |
| Disallow | *utm_ |
| Disallow | /search? |
| Disallow | */% |
| Disallow | */materials_list |
| Disallow | */related_movies_list |
| Disallow | */videos_list |
| Disallow | */selections_list |
| Disallow | *b1.filmpro.ru |
| Disallow | /series/top_list |
| Disallow | /club/* |
| Allow | /*.css?v=* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.filmpro.ru/sitemap.xml |
Warnings
- `host` is not a known field.
- `request-rate` is not a known field.