animew.ru
robots.txt
Robots Exclusion Standard data for animew.ru
Resource Scan
Scan Details
| Site Domain | animew.ru |
| Base Domain | animew.ru |
| Scan Status | Ok |
| Last Scan | 2024-11-05T01:53:17+00:00 |
| Next Scan | 2024-11-12T01:53:17+00:00 |
Last Scan
| Scanned | 2024-11-05T01:53:17+00:00 |
| URL | https://animew.ru/robots.txt |
| Domain IPs | 91.194.2.68 |
| Response IP | 91.194.2.68 |
| Found | Yes |
| Hash | b4e6bc7e6b535482d215c8b5009e8d11c8b863c4123a512046b286d81bd42b16 |
| SimHash | 47546ee2cd91 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /video/new |
| Disallow | /video/trending |
| Disallow | /video/view |
| Disallow | /video/search |
| Disallow | /upload |
| Disallow | /embed |
| Disallow | /stargate |
| Disallow | /thread/fave |
| Disallow | /radio/all |
| Disallow | /?crossauth |
| Disallow | /*?*hash= |
| Disallow | /? |
| Disallow | /*/fresh |
| Disallow | /*/discussions |
| Disallow | /*/top$ |
| Disallow | /*.m3u$ |
| Disallow | /*.vlc$ |
| Disallow | /*/tag/ |
| Disallow | /ajax/ |
| Disallow | /*rss.xml$ |
| Disallow | /video/*?* |
| Disallow | /series/*?section=* |
| Disallow | /movie/*?section=* |
| Disallow | /anime/*?section=* |
| Disallow | /resource/thread.php |
Other Records
| Field | Value |
|---|---|
| sitemap | https://animew.ru/resource/sitemap/index-anime.xml |
Warnings
- `host` is not a known field.