filmotok.ru
robots.txt
Robots Exclusion Standard data for filmotok.ru
Resource Scan
Scan Details
Site Domain | filmotok.ru |
Base Domain | filmotok.ru |
Scan Status | Ok |
Last Scan | 2024-11-05T08:02:04+00:00 |
Next Scan | 2024-11-12T08:02:04+00:00 |
Last Scan
Scanned | 2024-11-05T08:02:04+00:00 |
URL | https://filmotok.ru/robots.txt |
Domain IPs | 104.21.36.167, 172.67.197.151, 2606:4700:3036::ac43:c597, 2606:4700:3037::6815:24a7 |
Response IP | 104.21.36.167 |
Found | Yes |
Hash | c57dc8d5cf7b0285596181d5dc9c154c9777537a586777956ec8df38890ddfd4 |
SimHash | 60072a7088bb |
Groups
*
Rule | Path |
---|---|
Disallow | /tags/ |
Disallow | */print%3Apage* |
Disallow | /print%3Apage* |
Disallow | /index.php |
Disallow | /*rss.xml |
Disallow | /index.php?do=search |
Disallow | /*do%3Dsearch |
Disallow | /index.php?do=rules |
Disallow | /admin.php |
Disallow | /*do%3Dpm |
Disallow | /*do%3Dregister |
Disallow | /*do%3Daddnews |
Disallow | /*do%3Dfeedback |
Disallow | /*do%3Dlostpassword |
Disallow | /*do%3Dstats |
Disallow | /catalog/* |
Disallow | /newposts/ |
Disallow | /favorites/ |
Disallow | /statistics.html |
Disallow | /*subaction%3Duserinfo |
Disallow | /*subaction%3Dnewposts |
Disallow | /*do%3Dlastcomments |
Disallow | /*do%3Dlastnews |
Disallow | /language/ |
Disallow | /backup/ |
Disallow | /tmp/ |
Disallow | /addnews.html |
Disallow | /user/ |
Disallow | /upgrade/ |
Disallow | /cgi-bin/ |
Disallow | /upload/ |
Disallow | /cache/ |
Disallow | /page/ |
Disallow | /*page/ |
Disallow | /page/* |
Disallow | /page* |
Disallow | /2009/* |
Disallow | /2010/* |
Disallow | /2011/* |
Disallow | /2012/* |
Disallow | /2013/* |
Disallow | /2014/* |
Disallow | /2015/* |
Disallow | /2016/* |
Disallow | /2017/* |
Disallow | /2018/* |
Disallow | /2019/* |
Disallow | /2020/* |
Disallow | /2021/* |
Disallow | /2022/* |
Disallow | /2023/* |
Disallow | /2024/* |
Disallow | /2025/* |
Disallow | /2026/* |
Disallow | /2027/* |
Disallow | /2028/* |
Disallow | /2029/* |
Disallow | /engine/go.php |
Disallow | /engine/download.php |
Disallow | /engine/out.php |
Disallow | /engine/redirect.php |
Disallow | /engine/reklama.php |
Disallow | /fl2/* |
Disallow | /fl2/dl.php |
Disallow | /engine/ |
Disallow | /search-torrents/* |
Disallow | /xfsearch/* |
Disallow | /kr.php |
Disallow | /orbitum.php |
Disallow | /film-onlin.php |
Disallow | /mediaget.php |
Disallow | /vulkan.php |
Disallow | /ext.php |
Disallow | /admitad.php |
Disallow | /gobrowoffergate.php |
Disallow | /vkontaktedj.php |
Disallow | /cryptofarmer.php |
Allow | /sitemap.xml |
Disallow | /00-pugalo.html |
Disallow | /?ref=xranks |
Other Records
Field | Value |
---|---|
crawl-delay | 0 |
Other Records
Field | Value |
---|---|
sitemap | https://torspeed1.filmotok.ru/sitemap.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.
Comments