moviepilot.de
robots.txt
Robots Exclusion Standard data for moviepilot.de
Resource Scan
Scan Details
Site Domain | moviepilot.de |
Base Domain | moviepilot.de |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-08-30T08:05:25+00:00 |
Next Scan | 2024-10-29T08:05:25+00:00 |
Last Successful Scan
Scanned | 2024-07-02T07:39:40+00:00 |
URL | https://moviepilot.de/robots.txt |
Redirect | http://www.moviepilot.de/robots.txt |
Redirect Domain | www.moviepilot.de |
Redirect Base | moviepilot.de |
Domain IPs | 144.76.229.20 |
Redirect IPs | 104.18.33.103, 172.64.154.153 |
Response IP | 172.64.154.153 |
Found | Yes |
Hash | d17b8ed8d1c3c66b85230df77a44262ab2bccbbd6dfc34056bf11561cdc61aac |
SimHash | 782d1ca1fdd6 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin/* |
Disallow | /comments* |
Disallow | /movies/*/rating |
Disallow | /movies/*/sidebar_watch.partial |
Disallow | /movies/*/administration |
Disallow | /movies/*/kinoprogramm/*/*/*/* |
Disallow | /movies/*/comments/ |
Disallow | /people/*/followships |
Disallow | /people/*/comments/ |
Disallow | /people/*/assets/ |
Disallow | /serie/*/rating |
Disallow | /serie/*/kritik/ |
Disallow | /serie/*/staffel/*/kritik/ |
Disallow | /kino/*/*/*/*/kinoprogramm |
Disallow | /kino/kinoprogramm/*/*/*/* |
Disallow | /kinoprogramm/kino/*/add_favourite |
Disallow | */subscriptions/* |
Disallow | */diggs* |
Disallow | /myprofile |
Disallow | /amazon_search/* |
Disallow | /itunes_search/* |
Disallow | /*?play=true$ |
Disallow | /*?reset_city=1 |
Disallow | /myprofile |
Disallow | /archive/stars/character/* |
Disallow | /lists/* |
Disallow | /news/newsletter |
Disallow | /news/*/comments/ |
Disallow | /suche |
Disallow | /tv/fernsehprogramm/ |
Disallow | /broadcasts/ |
Disallow | /liste/*/comments/ |
Disallow | /streaming/*/*/* |
Disallow | /missing_headers.csv |
Disallow | /remote_headers.csv |
Disallow | /failed_header_checks.csv |