french.imdb.com
robots.txt
Robots Exclusion Standard data for french.imdb.com
Resource Scan
Scan Details
Site Domain | french.imdb.com |
Base Domain | imdb.com |
Scan Status | Ok |
Last Scan | 2024-11-15T07:19:24+00:00 |
Next Scan | 2024-11-22T07:19:24+00:00 |
Last Scan
Scanned | 2024-11-15T07:19:24+00:00 |
URL | http://french.imdb.com/robots.txt |
Redirect | https://www.imdb.com/robots.txt |
Redirect Domain | www.imdb.com |
Redirect Base | imdb.com |
Domain IPs | 72.21.210.29 |
Redirect IPs | 13.33.79.214 |
Response IP | 13.33.79.214 |
Found | Yes |
Hash | 6f65639989ba1e0d0c29cc673313909b0a6c08afc5041b8798b3042127a8a1bf |
SimHash | c536b9055cbc |
Groups
*
Rule | Path |
---|---|
Disallow | /OnThisDay |
Disallow | /ads/ |
Disallow | /ap/ |
Disallow | /mymovies/ |
Disallow | /r/ |
Disallow | /register |
Disallow | /registration/ |
Disallow | /search/name-text |
Disallow | /search/title-text |
Disallow | /find |
Disallow | /find$ |
Disallow | /find/ |
Disallow | /tvschedule |
Disallow | /updates |
Disallow | /watch/_ajax/option |
Disallow | /_json/video/mon |
Disallow | /_json/getAdsForMediaViewer/ |
Disallow | /list/ls*/_ajax |
Disallow | /list/ls*/export |
Disallow | /*/*/rg*/mediaviewer/rm*/tr |
Disallow | /*/rg*/mediaviewer/rm*/tr |
Disallow | /*/mediaviewer/*/tr |
Disallow | /title/tt*/mediaviewer/rm*/tr |
Disallow | /name/nm*/mediaviewer/rm*/tr |
Disallow | /gallery/rg*/mediaviewer/rm*/tr |
Disallow | /tr/ |
Disallow | /title/tt*/watchoptions |
Disallow | /search/title/?title_type=feature%2Ctv_movie%2Ctv_miniseries%2Cdocumentary%2Cshort%2Cvideo%2Ctv_short&release_date=%2C2020-12-31&lists=%21ls538187658%2C%21ls539867036%2C%21ls538186228&view=simple&sort=num_votes%2Casc&aft |
Disallow | /name/nm*/filmotype/* |
Disallow | /user/ur*/ratings |
Disallow | /user/ur*/checkins |
Disallow | /_json/* |
Comments