imdb.com
robots.txt
Robots Exclusion Standard data for imdb.com
Resource Scan
Scan Details
| Site Domain | imdb.com |
| Base Domain | imdb.com |
| Scan Status | Ok |
| Last Scan | 2024-04-30T14:39:22+00:00 |
| Next Scan | 2024-05-07T14:39:22+00:00 |
Last Scan
| Scanned | 2024-04-30T14:39:22+00:00 |
| URL | https://imdb.com/robots.txt |
| Redirect | https://www.imdb.com/robots.txt |
| Redirect Domain | www.imdb.com |
| Redirect Base | imdb.com |
| Domain IPs | 52.94.225.248, 52.94.228.167, 52.94.237.74 |
| Redirect IPs | 13.33.91.234 |
| Response IP | 13.33.91.234 |
| Found | Yes |
| Hash | 6f65639989ba1e0d0c29cc673313909b0a6c08afc5041b8798b3042127a8a1bf |
| SimHash | c536b9055cbc |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /OnThisDay |
| Disallow | /ads/ |
| Disallow | /ap/ |
| Disallow | /mymovies/ |
| Disallow | /r/ |
| Disallow | /register |
| Disallow | /registration/ |
| Disallow | /search/name-text |
| Disallow | /search/title-text |
| Disallow | /find |
| Disallow | /find$ |
| Disallow | /find/ |
| Disallow | /tvschedule |
| Disallow | /updates |
| Disallow | /watch/_ajax/option |
| Disallow | /_json/video/mon |
| Disallow | /_json/getAdsForMediaViewer/ |
| Disallow | /list/ls*/_ajax |
| Disallow | /list/ls*/export |
| Disallow | /*/*/rg*/mediaviewer/rm*/tr |
| Disallow | /*/rg*/mediaviewer/rm*/tr |
| Disallow | /*/mediaviewer/*/tr |
| Disallow | /title/tt*/mediaviewer/rm*/tr |
| Disallow | /name/nm*/mediaviewer/rm*/tr |
| Disallow | /gallery/rg*/mediaviewer/rm*/tr |
| Disallow | /tr/ |
| Disallow | /title/tt*/watchoptions |
| Disallow | /search/title/?title_type=feature%2Ctv_movie%2Ctv_miniseries%2Cdocumentary%2Cshort%2Cvideo%2Ctv_short&release_date=%2C2020-12-31&lists=%21ls538187658%2C%21ls539867036%2C%21ls538186228&view=simple&sort=num_votes%2Casc&aft |
| Disallow | /name/nm*/filmotype/* |
| Disallow | /user/ur*/ratings |
| Disallow | /user/ur*/checkins |
| Disallow | /_json/* |
Comments