m.imdb.com
robots.txt
Robots Exclusion Standard data for m.imdb.com
Resource Scan
Scan Details
Site Domain | m.imdb.com |
Base Domain | imdb.com |
Scan Status | Ok |
Last Scan | 2024-11-15T21:44:41+00:00 |
Next Scan | 2024-11-29T21:44:41+00:00 |
Last Scan
Scanned | 2024-11-15T21:44:41+00:00 |
URL | https://m.imdb.com/robots.txt |
Domain IPs | 3.165.83.219 |
Response IP | 3.165.83.219 |
Found | Yes |
Hash | 968265952f8979886d9aa7e5fa39150ed80d335b2cc747630233a94bb395dcde |
SimHash | 03f2e91e8cb8 |
Groups
*
Rule | Path |
---|---|
Disallow | /ads/ |
Disallow | /ap/ |
Disallow | /find$ |
Disallow | /find/ |
Disallow | /registration/ |
Disallow | /watch/_ajax/option |
Disallow | /_json/ |
Disallow | /title/json/ |
Disallow | /name/json/ |
Disallow | /tr/ |
Disallow | /*/*/rg*/mediaviewer/rm*/tr |
Disallow | /*/rg*/mediaviewer/rm*/tr |
Disallow | /title/tt*/mediaviewer/rm*/tr |
Disallow | /gallery/rg*/mediaviewer/rm*/tr |
Disallow | /name/nm*/mediaviewer/rm*/tr |
Disallow | /*/mediaviewer/*/tr |
Disallow | /title/tt*/watchoptions |
Disallow | /list/ls*/export |
Disallow | /user/ur*/ratings |
Disallow | /user/ur*/checkins |
Disallow | /_json/* |
Comments