french.imdb.com
robots.txt

Robots Exclusion Standard data for french.imdb.com

Resource Scan

Scan Details

Site Domain french.imdb.com
Base Domain imdb.com
Scan Status Ok
Last Scan2024-11-15T07:19:24+00:00
Next Scan 2024-11-22T07:19:24+00:00

Last Scan

Scanned2024-11-15T07:19:24+00:00
URL http://french.imdb.com/robots.txt
Redirect https://www.imdb.com/robots.txt
Redirect Domain www.imdb.com
Redirect Base imdb.com
Domain IPs 72.21.210.29
Redirect IPs 13.33.79.214
Response IP 13.33.79.214
Found Yes
Hash 6f65639989ba1e0d0c29cc673313909b0a6c08afc5041b8798b3042127a8a1bf
SimHash c536b9055cbc

Groups

*

Rule Path
Disallow /OnThisDay
Disallow /ads/
Disallow /ap/
Disallow /mymovies/
Disallow /r/
Disallow /register
Disallow /registration/
Disallow /search/name-text
Disallow /search/title-text
Disallow /find
Disallow /find$
Disallow /find/
Disallow /tvschedule
Disallow /updates
Disallow /watch/_ajax/option
Disallow /_json/video/mon
Disallow /_json/getAdsForMediaViewer/
Disallow /list/ls*/_ajax
Disallow /list/ls*/export
Disallow /*/*/rg*/mediaviewer/rm*/tr
Disallow /*/rg*/mediaviewer/rm*/tr
Disallow /*/mediaviewer/*/tr
Disallow /title/tt*/mediaviewer/rm*/tr
Disallow /name/nm*/mediaviewer/rm*/tr
Disallow /gallery/rg*/mediaviewer/rm*/tr
Disallow /tr/
Disallow /title/tt*/watchoptions
Disallow /search/title/?title_type=feature%2Ctv_movie%2Ctv_miniseries%2Cdocumentary%2Cshort%2Cvideo%2Ctv_short&release_date=%2C2020-12-31&lists=%21ls538187658%2C%21ls539867036%2C%21ls538186228&view=simple&sort=num_votes%2Casc&aft
Disallow /name/nm*/filmotype/*
Disallow /user/ur*/ratings
Disallow /user/ur*/checkins
Disallow /_json/*

baiduspider

Rule Path
Disallow /list/*
Disallow /user/*

bingbot

Rule Path
Disallow /showtimes/location/*

Comments

  • robots.txt for https://www.imdb.com properties