opensubtitles.org
robots.txt
Robots Exclusion Standard data for opensubtitles.org
Resource Scan
Scan Details
| Site Domain | opensubtitles.org |
| Base Domain | opensubtitles.org |
| Scan Status | Ok |
| Last Scan | 2024-11-08T14:10:57+00:00 |
| Next Scan | 2024-11-15T14:10:57+00:00 |
Last Scan
| Scanned | 2024-11-08T14:10:57+00:00 |
| URL | https://opensubtitles.org/robots.txt |
| Domain IPs | 104.21.14.73, 172.67.158.44, 2606:4700:3030::6815:e49, 2606:4700:3036::ac43:9e2c |
| Response IP | 172.67.158.44 |
| Found | Yes |
| Hash | 862a6a89fb8ab7a7ba71b0e40ec3450e54890905e517c27b6f6998a8729cb7cf |
| SimHash | 5d0d1b1c3dd4 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /libs/ |
| Allow | /libs/js/ |
| Disallow | /addons/ |
| Disallow | /redirect/ |
| Disallow | /*/download/ |
| Disallow | /*/report/ |
| Disallow | /*/profile/ |
| Disallow | /*/login/ |
| Disallow | /*/setlang- |
| Disallow | /*/subpreview |
| Disallow | /*/subtitleserve |
| Disallow | /*/fixinput-on |
| Disallow | /*/short-on |
| Disallow | /*/subsumcd- |
| Disallow | /*/moviefps- |
| Disallow | /*/subformat- |
| Disallow | /*/uploader- |
| Disallow | /*/subadddate- |
| Disallow | /*/subdate- |
| Disallow | /*/iduser- |
| Disallow | /*/subaddunixdate- |
| Disallow | /*/subcomments- |
| Disallow | /*/movieyear- |
| Disallow | /*/movieimdbrating- |
| Disallow | /*/hearingimpaired- |
| Disallow | /*/hd- |
| Disallow | /*/autotranslation- |
| Disallow | /*/subtrusted- |
| Disallow | /*/subfeatured- |
| Disallow | /*/subbad- |
| Disallow | /*/subjectid- |
| Disallow | /*/genre- |
| Disallow | /*/movielanguage- |
| Disallow | /*/moviecountry- |
| Disallow | /*/sort- |
| Disallow | /*/frre- |
| Disallow | /*/msg- |
| Disallow | /*/multisearch |
| Disallow | /*/upload/idmovieimdb- |
| Disallow | /*/rss_0_91 |
| Disallow | /*/rss_1_00 |
| Disallow | /*/atom_0_30 |
| Disallow | /*/atom_1_00 |
| Disallow | /*/xml |
| Disallow | /*/simplexml |
| Disallow |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.opensubtitles.org/sitemap.xml |