app7.letterboxd.com
robots.txt
Robots Exclusion Standard data for app7.letterboxd.com
Resource Scan
Scan Details
Site Domain | app7.letterboxd.com |
Base Domain | letterboxd.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2024-03-07T04:48:49+00:00 |
Next Scan | 2024-06-05T04:48:49+00:00 |
Last Successful Scan
Scanned | 2023-11-09T00:56:41+00:00 |
URL | https://app7.letterboxd.com/robots.txt |
Redirect | https://letterboxd.com/robots.txt |
Redirect Domain | letterboxd.com |
Redirect Base | letterboxd.com |
Domain IPs | 107.182.233.169, 2606:2e00:0:9d::5 |
Redirect IPs | 104.22.62.94, 104.22.63.94, 172.67.36.95, 2606:4700:10::6816:3e5e, 2606:4700:10::6816:3f5e, 2606:4700:10::ac43:245f |
Response IP | 172.67.36.95 |
Found | Yes |
Hash | 123c0fac1334f1c495ba33550327e9a21232495470c229a2424a9843de17664e |
SimHash | bdd4d10645ba |
Groups
*
Rule | Path | Comment |
---|---|---|
Disallow | /*/by/* | sorting options |
Disallow | /*/popular/this/* | popularity sorting options |
Disallow | /*/on/* | availability options |
Disallow | /*/tag/* | Members? tag lists |
Disallow | /*/genre/* | Films by genre |
Disallow | /*/country/* | Films by country |
Disallow | /*/language/* | Films by language |
Disallow | /*/decade/* | Films by decade |
Disallow | /films/year/* | Films by year |
Disallow | /films/*/year/* | Films by year |
Disallow | /films/*/size/large/* | Films with large posters (and therefore stats) |
Disallow | /*/friends/* | stuff grouped for users' friends |