ui.crackedcdn.com
robots.txt
Robots Exclusion Standard data for ui.crackedcdn.com
Resource Scan
Scan Details
Site Domain | ui.crackedcdn.com |
Base Domain | crackedcdn.com |
Scan Status | Ok |
Last Scan | 2024-06-24T14:14:36+00:00 |
Next Scan | 2024-07-01T14:14:36+00:00 |
Last Scan
Scanned | 2024-06-24T14:14:36+00:00 |
URL | https://ui.crackedcdn.com/robots.txt |
Domain IPs | 2600:9000:2024:2800:1c:a680:b200:93a1, 2600:9000:2024:2e00:1c:a680:b200:93a1, 2600:9000:2024:3c00:1c:a680:b200:93a1, 2600:9000:2024:4200:1c:a680:b200:93a1, 2600:9000:2024:4800:1c:a680:b200:93a1, 2600:9000:2024:600:1c:a680:b200:93a1, 2600:9000:2024:a600:1c:a680:b200:93a1, 2600:9000:2024:ee00:1c:a680:b200:93a1, 65.9.112.30, 65.9.112.37, 65.9.112.5, 65.9.112.94 |
Response IP | 18.165.171.53 |
Found | Yes |
Hash | 188d4886acf61fa4277e93296c05d54f866f1dd297f0a8da5c9b6fb0120c9877 |
SimHash | b9c05448e990 |
Groups
*
Rule | Path |
---|---|
Disallow | /craptions/archive/ |
Disallow | /craptions/category/ |
Disallow | /search/ |
Disallow | /forums/ |
Disallow | /movies/*_quotes/ |
Disallow | /movies/*_clips-*/ |
Disallow | /gallery/ |
Disallow | /single/ |
Other Records
Field | Value |
---|---|
sitemap | http://www.cracked.com/sitemap.xml |