secure.cracked.com
robots.txt

Robots Exclusion Standard data for secure.cracked.com

Resource Scan

Scan Details

Site Domain secure.cracked.com
Base Domain cracked.com
Scan Status Ok
Last Scan2024-09-23T12:40:18+00:00
Next Scan 2024-09-30T12:40:18+00:00

Last Scan

Scanned2024-09-23T12:40:18+00:00
URL https://secure.cracked.com/robots.txt
Redirect https://www.cracked.com/robots.txt
Redirect Domain www.cracked.com
Redirect Base cracked.com
Domain IPs 108.157.254.11, 108.157.254.124, 108.157.254.52, 108.157.254.96
Redirect IPs 13.33.183.108, 13.33.183.115, 13.33.183.24, 13.33.183.87, 2600:9000:2753:1c00:1d:5708:e1c0:93a1, 2600:9000:2753:2a00:1d:5708:e1c0:93a1, 2600:9000:2753:4e00:1d:5708:e1c0:93a1, 2600:9000:2753:5400:1d:5708:e1c0:93a1, 2600:9000:2753:5800:1d:5708:e1c0:93a1, 2600:9000:2753:5c00:1d:5708:e1c0:93a1, 2600:9000:2753:8a00:1d:5708:e1c0:93a1, 2600:9000:2753:fa00:1d:5708:e1c0:93a1
Response IP 108.157.254.52
Found Yes
Hash 188d4886acf61fa4277e93296c05d54f866f1dd297f0a8da5c9b6fb0120c9877
SimHash b9c05448e990

Groups

*

Rule Path
Disallow /craptions/archive/
Disallow /craptions/category/
Disallow /search/
Disallow /forums/
Disallow /movies/*_quotes/
Disallow /movies/*_clips-*/
Disallow /gallery/
Disallow /single/

yacy

Rule Path
Disallow /search/*

java

Rule Path
Disallow /search/*

Other Records

Field Value
sitemap http://www.cracked.com/sitemap.xml