test-pools-05.cracked.com
robots.txt

Robots Exclusion Standard data for test-pools-05.cracked.com

Resource Scan

Scan Details

Site Domain test-pools-05.cracked.com
Base Domain cracked.com
Scan Status Ok
Last Scan2024-05-20T16:22:28+00:00
Next Scan 2024-06-19T16:22:28+00:00

Last Scan

Scanned2024-05-20T16:22:28+00:00
URL http://test-pools-05.cracked.com/robots.txt
Domain IPs 3.211.42.2, 54.80.214.136
Response IP 54.80.214.136
Found Yes
Hash 188d4886acf61fa4277e93296c05d54f866f1dd297f0a8da5c9b6fb0120c9877
SimHash b9c05448e990

Groups

*

Rule Path
Disallow /craptions/archive/
Disallow /craptions/category/
Disallow /search/
Disallow /forums/
Disallow /movies/*_quotes/
Disallow /movies/*_clips-*/
Disallow /gallery/
Disallow /single/

yacy

Rule Path
Disallow /search/*

java

Rule Path
Disallow /search/*

Other Records

Field Value
sitemap http://www.cracked.com/sitemap.xml