cp24.com
robots.txt
Robots Exclusion Standard data for cp24.com
Resource Scan
Scan Details
| Site Domain | cp24.com |
| Base Domain | cp24.com |
| Scan Status | Ok |
| Last Scan | 2024-06-07T02:17:33+00:00 |
| Next Scan | 2024-06-14T02:17:33+00:00 |
Last Scan
| Scanned | 2024-06-07T02:17:33+00:00 |
| URL | https://cp24.com/robots.txt |
| Redirect | https://www.cp24.com/robots.txt |
| Redirect Domain | www.cp24.com |
| Redirect Base | cp24.com |
| Domain IPs | 104.69.167.54 |
| Redirect IPs | 173.223.85.247 |
| Response IP | 173.223.85.247 |
| Found | Yes |
| Hash | 11a60fed51f787bc09dcb1f0f8a9f5ea1801f81faabd2a8888495d232e20e081 |
| SimHash | cc24ce1983d1 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /search-results/ |
| Disallow | /poll/ |
| Disallow | /logger/ |
| Disallow | /cmlink/ |
| Disallow | /cm/ |
| Disallow | /error/ |
| Disallow | /errorpages/ |
| Disallow | /content/ |
| Disallow | /captcha/ |
| Disallow | /membership/ |
| Disallow | /blogimageupload/ |
| Disallow | /polopolydevelopment/ |
| Disallow | /status/ |
| Disallow | /redirect/ |
| Disallow | /crossdomain.xml |
| Disallow | /flagcomment/ |
| Disallow | /comments-7.* |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.cp24.com/sitemap_news.xml |
| sitemap | http://www.cp24.com/sitemap.xml |
| sitemap | http://www.cp24.com/sitemap_mobile.xml |