ctm.co.ke
robots.txt
Robots Exclusion Standard data for ctm.co.ke
Resource Scan
Scan Details
| Site Domain | ctm.co.ke |
| Base Domain | ctm.co.ke |
| Scan Status | Ok |
| Last Scan | 2024-09-22T03:12:40+00:00 |
| Next Scan | 2024-10-06T03:12:40+00:00 |
Last Scan
| Scanned | 2024-09-22T03:12:40+00:00 |
| URL | https://ctm.co.ke/robots.txt |
| Redirect | https://www.ctm.co.ke/robots.txt |
| Redirect Domain | www.ctm.co.ke |
| Redirect Base | ctm.co.ke |
| Domain IPs | 178.79.178.218, 2a01:7e00:e000:3f7:: |
| Redirect IPs | 151.101.131.52, 151.101.195.52, 151.101.3.52, 151.101.67.52 |
| Response IP | 199.232.47.52 |
| Found | Yes |
| Hash | 2fa106b7a47031033e5cf8c9c788671b1964af7e6862853382185393b1926448 |
| SimHash | 8d3448cbc77e |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /search?q=* |
| Disallow | /*SID%3D |
| Disallow | /*?* |
| Disallow | /?*cat=* |
| Disallow | /?*price=* |
| Disallow | /?*brand_name=* |
| Disallow | /?*gender* |
| Disallow | /404* |
| Disallow | /*.php$ |
| Disallow | /admin* |
| Disallow | /api* |
| Disallow | /app* |
| Disallow | /catalog* |
| Disallow | /cgi-bin* |
| Disallow | /checkout/ |
| Disallow | /control* |
| Disallow | /COPYING.txt |
| Disallow | /cron.php |
| Disallow | /cron.sh |
| Disallow | /customer* |
| Disallow | /customize* |
| Disallow | /downloader* |
| Disallow | /error_log |
| Disallow | /errors* |
| Disallow | /includes* |
| Disallow | /index.php/ |
| Disallow | /install.php |
| Disallow | /lib* |
| Disallow | /LICENSE_AFL.txt |
| Disallow | /LICENSE.html |
| Disallow | /LICENSE.txt |
| Disallow | /magento* |
| Disallow | /media/customer* |
| Disallow | /media/downloadable* |
| Disallow | /media/email* |
| Disallow | /media/pdf-printouts* |
| Disallow | /media/sales* |
| Disallow | /newsletter* |
| Disallow | /onestepcheckout/ |
| Disallow | /pkginfo* |
| Disallow | /poll* |
| Disallow | /report* |
| Disallow | /review/ |
| Disallow | /scripts* |
| Disallow | /sendfriend/ |
| Disallow | /shell* |
| Disallow | /stats* |
| Disallow | /STATUS.txt |
| Disallow | /store_manager/ |
| Disallow | /tag/ |
| Disallow | /var* |
| Disallow | /wishlist/ |
Comments