shell.co.ke
robots.txt
Robots Exclusion Standard data for shell.co.ke
Resource Scan
Scan Details
| Site Domain | shell.co.ke |
| Base Domain | shell.co.ke |
| Scan Status | Ok |
| Last Scan | 2025-10-16T00:28:16+00:00 |
| Next Scan | 2025-11-15T00:28:16+00:00 |
Last Scan
| Scanned | 2025-10-16T00:28:16+00:00 |
| URL | https://www.shell.co.ke/robots.txt |
| Domain IPs | 2600:1413:3800:57::172d:cf31, 2600:1413:3800:57::172d:cf34, 96.17.96.17, 96.17.96.22 |
| Response IP | 23.220.203.161 |
| Found | Yes |
| Hash | 6ab7bae8c54a9940494cb9ad6ff0a0456f0bea0f869391693a5d814bd16397de |
| SimHash | 22148c016912 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /error.html |
| Disallow | /error/ |
| Disallow | /external-redirects/amidala-global.html |
| Disallow | /external-redirects/amidala-global/ |
| Disallow | /external-redirects/contact-us.html |
| Disallow | /external-redirects/contact-us/ |
| Disallow | /links.html |
| Disallow | /links/ |
| Disallow | /tag-search.html |
| Disallow | /tag-search/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.shell.co.ke/.sitemap.xml |