shopit.co.ke
robots.txt

Robots Exclusion Standard data for shopit.co.ke

Resource Scan

Scan Details

Site Domain shopit.co.ke
Base Domain shopit.co.ke
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-20T05:21:19+00:00
Next Scan 2024-11-18T05:21:19+00:00

Last Successful Scan

Scanned2024-01-01T05:17:33+00:00
URL https://shopit.co.ke/robots.txt
Domain IPs 104.26.4.196, 104.26.5.196, 172.67.70.208, 2606:4700:20::681a:4c4, 2606:4700:20::681a:5c4, 2606:4700:20::ac43:46d0
Response IP 172.67.70.208
Found Yes
Hash ff5a6102b60c0816da94b688048133f67abd3c5741d478e6f36251746138c3ea
SimHash 8d045e45c4d3

Groups

*

Rule Path
Disallow /app/
Disallow /store_closed.html
Disallow /page-*/

Other Records

Field Value
sitemap https://shopit.co.ke/sitemap.xml