Log In Sign Up

desertcart.com.kw
robots.txt

Robots Exclusion Standard data for desertcart.com.kw

Resource Scan

Scan Details

Site Domain desertcart.com.kw
Base Domain desertcart.com.kw
Scan Status Ok
Last Scan2025-03-31T01:42:52+00:00
Next Scan 2025-04-14T01:42:52+00:00

Last Scan

Scanned2025-03-31T01:42:52+00:00
URL https://desertcart.com.kw/robots.txt
Redirect https://www.desertcart.com.kw/robots.txt
Redirect Domain www.desertcart.com.kw
Redirect Base desertcart.com.kw
Domain IPs 104.21.23.8, 172.67.208.66, 2606:4700:3033::6815:1708, 2606:4700:3035::ac43:d042
Redirect IPs 104.21.23.8, 172.67.208.66, 2606:4700:3033::6815:1708, 2606:4700:3035::ac43:d042
Response IP 172.67.208.66
Found Yes
Hash dab184fe11a85a0c7e8cc37769dcd913072d22252aae09e8d40a75fffbb7951f
SimHash 4915d43e6892

Groups

*

Rule Path
Disallow /searchv1
Disallow /searchv2
Disallow /a/
Disallow /invite/
Disallow /api/
Disallow /*?action=
Disallow /*?query=
Disallow /%5BcC%5Dart$
Disallow /cart%5BaA%5Dction
Disallow /store/

semrushbot
petalbot
ahrefsbot
dotbot
neevabot
seekportbot
fr_bot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /products/
Disallow /tags/
Disallow /nodes/

yandexbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /tags/
Back to top

Other Records

Field Value
sitemap https://www.www.desertcart.com.kw/sitemaps/kw/sitemap-index.xml.gz
Back to top