desertcart.hr
robots.txt

Robots Exclusion Standard data for desertcart.hr

Resource Scan

Scan Details

Site Domain desertcart.hr
Base Domain desertcart.hr
Scan Status Ok
Last Scan2025-03-31T03:06:25+00:00
Next Scan 2025-04-14T03:06:25+00:00

Last Scan

Scanned2025-03-31T03:06:25+00:00
URL https://desertcart.hr/robots.txt
Redirect https://www.desertcart.hr/robots.txt
Redirect Domain www.desertcart.hr
Redirect Base desertcart.hr
Domain IPs 104.21.10.20, 172.67.162.32, 2606:4700:3035::6815:a14, 2606:4700:3035::ac43:a220
Redirect IPs 104.21.10.20, 172.67.162.32, 2606:4700:3035::6815:a14, 2606:4700:3035::ac43:a220
Response IP 104.21.10.20
Found Yes
Hash c9cfc4dd77b9e294b3a7ae5cd23d78cdb038a8054f4e0c8ab0e32b85a2d3f4f1
SimHash 4915d4366892

Groups

*

Rule Path
Disallow /searchv1
Disallow /searchv2
Disallow /a/
Disallow /invite/
Disallow /api/
Disallow /*?action=
Disallow /*?query=
Disallow /%5BcC%5Dart$
Disallow /cart%5BaA%5Dction
Disallow /store/

semrushbot
petalbot
ahrefsbot
dotbot
neevabot
seekportbot
fr_bot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /products/
Disallow /tags/
Disallow /nodes/

yandexbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /tags/

Other Records

Field Value
sitemap https://www.www.desertcart.hr/sitemaps/hr/sitemap-index.xml.gz