desertcart.fr
robots.txt

Robots Exclusion Standard data for desertcart.fr

Resource Scan

Scan Details

Site Domain desertcart.fr
Base Domain desertcart.fr
Scan Status Ok
Last Scan5/27/2025, 1:43:24 PM
Next Scan 6/10/2025, 1:43:24 PM

Last Scan

Scanned5/27/2025, 1:43:24 PM
URL https://desertcart.fr/robots.txt
Redirect https://www.desertcart.fr/robots.txt
Redirect Domain www.desertcart.fr
Redirect Base desertcart.fr
Domain IPs 104.21.35.151, 172.67.176.253, 2606:4700:3032::6815:2397, 2606:4700:3037::ac43:b0fd
Redirect IPs 104.21.35.151, 172.67.176.253, 2606:4700:3032::6815:2397, 2606:4700:3037::ac43:b0fd
Response IP 172.67.176.253
Found Yes
Hash 1a3715cd9a4cb98049aad8ec6de34d1b5552eac8d49cafe54df14d361ebab799
SimHash 491594266892

Groups

*

Rule Path
Disallow /searchv1
Disallow /searchv2
Disallow /a/
Disallow /invite/
Disallow /api/
Disallow /*?action=
Disallow /*?query=
Disallow /%5BcC%5Dart$
Disallow /cart%5BaA%5Dction
Disallow /store/

semrushbot
petalbot
ahrefsbot
dotbot
neevabot
seekportbot
fr_bot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /products/
Disallow /tags/
Disallow /nodes/

yandexbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /tags/

Other Records

Field Value
sitemap https://www.desertcart.fr/sitemaps/fr/sitemap-index.xml.gz