desertcart.com.py
robots.txt

Robots Exclusion Standard data for desertcart.com.py

Resource Scan

Scan Details

Site Domain desertcart.com.py
Base Domain desertcart.com.py
Scan Status Ok
Last Scan2025-08-31T18:08:33+00:00
Next Scan 2025-09-14T18:08:33+00:00

Last Scan

Scanned2025-08-31T18:08:33+00:00
URL https://desertcart.com.py/robots.txt
Redirect https://www.desertcart.com.py/robots.txt
Redirect Domain www.desertcart.com.py
Redirect Base desertcart.com.py
Domain IPs 104.21.17.45, 172.67.222.6, 2606:4700:3031::ac43:de06, 2606:4700:3033::6815:112d
Redirect IPs 104.21.17.45, 172.67.222.6, 2606:4700:3031::ac43:de06, 2606:4700:3033::6815:112d
Response IP 172.67.222.6
Found Yes
Hash d6131cc0af53eccb049ad0b95b23090c25ec9f0a9c80e925efcb7a936b6ea70c
SimHash 5515d4346892

Groups

*

Rule Path
Disallow /searchv1
Disallow /searchv2
Disallow /a/
Disallow /invite/
Disallow /api/
Disallow /*?action=
Disallow /*?query=
Disallow /%5BcC%5Dart$
Disallow /cart%5BaA%5Dction
Disallow /store/
Disallow /search?query=

semrushbot
petalbot
ahrefsbot
dotbot
neevabot
seekportbot
fr_bot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /products/
Disallow /tags/
Disallow /nodes/

yandexbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /tags/

Other Records

Field Value
sitemap https://www.desertcart.com.py/sitemaps/py/sitemap-index.xml.gz