Log In Sign Up

desertcart.ro
robots.txt

Robots Exclusion Standard data for desertcart.ro

Resource Scan

Scan Details

Site Domain desertcart.ro
Base Domain desertcart.ro
Scan Status Ok
Last Scan5/25/2025, 10:29:04 PM
Next Scan 6/8/2025, 10:29:04 PM

Last Scan

Scanned5/25/2025, 10:29:04 PM
URL https://desertcart.ro/robots.txt
Redirect https://www.desertcart.ro/robots.txt
Redirect Domain www.desertcart.ro
Redirect Base desertcart.ro
Domain IPs 104.21.73.199, 172.67.165.206, 2606:4700:3034::ac43:a5ce, 2606:4700:3036::6815:49c7
Redirect IPs 104.21.73.199, 172.67.165.206, 2606:4700:3034::ac43:a5ce, 2606:4700:3036::6815:49c7
Response IP 104.21.73.199
Found Yes
Hash d104f8570138c0739b62419cee5415552de7b90bcf20316746ec0ade00e60111
SimHash 4915d43e6892

Groups

*

Rule Path
Disallow /searchv1
Disallow /searchv2
Disallow /a/
Disallow /invite/
Disallow /api/
Disallow /*?action=
Disallow /*?query=
Disallow /%5BcC%5Dart$
Disallow /cart%5BaA%5Dction
Disallow /store/

semrushbot
petalbot
ahrefsbot
dotbot
neevabot
seekportbot
fr_bot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /products/
Disallow /tags/
Disallow /nodes/

yandexbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /tags/
Back to top

Other Records

Field Value
sitemap https://www.desertcart.ro/sitemaps/ro/sitemap-index.xml.gz
Back to top