desertcart.dev
robots.txt
Robots Exclusion Standard data for desertcart.dev
Resource Scan
Scan Details
| Site Domain | desertcart.dev |
| Base Domain | desertcart.dev |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a server error. |
| Last Scan | 2025-12-14T15:03:35+00:00 |
| Next Scan | 2026-03-14T15:03:35+00:00 |
Last Successful Scan
| Scanned | 2025-05-11T23:54:45+00:00 |
| URL | https://desertcart.dev/robots.txt |
| Redirect | https://www.desertcart.ae/robots.txt |
| Redirect Domain | www.desertcart.ae |
| Redirect Base | desertcart.ae |
| Domain IPs | 104.21.3.112, 172.67.130.165, 2606:4700:3034::6815:370, 2606:4700:3034::ac43:82a5 |
| Redirect IPs | 104.26.10.226, 104.26.11.226, 172.67.72.69 |
| Response IP | 104.26.10.226 |
| Found | Yes |
| Hash | 830c71059a8836f55ee70ad13e6e4c7e6d0d148ec522fbff34e256128f009480 |
| SimHash | 4915d4266892 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /searchv1 |
| Disallow | /searchv2 |
| Disallow | /a/ |
| Disallow | /invite/ |
| Disallow | /api/ |
| Disallow | /*?action= |
| Disallow | /*?query= |
| Disallow | /%5BcC%5Dart$ |
| Disallow | /cart%5BaA%5Dction |
| Disallow | /store/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.desertcart.ae/sitemaps/ae/sitemap-index.xml.gz |