get.art
robots.txt
Robots Exclusion Standard data for get.art
Resource Scan
Scan Details
| Site Domain | get.art |
| Base Domain | get.art |
| Scan Status | Ok |
| Last Scan | 2025-10-26T06:08:54+00:00 |
| Next Scan | 2025-11-25T06:08:54+00:00 |
Last Scan
| Scanned | 2025-10-26T06:08:54+00:00 |
| URL | https://get.art/robots.txt |
| Domain IPs | 104.21.89.247, 172.67.166.46, 2606:4700:3031::ac43:a62e, 2606:4700:3034::6815:59f7 |
| Response IP | 104.21.89.247 |
| Found | Yes |
| Hash | c52919c4dabce23d5219f04237e1098b7ceb3f218801e42f861a04be844a686f |
| SimHash | 6190ce50e62a |
Groups
dotbot
| Rule | Path |
|---|---|
| Disallow | /*cart* |
| Disallow | *?sort=* |
| Disallow | *?popup=* |
| Disallow | /en/catalog/vip |
| Disallow | /de/catalog/ |
| Disallow | /fr/catalog/ |
| Disallow | /es/catalog/ |
| Disallow | /ru/catalog/ |
| Disallow | /zh/catalog/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
*
| Rule | Path |
|---|---|
| Disallow | /*cart* |
| Disallow | *?sort=* |
| Disallow | *?popup=* |
| Disallow | /en/catalog/vip |
| Disallow | /de/catalog/ |
| Disallow | /fr/catalog/ |
| Disallow | /es/catalog/ |
| Disallow | /ru/catalog/ |
| Disallow | /zh/catalog/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://get.art/sitemap/sitemap-index.xml |
| sitemap | https://get.art/sitemap/sitemap-index.xml |