gem-awards.com
robots.txt
Robots Exclusion Standard data for gem-awards.com
Resource Scan
Scan Details
| Site Domain | gem-awards.com |
| Base Domain | gem-awards.com |
| Scan Status | Ok |
| Last Scan | 2026-02-22T04:48:46+00:00 |
| Next Scan | 2026-03-24T04:48:46+00:00 |
Last Scan
| Scanned | 2026-02-22T04:48:46+00:00 |
| URL | https://gem-awards.com/robots.txt |
| Domain IPs | 104.21.62.89, 172.67.222.39, 2606:4700:3036::6815:3e59, 2606:4700:3036::ac43:de27 |
| Response IP | 104.21.62.89 |
| Found | Yes |
| Hash | d8db9f12bb2a7aa6ca6f24bc4f427d6a4e1f08b5c3ee3b6db9a4018981e39bca |
| SimHash | 08197410d740 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /api/ |
| Disallow | /profile/ |
| Disallow | /login/ |
| Disallow | /es/feria |
| Disallow | /es/gala |
| Disallow | /en/feria |
| Disallow | /en/gala |
| Disallow | /feria |
| Disallow | /gala |
| Disallow | /es/how-to-arrive |
| Disallow | /en/how-to-arrive |
| Disallow | /how-to-arrive |
| Disallow | /es/contest |
| Disallow | /en/contest |
| Disallow | /contest |
| Disallow | /es/nominados |
| Disallow | /en/nominados |
| Disallow | /nominados |
| Disallow | /es/event |
| Disallow | /en/event |
| Disallow | /event |
Other Records
| Field | Value |
|---|---|
| sitemap | https://gem-awards.com/sitemap.xml |