goldenrace.com
robots.txt
Robots Exclusion Standard data for goldenrace.com
Resource Scan
Scan Details
| Site Domain | goldenrace.com |
| Base Domain | goldenrace.com |
| Scan Status | Ok |
| Last Scan | 2025-05-07T04:17:04+00:00 |
| Next Scan | 2025-06-06T04:17:04+00:00 |
Last Scan
| Scanned | 2025-05-07T04:17:04+00:00 |
| URL | https://goldenrace.com/robots.txt |
| Domain IPs | 63.33.9.247 |
| Response IP | 63.33.9.247 |
| Found | Yes |
| Hash | dfc94b96bab3db09eb144ff38a002bb25e1e43468bd6b77093410a93dbe8a3f6 |
| SimHash | 3a4b1a43c4bb |
Groups
googlebot
sogou
sogou spider
screaming frog seo spider
applebot
duckduckbot
yandex
yandexbot
msnbot
bingbot
twitterbot
pingdom.com bot
yandex
baiduspider
yahoo! slurp
alexa crawler
sistrix
ahrefsbot
ahrefs
mail.ru bot
| Rule | Path |
|---|---|
| Allow | *.js |
| Allow | *.css |
| Allow | *.jpeg |
| Allow | *.jpg |
| Allow | *.png |
| Allow | *.mp4 |
| Allow | *.avi |
| Allow | *.svg |
| Disallow | */update-browser |
noxtrumbot
| Rule | Path |
|---|---|
| Allow | *.js |
| Allow | *.css |
| Allow | *.jpeg |
| Allow | *.jpg |
| Allow | *.png |
| Allow | *.mp4 |
| Allow | *.avi |
| Allow | *.svg |
| Disallow | */update-browser |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 60 |
rankflex.com webspider
seokicks
seo kicks robot
cliqzbot
seokicks-robot
dotbot
| Rule | Path |
|---|---|
| Disallow | */update-browser |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1500 |
*
| Rule | Path |
|---|---|
| Disallow | */update-browser |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 600 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://goldenrace.com/sitemap.xml |
| sitemap | https://goldenrace.com/sitemap.xml |
| sitemap | https://goldenrace.com/sitemap.xml |
| sitemap | https://goldenrace.com/sitemap.xml |
| sitemap | https://goldenrace.com/sitemap.xml |
Warnings
- 1 invalid line.