Log In Sign Up

goldmachine.com
robots.txt

Robots Exclusion Standard data for goldmachine.com

Resource Scan

Scan Details

Site Domain goldmachine.com
Base Domain goldmachine.com
Scan Status Ok
Last Scan2025-11-17T22:23:00+00:00
Next Scan 2025-12-17T22:23:00+00:00

Last Scan

Scanned2025-11-17T22:23:00+00:00
URL https://www.goldmachine.com/robots.txt
Domain IPs 13.35.202.126, 13.35.202.128, 13.35.202.25, 13.35.202.34, 2600:9000:2078:4c00:1e:4402:23c0:93a1, 2600:9000:2078:600:1e:4402:23c0:93a1, 2600:9000:2078:6600:1e:4402:23c0:93a1, 2600:9000:2078:7e00:1e:4402:23c0:93a1, 2600:9000:2078:8a00:1e:4402:23c0:93a1, 2600:9000:2078:c800:1e:4402:23c0:93a1, 2600:9000:2078:ec00:1e:4402:23c0:93a1, 2600:9000:2078:fe00:1e:4402:23c0:93a1
Response IP 13.35.202.126
Found Yes
Hash 64ef78eeea16e8e8e968fea3740f2b7f58d2cd6ba6a60791408c615552c2db37
SimHash 409c1810f5d7

Groups

*

Rule Path
Allow /
Disallow /api/
Disallow /admin/
Disallow /private/
Disallow /temp/
Disallow /assets/
Disallow /*.json$
Disallow /?

googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

googlebot-image

Rule Path
Allow /images/

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://goldmachine.com/sitemap.xml
Back to top

Comments

  • Sitemap location
  • Disallow common paths that shouldn't be indexed
  • Specific bot optimizations
  • Block AI training bots
Back to top