gatsbyjs.com
robots.txt

Robots Exclusion Standard data for gatsbyjs.com

Resource Scan

Scan Details

Site Domain gatsbyjs.com
Base Domain gatsbyjs.com
Scan Status Ok
Last Scan2025-12-06T14:01:05+00:00
Next Scan 2026-01-05T14:01:05+00:00

Last Scan

Scanned2025-12-06T14:01:05+00:00
URL https://gatsbyjs.com/robots.txt
Redirect https://www.gatsbyjs.com/robots.txt
Redirect Domain www.gatsbyjs.com
Redirect Base gatsbyjs.com
Domain IPs 15.197.167.90, 3.33.186.135
Redirect IPs 15.197.167.90, 2406:da18:b3d:e201::1f5, 3.33.186.135
Response IP 3.33.186.135
Found Yes
Hash 112f78a78be7b2c154dfec07b026a7880df24e29c9dcb836c1080edf27da35bc
SimHash 67598e5147b0

Groups

*

Rule Path
Disallow /dashboard/

Other Records

Field Value
sitemap https://www.gatsbyjs.com/sitemap/sitemap-index.xml

Warnings

  • `host` is not a known field.