app.gowinston.ai
robots.txt

Robots Exclusion Standard data for app.gowinston.ai

Resource Scan

Scan Details

Site Domain app.gowinston.ai
Base Domain gowinston.ai
Scan Status Ok
Last Scan2025-06-01T12:28:51+00:00
Next Scan 2025-07-01T12:28:51+00:00

Last Scan

Scanned2025-06-01T12:28:51+00:00
URL https://app.gowinston.ai/robots.txt
Redirect https://d2bxp9q9224yh5.cloudfront.net/8d431886-2e20-4dbe-ab7f-7b5461700221/robots.txt
Redirect Domain d2bxp9q9224yh5.cloudfront.net
Redirect Base d2bxp9q9224yh5.cloudfront.net
Domain IPs 104.21.68.64, 172.67.191.37, 2606:4700:3030::6815:4440, 2606:4700:3032::ac43:bf25
Redirect IPs 2600:9000:271a:2400:b:54c8:6240:21, 2600:9000:271a:2c00:b:54c8:6240:21, 2600:9000:271a:4c00:b:54c8:6240:21, 2600:9000:271a:7200:b:54c8:6240:21, 2600:9000:271a:a800:b:54c8:6240:21, 2600:9000:271a:c800:b:54c8:6240:21, 2600:9000:271a:da00:b:54c8:6240:21, 2600:9000:271a:e000:b:54c8:6240:21, 54.192.16.106, 54.192.16.155, 54.192.16.198, 54.192.16.212
Response IP 3.165.84.35
Found Yes
Hash 3be0c31d09fd6688dcc15c487b93451bbf5a6c7aa941d48a57b421e0740a2ee1
SimHash 3a10b129e9e1

Groups

*

Rule Path
Disallow /share/
Disallow /oauth/

twitterbot

Rule Path
Allow /share/image/

facebookexternalhit

Rule Path
Allow /share/image/

linkedinbot

Rule Path
Allow /share/image/

Comments

  • Certain social media sites are whitelisted to allow crawlers to access page markup when links to /images are shared.