stephens.com
robots.txt

Robots Exclusion Standard data for stephens.com

Resource Scan

Scan Details

Site Domain stephens.com
Base Domain stephens.com
Scan Status Ok
Last Scan2025-11-12T20:43:30+00:00
Next Scan 2025-11-19T20:43:30+00:00

Last Scan

Scanned2025-11-12T20:43:30+00:00
URL https://stephens.com/robots.txt
Redirect https://www.stephens.com/robots.txt
Redirect Domain www.stephens.com
Redirect Base stephens.com
Domain IPs 173.237.181.176
Redirect IPs 104.20.36.47, 172.66.150.224, 2606:4700:10::6814:242f, 2606:4700:10::ac42:96e0
Response IP 104.20.36.47
Found Yes
Hash d4c1c4e60b81cf1f29874f6db5d969b89524262d6da4c4e8a2e014d9a9efa986
SimHash 61701d567730

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/

Other Records

Field Value
sitemap https://www.stephens.com/sitemaps-1-sitemap.xml

Comments

  • robots.txt for https://www.stephens.com/
  • live - don't allow web crawlers to index cpresources/ or vendor/