warbyparker.com
robots.txt

Robots Exclusion Standard data for warbyparker.com

Resource Scan

Scan Details

Site Domain warbyparker.com
Base Domain warbyparker.com
Scan Status Ok
Last Scan2024-06-08T10:49:21+00:00
Next Scan 2024-06-22T10:49:21+00:00

Last Scan

Scanned2024-06-08T10:49:21+00:00
URL https://warbyparker.com/robots.txt
Redirect https://www.warbyparker.com/robots.txt
Redirect Domain www.warbyparker.com
Redirect Base warbyparker.com
Domain IPs 13.227.254.112, 13.227.254.118, 13.227.254.17, 13.227.254.30
Redirect IPs 104.17.184.81, 104.17.185.81
Response IP 104.17.184.81
Found Yes
Hash 04286d026c30915ac20effa709b7921ccdfc9bc6b3d35c3e553fa19808366fbd
SimHash 6c205a046593

Groups

*

Rule Path
Disallow /account
Disallow /my-account
Disallow /ajax
Disallow /ajaxcontent
Disallow /api
Disallow /cart
Disallow /checkout
Disallow /logout
Disallow /virtual-tryon
Disallow /preview
Disallow /cms
Disallow /rx-upload
Disallow /pd-upload
Disallow /atc/*

Other Records

Field Value
sitemap https://www.warbyparker.com/sitemap.xml