links.warbyparker.com
robots.txt

Robots Exclusion Standard data for links.warbyparker.com

Resource Scan

Scan Details

Site Domain links.warbyparker.com
Base Domain warbyparker.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-02-03T10:36:37+00:00
Next Scan 2025-05-04T10:36:37+00:00

Last Successful Scan

Scanned2024-07-02T10:32:52+00:00
URL https://links.warbyparker.com/robots.txt
Domain IPs 104.17.184.81, 104.17.185.81
Response IP 104.17.185.81
Found Yes
Hash b489ed1be98ce0cef138a0386e106c36d4b8aa1fea7907f2d3dd5ac2a2861be7
SimHash 94045a08e5d0

Groups

*

Rule Path
Disallow /a/
Disallow /e/
Disallow /u/
Disallow /ep?
Disallow /p?

Comments

  • robotstxt.org/

Warnings

  • `noindex` is not a known field.