dwr.com
robots.txt

Robots Exclusion Standard data for dwr.com

Resource Scan

Scan Details

Site Domain dwr.com
Base Domain dwr.com
Scan Status Ok
Last Scan2025-09-11T14:57:56+00:00
Next Scan 2025-10-11T14:57:56+00:00

Last Scan

Scanned2025-09-11T14:57:56+00:00
URL https://dwr.com/robots.txt
Redirect https://www.dwr.com/robots.txt
Redirect Domain www.dwr.com
Redirect Base dwr.com
Domain IPs 13.248.160.137, 76.223.34.124
Redirect IPs 104.18.18.29, 104.18.19.29, 2606:4700::6812:121d, 2606:4700::6812:131d
Response IP 104.18.19.29
Found Yes
Hash 75cfe62787709ceb37343f8213e6735b007074bc9484092dea6190bf4ad91664
SimHash e706e62c2df0

Groups

*

Rule Path
Disallow */account
Disallow */checkout
Disallow */api/
Disallow */search
Disallow */requestswatches
Disallow */request-swatch
Disallow */productdetail
Disallow */Search-UpdateGrid
Disallow */wishlist
Disallow */cart
Disallow */Login
Disallow */login
Disallow */variation
Disallow */amp
Disallow *%7C
Disallow *%7C
Disallow *%7C
Disallow /newcatalogoptout
Disallow */COPlaceOrder-Submit

ahrefsbot crawl-delay: 15
pinterestbot crawl-delay: 1

No rules defined. All paths allowed.

Other Records

Field Value
sitemap https://www.dwr.com/sitemap_index.xml