devonduvets.com
robots.txt

Robots Exclusion Standard data for devonduvets.com

Resource Scan

Scan Details

Site Domain devonduvets.com
Base Domain devonduvets.com
Scan Status Ok
Last Scan2026-01-03T05:12:25+00:00
Next Scan 2026-02-02T05:12:25+00:00

Last Scan

Scanned2026-01-03T05:12:25+00:00
URL https://devonduvets.com/robots.txt
Redirect https://www.devonduvets.com/robots.txt
Redirect Domain www.devonduvets.com
Redirect Base devonduvets.com
Domain IPs 104.21.35.72, 172.67.215.135, 2606:4700:3032::ac43:d787, 2606:4700:3033::6815:2348
Redirect IPs 104.21.35.72, 172.67.215.135, 2606:4700:3032::ac43:d787, 2606:4700:3033::6815:2348
Response IP 172.67.215.135
Found Yes
Hash 44344a9ac3fe791ed173abca7ab3629b9d99ff024be3556ea1270b3cd86483ba
SimHash 6044d900a5c5

Groups

amazonbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

*

Rule Path
Disallow /catalogsearch/result/index/*

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 0.2

pinterestbot

Rule Path
Disallow /catalogsearch/

*

Rule Path
Disallow /customer/account/login/referer/*

Comments

  • 08/07/25 - 252