chewy.com
robots.txt
Robots Exclusion Standard data for chewy.com
Resource Scan
Scan Details
| Site Domain | chewy.com |
| Base Domain | chewy.com |
| Scan Status | Ok |
| Last Scan | 2024-06-05T18:51:12+00:00 |
| Next Scan | 2024-06-19T18:51:12+00:00 |
Last Scan
| Scanned | 2024-06-05T18:51:12+00:00 |
| URL | https://chewy.com/robots.txt |
| Redirect | https://www.chewy.com/robots.txt |
| Redirect Domain | www.chewy.com |
| Redirect Base | chewy.com |
| Domain IPs | 23.53.216.120, 2600:1413:1:59a::c35, 2600:1413:1:5a0::c35 |
| Redirect IPs | 23.53.216.120, 2600:1413:a000:1180::c35, 2600:1413:a000:1188::c35 |
| Response IP | 23.54.56.36 |
| Found | Yes |
| Hash | bf76f4084cf5cf85281e842d85be45b833940e6469cd68312ad8dd51341ed469 |
| SimHash | 70a1600ac7d6 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /app/buy |
| Disallow | /app/deals? |
| Disallow | /app/account |
| Disallow | /app/ajax |
| Disallow | /app/checkout |
| Disallow | /*/dp/*?features |
| Disallow | /*/dp/*?hybrid |
| Disallow | /app/catalog/product-dimensions |
| Disallow | /app/we |
| Disallow | /app/write-review |
| Disallow | /app/api |
| Disallow | /app/subs |
| Disallow | /rp-resources |
| Disallow | *query%3D* |
| Disallow | /cc/ |
| Disallow | /app/cc/ |
| Disallow | /*?*ref=* |
| Disallow | /*lp%3D* |
| Disallow | /app/dp/* |
| Disallow | /api/login |
| Disallow | /app/login |
| Disallow | /app/register |
| Disallow | /app/resetpassword/ |
| Disallow | /auth/ |
| Disallow | /ca/app/login |
| Disallow | /ca/app/write-review |
| Disallow | /ca/app/register |
| Disallow | /ca/app/api |
| Disallow | /ca/app/resetpassword |
| Disallow | /ca/app/account |
| Disallow | /ca/ca/ |
| Disallow | /ca/auth/ |
| Disallow | /ca/api/login |
| Disallow | *adId%3D* |
| Disallow | /vet-care/scheduler |
| Disallow | /api/event/ |
Comments