cfsbrands.com
robots.txt
Robots Exclusion Standard data for cfsbrands.com
Resource Scan
Scan Details
| Site Domain | cfsbrands.com |
| Base Domain | cfsbrands.com |
| Scan Status | Ok |
| Last Scan | 2024-11-12T06:43:33+00:00 |
| Next Scan | 2024-11-26T06:43:33+00:00 |
Last Scan
| Scanned | 2024-11-12T06:43:33+00:00 |
| URL | https://www.cfsbrands.com/robots.txt |
| Domain IPs | 13.33.88.112, 13.33.88.119, 13.33.88.20, 13.33.88.96, 2600:9000:223b:2800:0:86f7:8c40:93a1, 2600:9000:223b:4000:0:86f7:8c40:93a1, 2600:9000:223b:5400:0:86f7:8c40:93a1, 2600:9000:223b:7400:0:86f7:8c40:93a1, 2600:9000:223b:7e00:0:86f7:8c40:93a1, 2600:9000:223b:9c00:0:86f7:8c40:93a1, 2600:9000:223b:e00:0:86f7:8c40:93a1, 2600:9000:223b:e400:0:86f7:8c40:93a1 |
| Response IP | 13.33.88.20 |
| Found | Yes |
| Hash | 904166c7b4054bd7df63bbd50fdf827d3296bfe8c5f747d856e423e1c230e30f |
| SimHash | c5909d464653 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /account |
| Disallow | /account/* |
| Disallow | /admin |
| Disallow | /admin/* |
| Disallow | /cart |
| Disallow | /catalog |
| Disallow | /catalog?* |
| Disallow | /images/ |
| Disallow | /password/new |
| Disallow | /signin |
| Disallow | /signup |
| Disallow | /where-to-buy/* |
| Disallow | /wishlists |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |