cfsbrands.com
robots.txt
Robots Exclusion Standard data for cfsbrands.com
Resource Scan
Scan Details
| Site Domain | cfsbrands.com |
| Base Domain | cfsbrands.com |
| Scan Status | Ok |
| Last Scan | 2024-09-17T06:42:48+00:00 |
| Next Scan | 2024-10-01T06:42:48+00:00 |
Last Scan
| Scanned | 2024-09-17T06:42:48+00:00 |
| URL | https://www.cfsbrands.com/robots.txt |
| Domain IPs | 13.33.88.112, 13.33.88.119, 13.33.88.20, 13.33.88.96, 2600:9000:223b:8a00:0:86f7:8c40:93a1, 2600:9000:223b:9800:0:86f7:8c40:93a1, 2600:9000:223b:9e00:0:86f7:8c40:93a1, 2600:9000:223b:ae00:0:86f7:8c40:93a1, 2600:9000:223b:b200:0:86f7:8c40:93a1, 2600:9000:223b:e200:0:86f7:8c40:93a1, 2600:9000:223b:f400:0:86f7:8c40:93a1, 2600:9000:223b:f800:0:86f7:8c40:93a1 |
| Response IP | 13.33.88.112 |
| Found | Yes |
| Hash | 904166c7b4054bd7df63bbd50fdf827d3296bfe8c5f747d856e423e1c230e30f |
| SimHash | c5909d464653 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /account |
| Disallow | /account/* |
| Disallow | /admin |
| Disallow | /admin/* |
| Disallow | /cart |
| Disallow | /catalog |
| Disallow | /catalog?* |
| Disallow | /images/ |
| Disallow | /password/new |
| Disallow | /signin |
| Disallow | /signup |
| Disallow | /where-to-buy/* |
| Disallow | /wishlists |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |