berrysee.com
robots.txt
Robots Exclusion Standard data for berrysee.com
Resource Scan
Scan Details
| Site Domain | berrysee.com |
| Base Domain | berrysee.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-08-31T17:05:42+00:00 |
| Next Scan | 2024-11-29T17:05:42+00:00 |
Last Successful Scan
| Scanned | 2024-01-12T14:15:20+00:00 |
| URL | https://berrysee.com/robots.txt |
| Redirect | https://www.berrysee.com/robots.txt |
| Redirect Domain | www.berrysee.com |
| Redirect Base | berrysee.com |
| Domain IPs | 104.21.22.34, 172.67.202.58, 2606:4700:3031::6815:1622, 2606:4700:3034::ac43:ca3a |
| Redirect IPs | 104.21.22.34, 172.67.202.58, 2606:4700:3031::6815:1622, 2606:4700:3034::ac43:ca3a |
| Response IP | 104.21.22.34 |
| Found | Yes |
| Hash | 6328cbffe0538c164a124d0ea857cfcfcd84fcac7cdf1465e4bb6804ecabb654 |
| SimHash | c0711ffec638 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /customer/ |
| Disallow | /Collection/ |
| Disallow | /Search/ |
| Disallow | /*Account/ |
| Disallow | /*account/ |
| Disallow | /*Payment.html |
| Disallow | /*payment.html |
| Disallow | /*shoppingcart.html |
| Disallow | /*Shoppingcart.html |
| Disallow | /*login.html |
| Disallow | /*Login.html |
| Disallow | /*Address.html |
| Disallow | /*address.html |
| Disallow | /*.bmp$ |
| Disallow | /*.aspx$ |
| Disallow | /*.php$ |
| Disallow | /ClickTale/ |
| Disallow | /plus-size-114/ |
| Disallow | /jewelry-sets-42/ |
| Disallow | /cms/ |
| Disallow | /test/ |
| Allow | /*.css |
| Allow | /*.jpg |
| Allow | /*.png |
| Allow | /*?p=* |
| Disallow | /*? |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.berrylook.com/sitemap.xml |
Warnings
- 1 invalid line.