buckle.com
robots.txt
Robots Exclusion Standard data for buckle.com
Resource Scan
Scan Details
| Site Domain | buckle.com |
| Base Domain | buckle.com |
| Scan Status | Ok |
| Last Scan | 2024-05-27T03:07:50+00:00 |
| Next Scan | 2024-06-26T03:07:50+00:00 |
Last Scan
| Scanned | 2024-05-27T03:07:50+00:00 |
| URL | https://buckle.com/robots.txt |
| Redirect | https://www.buckle.com/robots.txt |
| Redirect Domain | www.buckle.com |
| Redirect Base | buckle.com |
| Domain IPs | 151.101.131.52, 151.101.195.52, 151.101.3.52, 151.101.67.52 |
| Redirect IPs | 151.101.131.52, 151.101.195.52, 151.101.3.52, 151.101.67.52 |
| Response IP | 199.232.47.52 |
| Found | Yes |
| Hash | 7ec635b45aa07d0be7b5b8bc9b377e2a3669ae2e11eb513fcfb4b357fb56409e |
| SimHash | 1c21ca768af3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /account/ |
| Disallow | /admin |
| Disallow | /administration |
| Disallow | /bucklecard/buckle-card-info/ |
| Disallow | /cart/ |
| Disallow | /checkout/ |
| Disallow | /cms |
| Disallow | /confirmation/ |
| Disallow | /corporate/ |
| Disallow | /error/ |
| Disallow | /guest-services/our-brands |
| Disallow | /international/ |
| Disallow | /jobscareers/ |
| Disallow | /p/ |
| Disallow | /products/ |
| Disallow | /products/include/ |
| Disallow | /returns/ |
| Disallow | /static/bscene/games/drums/ |
| Disallow | /favorites/api |
| Disallow | /newsletter/email |
| Disallow | */inseam%3A*/* |
| Disallow | */price-range%3A* |
| Disallow | */waist%3A*/* |
| Disallow | */stretch%3A*/* |
| Disallow | */destruction%3A*/* |
| Disallow | */finish%3A* |
| Disallow | */color%3A*/* |
| Disallow | */leg-opening%3A*/* |
| Disallow | */length%3A*/* |
| Disallow | */*%2B* |
| Allow | */prd-* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.buckle.com/sitemap.xml |