bogsfootwear.com
robots.txt
Robots Exclusion Standard data for bogsfootwear.com
Resource Scan
Scan Details
| Site Domain | bogsfootwear.com |
| Base Domain | bogsfootwear.com |
| Scan Status | Ok |
| Last Scan | 2024-11-18T16:32:53+00:00 |
| Next Scan | 2024-12-02T16:32:53+00:00 |
Last Scan
| Scanned | 2024-11-18T16:32:53+00:00 |
| URL | https://bogsfootwear.com/robots.txt |
| Redirect | https://www.bogsfootwear.com/robots.txt |
| Redirect Domain | www.bogsfootwear.com |
| Redirect Base | bogsfootwear.com |
| Domain IPs | 139.60.100.48, 74.217.254.244 |
| Redirect IPs | 159.255.219.9 |
| Response IP | 74.217.215.31 |
| Found | Yes |
| Hash | 35334539e6e397e92de83aef78759853418b17118cbbbd3f5be8a52af64dd160 |
| SimHash | 47e447126297 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /shop/javax* |
| Disallow | /WEB-INF/ |
| Disallow | /shop/xmlhttp* |
| Disallow | /shop/META-INF/INF/ |
| Disallow | /feeds/ |
| Disallow | /shop/default-landing-page.html |
| Disallow | /shop/styleGridSearch.html? |
| Disallow | /shop/shoppingCart.html |
| Disallow | /shop/customers |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.bogsfootwear.com/SiteMap.xml |
| sitemap | https://www.bogsfootwear.com/ImageSiteMap.xml |
Comments