mugler.com
robots.txt
Robots Exclusion Standard data for mugler.com
Resource Scan
Scan Details
Site Domain | mugler.com |
Base Domain | mugler.com |
Scan Status | Ok |
Last Scan | 2024-09-27T21:33:48+00:00 |
Next Scan | 2024-10-11T21:33:48+00:00 |
Last Scan
Scanned | 2024-09-27T21:33:48+00:00 |
URL | https://mugler.com/robots.txt |
Redirect | https://www.mugler.com/robots.txt |
Redirect Domain | www.mugler.com |
Redirect Base | mugler.com |
Domain IPs | 104.18.43.153, 172.64.144.103, 2606:4700:4400::6812:2b99, 2606:4700:4400::ac40:9067 |
Redirect IPs | 104.18.43.153, 172.64.144.103, 2606:4700:4400::6812:2b99, 2606:4700:4400::ac40:9067 |
Response IP | 172.64.144.103 |
Found | Yes |
Hash | 10ae0a3fadb664f7d926774f62729f704ec9054acb391bf49bf4a379a7062dc7 |
SimHash | 665c5164e3d1 |
Groups
*
Rule | Path |
---|---|
Disallow | */cart* |
Disallow | */account* |
Disallow | */account-login |
Disallow | */Address-List* |
Disallow | */checkout-start* |
Disallow | */Order-History* |
Disallow | */Wishlist-Show* |
Disallow | */LoyaltyFlows* |
Disallow | */search* |
Disallow | */*dwcont* |
Disallow | */*format* |
Disallow | */*linksrc* |
Disallow | */*pmin* |
Disallow | */*pmax* |
Disallow | */*srule* |
Disallow | */*subid* |
Disallow | */*sz* |
Disallow | */*variantID* |
Disallow | *?bvstate* |
Other Records
Field | Value |
---|---|
crawl-delay | 5 |
Other Records
Field | Value |
---|---|
sitemap | https://www.mugler.com/sitemap_index.xml |