musicmagpie.co.uk
robots.txt
Robots Exclusion Standard data for musicmagpie.co.uk
Resource Scan
Scan Details
| Site Domain | musicmagpie.co.uk |
| Base Domain | musicmagpie.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-09-29T16:58:10+00:00 |
| Next Scan | 2024-10-29T16:58:10+00:00 |
Last Scan
| Scanned | 2024-09-29T16:58:10+00:00 |
| URL | https://musicmagpie.co.uk/robots.txt |
| Redirect | https://www.musicmagpie.co.uk/robots.txt |
| Redirect Domain | www.musicmagpie.co.uk |
| Redirect Base | musicmagpie.co.uk |
| Domain IPs | 104.19.152.73, 104.19.153.73, 2606:4700::6813:9849, 2606:4700::6813:9949 |
| Redirect IPs | 104.19.152.73, 104.19.153.73, 2606:4700::6813:9849, 2606:4700::6813:9949 |
| Response IP | 104.19.153.73 |
| Found | Yes |
| Hash | 9470d9a798b3dc0024b95cf2f32a7c57949c03b2661a8d9371ea1fb04b7d83b2 |
| SimHash | 236048c42fc3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /App_* |
| Disallow | /apps* |
| Disallow | /bi* |
| Disallow | /Conf* |
| Disallow | /Das* |
| Disallow | /email_* |
| Disallow | /Ins* |
| Disallow | /Mac* |
| Disallow | /mi* |
| Disallow | /Umb* |
| Disallow | /Us* |
| Disallow | /Vi* |
| Disallow | /Xs* |
| Disallow | /externalcmscontent* |
| Disallow | /popups* |
| Disallow | WL-* |
| Disallow | /WL-* |
| Disallow | /register/register-popups* |
| Disallow | /start-selling/basket-popups* |
| Disallow | /checkout/popup-pages-checkout* |
| Disallow | /my-account/forgotten-password/popup-pages* |
| Disallow | /store/checkout |
| Disallow | /store/cart |
| Disallow | /store/extras |
| Disallow | /store/orders |
| Disallow | /store/user |
| Disallow | /store/account |
| Disallow | /store/api |
| Disallow | /store/password |
| Disallow | /store/related_products |
| Allow | /mirror-mirror/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.musicmagpie.co.uk/sitemap.xml |
| sitemap | https://www.musicmagpie.co.uk/store/sitemaps/sitemap.xml.gz |
| sitemap | https://www.musicmagpie.co.uk/blog/sitemap.xml |