danmurphys.com.au
robots.txt
Robots Exclusion Standard data for danmurphys.com.au
Resource Scan
Scan Details
| Site Domain | danmurphys.com.au |
| Base Domain | danmurphys.com.au |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-09-18T16:56:39+00:00 |
| Next Scan | 2024-12-17T16:56:39+00:00 |
Last Successful Scan
| Scanned | 2023-02-19T20:45:26+00:00 |
| URL | https://danmurphys.com.au/robots.txt |
| Redirect | https://www.danmurphys.com.au/robots.txt |
| Redirect Domain | www.danmurphys.com.au |
| Redirect Base | danmurphys.com.au |
| Domain IPs | 104.18.30.32, 104.18.31.32 |
| Redirect IPs | 104.18.30.32, 104.18.31.32 |
| Response IP | 104.18.31.32 |
| Found | Yes |
| Hash | 331cdb3526c313efd082c62d486c8273909d5a290352e01f263be749a9c01afb |
| SimHash | 207145671c31 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /dm/home.jsp |
| Allow | /beer.jsp |
| Allow | /beer/cider.jsp |
| Allow | /red-wine.jsp |
| Allow | /red-wine/shiraz.jsp |
| Allow | /white-wine/sauvignon-blanc.jsp |
| Allow | /white-wine/moscato-sweet-white.jsp |
| Allow | /spirits.jsp |
| Allow | /spirits/vodka.jsp |
| Allow | /spirits/gin.jsp |
| Allow | /spirits/tequila.jsp |
| Allow | /spirits/rum.jsp |
| Allow | /spirits/brandy-cognac.jsp |
| Allow | /champagne-sparkling.jsp |
| Allow | /spirits/soju-shochu.jsp |
| Disallow | /checkout |
| Disallow | /dm/ecart/cart |
| Disallow | /dm/expresscheckout/checkout |
| Disallow | /dm/mydans/my_offers |
| Disallow | /dm/mydans/my_account |
| Disallow | /dm/mydans/my_shopping |
| Disallow | /dm/mydans/my_lists |
| Disallow | /dm/mydans/my_subscriptions |
| Disallow | /dm/mydans/staff |
| Disallow | /*.jsp |
| Disallow | /*UID%3D |
| Disallow | /*jsessionid%3D |
| Disallow | /dm/account |
| Disallow | /dm/checkout |
| Disallow | /dm/quickcheckout |
| Disallow | /dm/email |
| Disallow | /dm/shoppingcart |
| Disallow | /dm/search |
| Disallow | /dm/dm_error_session_timeout.jsp |
| Disallow | /dm/dm_error_page_not_found.jsp |
| Disallow | /dm/navigation/error_template.jsp |
| Disallow | /dm/navigation/error_compare_product.jsp |
| Disallow | /dm/navigation/navigation_results_gallery.jsp |
| Disallow | /static/ |
| Disallow | /empty.html |
| Disallow | /Storelocator/ |
| Disallow | /mdm/navigation/navigation_results.jsp |
| Disallow | /mdm/search/ |
| Disallow | /mdm/account/ |
| Disallow | /mob/mob/ |
| Disallow | .*orgSearchTerm.* |
| Disallow | /mydans/q-tracker/ |
| Disallow | /instore-signup/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.danmurphys.com.au/sitemap/FacetSitemap.xml |
| sitemap | https://www.danmurphys.com.au/sitemap/ProductSitemap.xml |
| sitemap | https://www.danmurphys.com.au/sitemap/StoreSitemap.xml |
| sitemap | https://www.danmurphys.com.au/sitemap/keywords-sitemap.xml |
| sitemap | https://www.danmurphys.com.au/sitemap/FreeTextSitemap.xml |