majestic.co.uk
robots.txt
Robots Exclusion Standard data for majestic.co.uk
Resource Scan
Scan Details
| Site Domain | majestic.co.uk |
| Base Domain | majestic.co.uk |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-09-12T07:56:37+00:00 |
| Next Scan | 2024-11-11T07:56:37+00:00 |
Last Successful Scan
| Scanned | 2024-01-24T03:23:52+00:00 |
| URL | https://majestic.co.uk/robots.txt |
| Redirect | https://www.majestic.co.uk/robots.txt |
| Redirect Domain | www.majestic.co.uk |
| Redirect Base | majestic.co.uk |
| Domain IPs | 104.18.37.106, 172.64.150.150 |
| Redirect IPs | 104.18.37.106, 172.64.150.150 |
| Response IP | 172.64.150.150 |
| Found | Yes |
| Hash | 4afafb66ce499591f90faa3593974459027e34332a94bf0b5f5cec9e19db88f7 |
| SimHash | b9c65a345f5a |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /*ref%3D* |
| Disallow | /addproducttocart |
| Disallow | /backinstocksubscriptions/manage |
| Disallow | /bin/ |
| Disallow | /boards |
| Disallow | /Cache.aspx |
| Disallow | /cart |
| Disallow | /checkout |
| Disallow | /clearcomparelist |
| Disallow | /compareproducts |
| Disallow | /content/files |
| Disallow | /country/getstatesbycountryid/ |
| Disallow | /cs/ |
| Disallow | /customer |
| Disallow | /deletepm |
| Disallow | /emailwishlist |
| Disallow | /inboxupdate |
| Disallow | /install |
| Disallow | /login |
| Disallow | /logout |
| Disallow | /newsletter/subscriptionactivation |
| Disallow | /onepagecheckout |
| Disallow | /order/ |
| Disallow | /orderdetails |
| Disallow | /passwordrecovery |
| Disallow | /poll/vote |
| Disallow | /privatemessages |
| Disallow | /returnrequest |
| Disallow | /rewardpoints/history |
| Disallow | /sendpm |
| Disallow | /sentupdate |
| Disallow | /setproductreviewhelpfulness |
| Disallow | /shoppingcart |
| Disallow | /subscribenewsletter |
| Disallow | /topic/authenticate |
| Disallow | /uploadfilecheckoutattribute |
| Disallow | /uploadfileproductattribute |
| Disallow | /viewpm |
| Disallow | /wishlist |
| Disallow | /backinstocksubscribe/ |
| Disallow | /addproducttocart |
| Disallow | /Product/GetProductCompareList |
| Disallow | /Product/GetPaymentTableValue |
| Disallow | /t/a1 |
| Disallow | /bin2/ |
| Disallow | /cis/ |
| Disallow | *changecurrency* |
| Disallow | /search?q=* |
| Disallow | *changelanguage* |
| Disallow | *script* |
| Disallow | *Script* |
| Allow | /subscriptions |
| Allow | /wine-subscriptions |
| Disallow | *GetCustomerFavourite* |
| Disallow | *orderby* |
| Disallow | *price* |
| Disallow | *specs* |
| Disallow | *returnurl* |
| Disallow | *ReturnUrl* |
| Disallow | *returnUrl* |
| Disallow | *pagesize* |
| Disallow | *PageSize* |
| Disallow | *ProductQuickview* |
| Disallow | *productquickview* |
| Disallow | /Home/Error |
| Disallow | /pages/thank-you-page |