malema.com
robots.txt
Robots Exclusion Standard data for malema.com
Resource Scan
Scan Details
Site Domain | malema.com |
Base Domain | malema.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-10-08T10:06:53+00:00 |
Next Scan | 2025-01-06T10:06:53+00:00 |
Last Successful Scan
Scanned | 2024-02-19T08:53:21+00:00 |
URL | https://malema.com/robots.txt |
Redirect | https://www.malema.com/robots.txt |
Redirect Domain | www.malema.com |
Redirect Base | malema.com |
Domain IPs | 23.52.171.128, 23.52.171.129, 2600:1413:b000:13::b857:c18e, 2600:1413:b000:13::b857:c196 |
Redirect IPs | 184.87.193.147, 184.87.193.161, 2600:1413:b000:13::b857:c193, 2600:1413:b000:13::b857:c1a1 |
Response IP | 42.99.140.208 |
Found | Yes |
Hash | 7b38badccbf688a77c0efa5161d722be4c5c17f05498f31767da791f7f2ec33b |
SimHash | 19e24ab0cb3b |
Groups
*
Rule | Path |
---|---|
Disallow | /admin |
Disallow | /bin/ |
Disallow | /files/ |
Disallow | /files/exportimport/ |
Disallow | /country/getstatesbycountryid |
Disallow | /install |
Disallow | /setproductreviewhelpfulness |
Disallow | /addproducttocart/catalog/ |
Disallow | /addproducttocart/details/ |
Disallow | /backinstocksubscriptions/manage |
Disallow | /boards/forumsubscriptions |
Disallow | /boards/forumwatch |
Disallow | /boards/postedit |
Disallow | /boards/postdelete |
Disallow | /boards/postcreate |
Disallow | /boards/topicedit |
Disallow | /boards/topicdelete |
Disallow | /boards/topiccreate |
Disallow | /boards/topicmove |
Disallow | /boards/topicwatch |
Disallow | /cart$ |
Disallow | /changecurrency |
Disallow | /changelanguage |
Disallow | /changetaxtype |
Disallow | /checkout |
Disallow | /checkout/billingaddress |
Disallow | /checkout/completed |
Disallow | /checkout/confirm |
Disallow | /checkout/shippingaddress |
Disallow | /checkout/shippingmethod |
Disallow | /checkout/paymentinfo |
Disallow | /checkout/paymentmethod |
Disallow | /clearcomparelist |
Disallow | /compareproducts |
Disallow | /compareproducts/add/* |
Disallow | /customer/avatar |
Disallow | /customer/activation |
Disallow | /customer/addresses |
Disallow | /customer/changepassword |
Disallow | /customer/checkusernameavailability |
Disallow | /customer/downloadableproducts |
Disallow | /customer/info |
Disallow | /deletepm |
Disallow | /emailwishlist |
Disallow | /eucookielawaccept |
Disallow | /inboxupdate |
Disallow | /newsletter/subscriptionactivation |
Disallow | /onepagecheckout |
Disallow | /order/history |
Disallow | /orderdetails |
Disallow | /passwordrecovery/confirm |
Disallow | /poll/vote |
Disallow | /privatemessages |
Disallow | /returnrequest |
Disallow | /returnrequest/history |
Disallow | /rewardpoints/history |
Disallow | /search? |
Disallow | /sendpm |
Disallow | /sentupdate |
Disallow | /shoppingcart/* |
Disallow | /storeclosed |
Disallow | /subscribenewsletter |
Disallow | /topic/authenticate |
Disallow | /viewpm |
Disallow | /uploadfilecheckoutattribute |
Disallow | /uploadfileproductattribute |
Disallow | /uploadfilereturnrequest |
Disallow | /wishlist |
Other Records
Field | Value |
---|---|
sitemap | https://www.malema.com/sitemap.xml |
Warnings
- `host` is not a known field.