malema.com
robots.txt

Robots Exclusion Standard data for malema.com

Resource Scan

Scan Details

Site Domain malema.com
Base Domain malema.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-11T08:54:40+00:00
Next Scan 2024-07-10T08:54:40+00:00

Last Successful Scan

Scanned2024-02-19T08:53:21+00:00
URL https://malema.com/robots.txt
Redirect https://www.malema.com/robots.txt
Redirect Domain www.malema.com
Redirect Base malema.com
Domain IPs 23.52.171.128, 23.52.171.129, 2600:1413:b000:13::b857:c18e, 2600:1413:b000:13::b857:c196
Redirect IPs 184.87.193.147, 184.87.193.161, 2600:1413:b000:13::b857:c193, 2600:1413:b000:13::b857:c1a1
Response IP 42.99.140.208
Found Yes
Hash 7b38badccbf688a77c0efa5161d722be4c5c17f05498f31767da791f7f2ec33b
SimHash 19e24ab0cb3b

Groups

*

Rule Path
Disallow /admin
Disallow /bin/
Disallow /files/
Disallow /files/exportimport/
Disallow /country/getstatesbycountryid
Disallow /install
Disallow /setproductreviewhelpfulness
Disallow /addproducttocart/catalog/
Disallow /addproducttocart/details/
Disallow /backinstocksubscriptions/manage
Disallow /boards/forumsubscriptions
Disallow /boards/forumwatch
Disallow /boards/postedit
Disallow /boards/postdelete
Disallow /boards/postcreate
Disallow /boards/topicedit
Disallow /boards/topicdelete
Disallow /boards/topiccreate
Disallow /boards/topicmove
Disallow /boards/topicwatch
Disallow /cart$
Disallow /changecurrency
Disallow /changelanguage
Disallow /changetaxtype
Disallow /checkout
Disallow /checkout/billingaddress
Disallow /checkout/completed
Disallow /checkout/confirm
Disallow /checkout/shippingaddress
Disallow /checkout/shippingmethod
Disallow /checkout/paymentinfo
Disallow /checkout/paymentmethod
Disallow /clearcomparelist
Disallow /compareproducts
Disallow /compareproducts/add/*
Disallow /customer/avatar
Disallow /customer/activation
Disallow /customer/addresses
Disallow /customer/changepassword
Disallow /customer/checkusernameavailability
Disallow /customer/downloadableproducts
Disallow /customer/info
Disallow /deletepm
Disallow /emailwishlist
Disallow /eucookielawaccept
Disallow /inboxupdate
Disallow /newsletter/subscriptionactivation
Disallow /onepagecheckout
Disallow /order/history
Disallow /orderdetails
Disallow /passwordrecovery/confirm
Disallow /poll/vote
Disallow /privatemessages
Disallow /returnrequest
Disallow /returnrequest/history
Disallow /rewardpoints/history
Disallow /search?
Disallow /sendpm
Disallow /sentupdate
Disallow /shoppingcart/*
Disallow /storeclosed
Disallow /subscribenewsletter
Disallow /topic/authenticate
Disallow /viewpm
Disallow /uploadfilecheckoutattribute
Disallow /uploadfileproductattribute
Disallow /uploadfilereturnrequest
Disallow /wishlist

Other Records

Field Value
sitemap https://www.malema.com/sitemap.xml

Warnings

  • `host` is not a known field.