Re: Need help setting UP Strimzi Kafka Cluster with Cruise Control
toggle quoted message Show quoted text
You have to do it manually. Kafka is not something that is normally scaled up or down very often. It is a stateful application with partitions and their replicas having a fixed assignment to a specific broker. Scaling the cluster up and down means reassigning the partitions between the nodes and since the partitions often contain very large amounts of data, these data need to be transferred. And that has of course its cost (it often takes a long time, generates financial costs etc.). So usually, you would scale the cluster up for example as you onboard new applications or as your applications grow. But you would for example not scale it up for a few minutes because there seems to be some traffic peak. So normally it is more the result of some long term planning rather than some quick decision of the HPA.
Thanks & Regards
On Wed, Feb 23, 2022 at 9:48 PM Ranjeet Ranjan <ranjeet@...> wrote: