Breaking News: Grepper is joining You.com. Read the official announcement!
Check it out

When to use the Kafka reassignment partition tool

Sumit Rawal answered on May 31, 2023 Popularity 3/10 Helpfulness 1/10

Contents


More Related Answers

  • What do you mean by a Partition in Kafka?
  • auto increase partition in kafka
  • why do we need partitions in kafka
  • partitions in kafka
  • kafka default number of partitions per topic
  • Kafka Components:Topic, Partitions, Offset and Replication Factor
  • How are partitions distributed in an Apache Kafka cluster?
  • Can the number of partitions for a topic be changed in Kafka?
  • How will you expand a cluster in Kafka?
  • rebalancing kafka partitions

  • When to use the Kafka reassignment partition tool

    0

    As mentioned, we recommend using Cruise Control where possible. Currently Strimzi offers first-class support for three use cases:

    Balancing the whole cluster. This uses the KafkaRebalance custom resource.

    Assigning replicas to newly-added brokers. This uses a KafkaRebalance with spec.mode set to add-broker, which was added in Strimzi 0.29.

    Reassigning replicas away from brokers prior to scaling down the cluster. This uses a KafkaRebalance with spec.model set to remove-broker. This was also added in Strimzi 0.29.

    These use cases are covered extensively in the Strimzi documentation.

    The Strimzi community is also planning further integration with Cruise Control, as follows:

    Simplifying the existing rebalancing functionality using auto-approval.

    Automatic rebalance on scaling the broker up or down using auto-rebalance.

    Better supporting changing the replication factor of individual topics using the Topic Operator.

    There are a couple of common use cases where the tool can be used:

    Changing the preferred leader of one or more partitions. Followed by forcing the election of the preferred leader, this can be used to change the leadership of a given partition.

    Moving data from one volume to another on the same broker. This is necessary prior to removing a volume from JBOD storage. (To utilise a newly added JBOD volume it’s probably more convenient to perform a global rebalance using KafkaRebalance once the volume has been added).

    In the rest of this post we’ll dive into how the tool works, and then go through some examples based on these use cases.

    Popularity 3/10 Helpfulness 1/10 Language whatever
    Source: Grepper
    Link to this answer
    Share Copy Link
    Contributed on May 31 2023
    Sumit Rawal
    0 Answers  Avg Quality 2/10


    X

    Continue with Google

    By continuing, I agree that I have read and agree to Greppers's Terms of Service and Privacy Policy.
    X
    Grepper Account Login Required

    Oops, You will need to install Grepper and log-in to perform this action.