Kafka Controller Test

In a Kafka cluster, one of the brokers serves as the controller, which is responsible for managing the states of partitions and replicas and for performing administrative tasks like reassigning partitions.

This test monitors the partitions managed by the controller and for each partition, reports whether the partition is active and running.

Target of the test : Apache Kafka Message System

Agent deploying the test : An internal/remote agent

Outputs of the test : One set of results for the target Apache Kafka Message System.

Configurable parameters for the test
Parameter Description

Test period

How often should the test be executed.

Host

The IP address of the target server that is being monitored.

Port

The port number through which the Apache Kafka Message System communicates. The default port is 9092.

JMX Remote Port

This parameter appears only if the Measurement Mode is set to jmx. Here, specify the port at which the jmx listens for requests from remote hosts.

JMX User, JMX Password, and Confirm Password

These parameters appear only if the Measurement Mode is set to jmx. If JMX requires authentication only (but no security), then ensure that the JMX User and JMX Password parameters are configured with the credentials of a user with read-write access to JMX.

Measurements made by the test
Measurement Description Measurement Unit Interpretation

Controller state

Indicates the number of brokers designated as controllers.

Count

 

Active controller

Indicates the state the controller is in, i.e. the event that is currently being processed.

 

The values reported by this measure and its numeric equivalents are mentioned in the table below:

Measure Value

Numeric Value
Idle 0
Controller change 1
Broker change 2
Topic creation 3
Topic deletion 4
Partition reassignment 5
Auto leader balance 6
Manual leader balance 7
Controlled shutdown 8
ISR change 9

Note:

By default, this measure reports the Measure Values listed in the table above to indicate the state the controller is in, i.e. the event that is currently being processed.

Global partition

Indicates that the Global Partition is updated when the Controller Event Thread gets a Topic Change, Topic Deletion, and Partition Reassignment request and is purged on Controller failover.

Count

 

Global topic

Indicates that the Global Topic is updated when the Controller Event Thread gets a Topic Change and Topic Deletion request and is purged on Controller failover.

Count

 

Offline partitions

Indicates the number of partitions that do not have an active leader and are hence not writable or readable.

Count

Alert will be given when this value is greater than 0.

Preferred replica imbalance

Indicates the imbalance count in the preferred replica.

Count

 

Replica ineligible to delete

Indicates the count of ineligible pending replica to be deleted.

Count

 

Replicas to delete

Indicates the count of pending replica to be deleted.

Count

 

Topics ineligible to delete

Indicates the count of ineligible pending topic to be deleted.

Count

 

Topics to delete

Indicates the count of pending topic to be deleted.

Count