Kafka Server Test

Kafka is distributed data infrastructure, which implies that there is a node (broker) that can be duplicated across a network such that the collection of all of those nodes functions together and constitute a single Kafka cluster. This test reports the performance of operational broker metrics aggregated across the cluster, and per broker or per topic.

Target of the test : Apache Kafka Message System

Agent deploying the test : An internal/remote agent

Outputs of the test : One set of results for the target Apache Kafka Message System.

Configurable parameters for the test
Parameter Description

Test period

How often should the test be executed.

Host

The IP address of the target server that is being monitored.

Port

The port number through which the Apache Kafka Message System communicates. The default port is 9092.

JMX Remote Port

This parameter appears only if the Measurement Mode is set to jmx. Here, specify the port at which the jmx listens for requests from remote hosts.

JMX User, JMX Password, and Confirm Password

These parameters appear only if the Measurement Mode is set to jmx. If JMX requires authentication only (but no security), then ensure that the JMX User and JMX Password parameters are configured with the credentials of a user with read-write access to JMX.

Measurements made by the test
Measurement Description Measurement Unit Interpretation

Leader

Indicates the number of replicas for which this broker is the leader.

Count

 

Partition

Indicates the number of partitions in the broker.

Count

 

Offline replica

Indicates the number of offline replicas on a live broker.

Count

This is equivalent to the number of Topic Partition log on the bad log directories of the broker.

Failed ISR updates

Indicates the number of failed ISR update in Zookeeper.

Number

A very low value is required for this measure.

Reassigning partitions

Indicates the number of reassigning leader partitions on a broker.

Number

 

Under replicated partition

Indicates the number of partitions that have not been fully replicated in the follower replicas.

Number

 

Under minimum ISR partition

Indicates the number of partitions under the minimum In-Sync Replica (ISR) count.

Count

The ISR count indicates the set of replicas that are up-to-date with the leader.

ISR shrinks

Indicates the rate at which the number of ISRs are decreasing in the broker.

Number

 

ISR expands

Indicates the rate at which the number of ISRs are decreasing in the broker.

Number

 

At minimum ISR partition

Indicates the number of partitions with only minimum number of In-sync replicas remaining in the ISR set.

Count

 

Fetch queue size

Indicates the size of the queue for Fetch.

MB

 

Produce queue size

Indicates the size of the queue for Produce.

MB

 

Request queue size

Indicates the size of the queue for requests.

MB