Kafka Network Test

Kafka uses a binary protocol over TCP. The protocol defines all APIs as request response message pairs and all messages are size delimited. This test reports the performance of the Kafka network where the transactions between producers, consumers and Kafka clusters (brokers) take place.

Target of the test : Apache Kafka Message System

Agent deploying the test : An internal/remote agent

Outputs of the test : One set of results for the target Apache Kafka Message System.

Configurable parameters for the test
Parameter Description

Test period

How often should the test be executed.

Host

The IP address of the target server that is being monitored.

Port

The port number through which the Apache Kafka Message System communicates. The default port is 9092.

JMX Remote Port

This parameter appears only if the Measurement Mode is set to jmx. Here, specify the port at which the jmx listens for requests from remote hosts.

JMX User, JMX Password, and Confirm Password

These parameters appear only if the Measurement Mode is set to jmx. If JMX requires authentication only (but no security), then ensure that the JMX User and JMX Password parameters are configured with the credentials of a user with read-write access to JMX.

Measurements made by the test
Measurement Description Measurement Unit Interpretation

Request queue size

Indicates the size of the request queue.

MB

A congested request queue will not be able to process incoming or outgoing requests.

Response queue size

Indicates the size of the response queue.

MB

The response queue is unbounded.

A congested response queue can result in delayed response times and memory pressure on the broker.

Expired connections killed

Indicates the total number of connections disconnected, across all processors.

Count

The disconnection is due to a client not being re-authenticated and using the connection beyond its expiration time for anything other than re-authentication.

Control plane expired connection kill

Indicates the number of expired connections that were disconnected on the control plane.

Count

A very low value is required for this measure.

Memory pool used

Indicates the number of bytes currently allocated out of the pool and still not returned.

MB

 

Temporary memory fetch

Indicates the temporary memory used for message format conversions and decompression during Fetch.

MB

 

Temporary memory produce

Indicates the temporary memory used for message format conversions and decompression during Produce.

MB