Kafka Consumer Test
Kafka consumers are typically part of a consumer group. Consumers read data from brokers. Consumers subscribes to one or more topics and consume published messages by pulling data from the brokers.
This test monitors the broker's connection to the consumer and any abnormal connectivity issues can be proactively detected.
Target of the test : Apache Kafka Message System
Agent deploying the test : An internal/remote agent
Outputs of the test : One set of results for the target Apache Kafka Message System.
| Parameter | Description |
|---|---|
|
Test period |
How often should the test be executed. |
|
Host |
The IP address of the target server that is being monitored. |
|
Port |
The port number through which the Apache Kafka Message System communicates. The default port is 9092. |
|
Consumer Port |
The port number through which the consumer communicates with the broker. |
|
JMX User, JMX Password, and Confirm Password |
These parameters appear only if the Measurement Mode is set to jmx. If JMX requires authentication only (but no security), then ensure that the JMX User and JMX Password parameters are configured with the credentials of a user with read-write access to JMX. |
| Measurement | Description | Measurement Unit | Interpretation |
|---|---|---|---|
|
Connection close rate |
Indicates the rate of closed connections. |
Connections/sec |
|
|
Connection count |
Indicates the current number of active connections. |
Number |
A very high value is required for this measure. |
|
Connection creation rate |
Indicates the new established connections . |
Connections/sec |
|
|
Failed authentication rate |
Indicates the connections for failed authentication. |
Connections/sec |
Ideally, the value of these measures should be zero.
|
|
Failed reauthentication rate |
Indicates the connections for failed re-authentication. |
Connections/sec |
|
|
Average incoming data rate |
Indicates the average data rate received for a node. |
MB/Second |
|
|
Average IO time |
Indicates the average length of time for I/O per select call. |
Seconds |
|
|
Average IO wait time |
Indicates the average length of time the I/O thread spent waiting for a socket ready for reads or writes. |
Seconds |
|
|
Network IO rate |
Indicates the average number of network operations (reads or writes) on all connections. |
Operations/sec |
|
|
Average outgoing data rate |
Indicates the average outgoing data rate sent for a node. |
MB/Second |
|
|
Average reauthentication latency |
Indicates the average latency observed due to re-authentication. |
Milliseconds |
A very low value is required for this measure.
|
|
Number of requests sent |
Indicates the average number of sent requests. |
Requests/sec |
|
|
Number of responses sent |
Indicates the average number of received responses. |
Responses/sec |
|
|
Select rate |
Indicates the number of times the I/O layer checked for new I/O to perform. |
Number/sec |
|
