Kafka Producer Test
A Kafka Producer publishes or writes data to the topics within different partitions. Producers automatically know that, what data should be written to which partition and broker. The user does not require to specify the broker and the partition.
This test monitors the broker's connection to the producer and any abnormal connectivity issues can be proactively detected.
Target of the test : Apache Kafka Message System
Agent deploying the test : An internal/remote agent
Outputs of the test : One set of results for the target Apache Kafka Message System.
| Parameter | Description |
|---|---|
|
Test period |
How often should the test be executed. |
|
Host |
The IP address of the target server that is being monitored. |
|
Port |
The port number through which the Apache Kafka Message System communicates. The default port is 9092. |
|
Producer Port |
The port number through which the producer communicates with the broker. |
|
JMX User, JMX Password, and Confirm Password |
These parameters appear only if the Measurement Mode is set to jmx. If JMX requires authentication only (but no security), then ensure that the JMX User and JMX Password parameters are configured with the credentials of a user with read-write access to JMX. |
| Measurement | Description | Measurement Unit | Interpretation |
|---|---|---|---|
|
Average incoming data rate |
Indicates the average incoming data rate for a node. |
MB/Second |
|
|
Network IO rate |
Indicates the average number of network operations (reads or writes) on all connections. |
Operations/sec |
|
|
Average outgoing data rate |
Indicates the average outgoing data rate for a node. |
MB/Second |
|
|
Average produce throttle time |
Indicates the average time a request was throttled by a broker. |
Seconds |
A very low value is required for this measure. |
|
Average reauthentication latency |
Indicates the average latency observed due to re-authentication. |
Milliseconds |
A very low value is required for these measures.
|
|
Record error rate |
Indicates the average number of sent record that resulted in errors. |
Records/sec |
|
|
Average record queue time |
Indicates the average time of record batches spent in the sent buffer. |
Seconds |
|
|
Record retry rate |
Indicates the average number of sent retried record. |
Records/sec |
|
|
Record send rate |
Indicates the average number of sent records. |
Records/sec |
|
|
Average record Size |
Indicates the average record size. |
MB |
|
|
Average records per request |
Indicates the average number of records per request. |
Records/requests |
|
|
Average request latency |
Indicates the average request latency. |
Milliseconds |
A very low value is required for this measure. |
|
Number of requests sent |
Indicates the average number of sent requests. |
Requests/sec |
|
|
Average request size |
Indicates the average record size. |
MB |
|
|
Requests in flight |
Indicates the current number of in-flight requests awaiting a response. |
Number |
A very low value is required for this measure. |
|
Number of responses sent |
Indicates the received responses. |
Responses/sec |
|
|
Select rate |
Indicates the number of times the I/O layer checked for new I/O to perform. |
Number/sec |
|
