Apache Kafka Consumer layer
Using the tests associated with the Apache Kafka Consumer layer (see Figure 1), you can monitor the following:
-
Number of active broker's connections to the consumer and new connections established per second.
-
Connections that failed during authentication/re-authentication process.
-
Average latency observed due to re-authentication.
-
Average number of requests sent to the broker per second.
-
Average number of responses received from the broker per second.
-
Number of current and end offsets .
-
Number of lags between Kafka producers and consumers.
-
Percentage of lags between Kafka producers and consumers.
Figure 1 : The list of tests associated with the Apache Kafka Consumer layer