Hive Execution Engine Test
An Execution Engine is used to communicate with Hadoop daemons such as Name node, Data nodes, and job tracker to execute the Hive query on top of Hadoop file system. It executes the execution plan created by the compiler. This test reports the number of tasks executed by the engines namely Mapreduce, Spark and Tez in the target Apache Hive and helps the administrators to sort out which engine is imposing the maximum load on the Apache Hive data warehouse.
Target of the test : Apache Hive
Agent deploying the test : An internal/remote agent
Outputs of the test : One set of results for the target Apache Hive
Parameter | Description |
---|---|
Test period |
How often should the test be executed. |
Host |
The IP address of the target server that is being monitored. |
Port |
The port number through which the Apache Hive communicates. The default port is 10002. |
SSL |
By default, the SSL flag is set to False, indicating that the target Apache Hive is not SSL-enabled by default. To enable the test to connect to an SSL-enabled Apache Hive, set the SSL flag to True. |
DD Frequency |
Refers to the frequency with which detailed diagnosis measures are to be generated for this test. The default is 1:1. This indicates that, by default, detailed measures will be generated every time the test runs, and also every time the test detects a problem. You can modify this frequency, if you so desire. Also, if you intend to disable the detailed diagnosis capability for this test, you can do so by specifying none against DD Frequency. |
Measurement | Description | Measurement Unit | Interpretation |
---|---|---|---|
Mapreduce tasks |
Indicates the total number of MapReduce tasks that are currently running on Apache Hive. |
Number |
Compare the value of this measure across other tasks to know which task is imposing the maximum load on the Apache Hive data warehouse. |
Spark tasks |
Indicates the total number of Spark tasks that are currently running on Apache Hive. |
Number |
|
Tez tasks |
Indicates the total number of Tez tasks that are currently running on Apache Hive. |
Number |
|