Hive Execution Engine Test

An Execution Engine is used to communicate with Hadoop daemons such as Name node, Data nodes, and job tracker to execute the Hive query on top of Hadoop file system. It executes the execution plan created by the compiler. This test reports the number of tasks executed by the engines namely Mapreduce, Spark and Tez in the target Apache Hive and helps the administrators to sort out which engine is imposing the maximum load on the Apache Hive data warehouse.

Target of the test : Apache Hive

Agent deploying the test : An internal/remote agent

Outputs of the test : One set of results for the target Apache Hive

Configurable parameters for the test
Parameter Description

Test period

How often should the test be executed.

Host

The IP address of the target server that is being monitored.

Port

The port number through which the Apache Hive communicates. The default port is 10002.

SSL

By default, the SSL flag is set to False, indicating that the target Apache Hive is not SSL-enabled by default. To enable the test to connect to an SSL-enabled Apache Hive, set the SSL flag to True.

DD Frequency

Refers to the frequency with which detailed diagnosis measures are to be generated for this test. The default is 1:1. This indicates that, by default, detailed measures will be generated every time the test runs, and also every time the test detects a problem. You can modify this frequency, if you so desire. Also, if you intend to disable the detailed diagnosis capability for this test, you can do so by specifying none against DD Frequency.

Measurements made by the test
Measurement Description Measurement Unit Interpretation

Mapreduce tasks

Indicates the total number of MapReduce tasks that are currently running on Apache Hive.

Number

Compare the value of this measure across other tasks to know which task is imposing the maximum load on the Apache Hive data warehouse.

Spark tasks

Indicates the total number of Spark tasks that are currently running on Apache Hive.

Number

 

Tez tasks

Indicates the total number of Tez tasks that are currently running on Apache Hive.

Number