Storm Cluster Test

Apache storm cluster is similar to the Hadoop cluster but Storm use topologies instead of MapReduce jobs. In the storm, the topology needs to be terminated otherwise it will run forever unlike MapReduce jobs. Apache storm cluster will have one master node and many worker nodes. Apache Storm uses an internal distributed messaging system for the communication between nimbus and supervisors. Nimbus is a master node of Storm cluster and all other nodes in the cluster are called as worker nodes.

This test reports the number of supervisors, topologies, executors in the Storm cluster and the number of tasks completed by the cluster. Using this test, administrators would be able to identify the number of available CPU cores, the total memory used by the CPU and the available worker slots that are currently existing in the Storm cluster of the target Apache Storm. Any high usage of the CPU memory will alert the administrators to take remedial measures.

Target of the test : Apache Storm

Agent deploying the test : An internal/remote agent

Outputs of the test : One set of results for the target Apache Storm.

Configurable parameters for the test
Parameter Description

Test period

How often should the test be executed.

Host

The IP address of the target server that is being monitored.

Port

The port number through which the Apache Storm communicates. The default port is 8080.

SSL

By default, the SSL flag is set to No, indicating that the target Apache Storm is not SSL-enabled by default. To enable the test to connect to an SSL-enabled Apache Storm, set the SSL flag to Yes.

Measurements made by the test
Measurement Description Measurement Unit Interpretation

Supervisors

Indicates the number of supervisors in the Storm cluster.

Number

 

Topologies

Indicates the number of topologies in the Storm cluster.

Number

 

Total executors

Indicates the number of total executors in the Storm cluster.

Number

 

Total tasks

Indicates the number of total tasks executed by the Storm cluster.

Number

A very high value is required for this measure.

Total memory

Indicates the total size of memory in the Storm cluster.

MB

 

Available memory

Indicates the size of available memory in the Storm cluster.

MB

A very high value is required for this measure.

Used memory

Indicates the size of used memory in the Storm cluster.

MB

A value close to the Total memory measure indicates that the memory resources are depleting rapidly.

Available memory percentage

Indicates the percentage of available memory in the Storm cluster.

Percent

A value close to 100% is required for this measure.

Total CPU core

Indicates the total number of CPU cores in the Storm cluster.

Number

 

Available CPU core

Indicates the number of available CPU cores in the Storm cluster.

Number

A very high value is required for this measure.

Used CPU core

Indicates the number used CPU cores in the Storm cluster.

Number

A very low value is required for this measure.

Available CPU percentage

Indicates the percentage of available CPU from the total CPU.

Percent

A value close to 100% is required for this measure.

Total slots

Indicates the total number of worker slots in the Storm cluster.

Number

 

Used slots

Indicates the number of used worker slots in the Storm cluster.

Number

A very high value is required for this measure.

Free slots

Indicates the number of free worker slots in the Storm cluster.

Number

A very low value is required for this measure.

Used slots percentage

Indicates the percentage of used worker slots in the Storm cluster.

Percent

A value close to 100% is required for this measure.