Storm Cluster Test
Apache storm cluster is similar to the Hadoop cluster but Storm use topologies instead of MapReduce jobs. In the storm, the topology needs to be terminated otherwise it will run forever unlike MapReduce jobs. Apache storm cluster will have one master node and many worker nodes. Apache Storm uses an internal distributed messaging system for the communication between nimbus and supervisors. Nimbus is a master node of Storm cluster and all other nodes in the cluster are called as worker nodes.
This test reports the number of supervisors, topologies, executors in the Storm cluster and the number of tasks completed by the cluster. Using this test, administrators would be able to identify the number of available CPU cores, the total memory used by the CPU and the available worker slots that are currently existing in the Storm cluster of the target Apache Storm. Any high usage of the CPU memory will alert the administrators to take remedial measures.
Target of the test : Apache Storm
Agent deploying the test : An internal/remote agent
Outputs of the test : One set of results for the target Apache Storm.
| Parameter | Description |
|---|---|
|
Test period |
How often should the test be executed. |
|
Host |
The IP address of the target server that is being monitored. |
|
Port |
The port number through which the Apache Storm communicates. The default port is 8080. |
|
SSL |
By default, the SSL flag is set to No, indicating that the target Apache Storm is not SSL-enabled by default. To enable the test to connect to an SSL-enabled Apache Storm, set the SSL flag to Yes. |
| Measurement | Description | Measurement Unit | Interpretation |
|---|---|---|---|
|
Supervisors |
Indicates the number of supervisors in the Storm cluster. |
Number |
|
|
Topologies |
Indicates the number of topologies in the Storm cluster. |
Number |
|
|
Total executors |
Indicates the number of total executors in the Storm cluster. |
Number |
|
|
Total tasks |
Indicates the number of total tasks executed by the Storm cluster. |
Number |
A very high value is required for this measure. |
|
Total memory |
Indicates the total size of memory in the Storm cluster. |
MB |
|
|
Available memory |
Indicates the size of available memory in the Storm cluster. |
MB |
A very high value is required for this measure. |
|
Used memory |
Indicates the size of used memory in the Storm cluster. |
MB |
A value close to the Total memory measure indicates that the memory resources are depleting rapidly. |
|
Available memory percentage |
Indicates the percentage of available memory in the Storm cluster. |
Percent |
A value close to 100% is required for this measure. |
|
Total CPU core |
Indicates the total number of CPU cores in the Storm cluster. |
Number |
|
|
Available CPU core |
Indicates the number of available CPU cores in the Storm cluster. |
Number |
A very high value is required for this measure. |
|
Used CPU core |
Indicates the number used CPU cores in the Storm cluster. |
Number |
A very low value is required for this measure. |
|
Available CPU percentage |
Indicates the percentage of available CPU from the total CPU. |
Percent |
A value close to 100% is required for this measure. |
|
Total slots |
Indicates the total number of worker slots in the Storm cluster. |
Number |
|
|
Used slots |
Indicates the number of used worker slots in the Storm cluster. |
Number |
A very high value is required for this measure. |
|
Free slots |
Indicates the number of free worker slots in the Storm cluster. |
Number |
A very low value is required for this measure. |
|
Used slots percentage |
Indicates the percentage of used worker slots in the Storm cluster. |
Percent |
A value close to 100% is required for this measure. |
