Storm Owner Resources Test

This test monitors the resources utilized by the users (owners) that includes total number of topologies, executors, workers and tasks completed by the owners in the target Apache Storm. Using this test, administrators would be able to identify the number of used CPU cores, the total memory used by the CPU and the heap/off-heap memory assigned to the owners. Any abnormal condition in the resource usage will alert the administrators to take preventive action against the abnormality.

Target of the test : Apache Storm

Agent deploying the test : An internal/remote agent

Outputs of the test : One set of results for each owner (user) in the target Apache Storm.

Configurable parameters for the test
Parameter Description

Test period

How often should the test be executed.

Host

The IP address of the target server that is being monitored.

Port

The port number through which the Apache Storm communicates. The default port is 8080.

SSL

By default, the SSL flag is set to No, indicating that the target Apache Storm is not SSL-enabled by default. To enable the test to connect to an SSL-enabled Apache Storm, set the SSL flag to Yes.

Measurements made by the test
Measurement Description Measurement Unit Interpretation

Total topologies

Indicates the total number of topologies used by this owner.

Number

 

Total executors

Indicates the total number of executors used by this owner.

Number

 

Total workers

Indicates the total number of worker nodes used by this owner.

Number

 

Total tasks

Indicates the total number of tasks completed by this owner.

Number

A very high value is required for this measure.

Total requested memory

Indicates the total size of memory requested by this owner.

MB

 

Total memory usage

Indicates the total size of memory used by this owner.

MB

A very low value is required for this measure.

Total requested CPU core

Indicates the total number of CPU cores requested by this owner.

Number

 

Total CPU core usage

Indicates the total number of CPU cores used by this owner.

Number

A very low value is required for this measure.

Memory guarantee

Indicates the size of memory guaranteed for this owner.

MB

 

Memory remaining guarantee

Indicates the size of memory remain guaranteed for this owner.

MB

 

CPU core guarantee

Indicates the number of CPU cores guaranteed for this owner.

Number

Reservation specifies the guaranteed reservation for CPU cores. The Apache Storm server will execute a comfortable data processing only if the CPU and memory reservation is available.

CPU core remaining guarantee

Indicates the number of CPU cores remain guaranteed for this owner.

Number

 

Isolated nodes

Indicates the number of isolated nodes for this owner.

Number

 

Total Requested on heap memory

Indicates the total size of heap memory requested by this owner.

MB

 

Total assigned on heap memory

Indicates the total size of heap memory assigned to this owner.

MB

As a rule of thumb, there should be enough heap memory to address data processing. If the heap memory is high, then it leads to garbage collection.

Total requested off heap memory

Indicates the total size of off-heap memory requested by this owner.

MB

 

Total assigned off heap memory

Indicates the total size of off-heap memory assigned to this owner.

MB

If there is no off -heap memory, then you will be unable to perform the data processing. To avoid this, it would be good practice to allocate adequate off-heap memory.