Storm Owner Resources Test
This test monitors the resources utilized by the users (owners) that includes total number of topologies, executors, workers and tasks completed by the owners in the target Apache Storm. Using this test, administrators would be able to identify the number of used CPU cores, the total memory used by the CPU and the heap/off-heap memory assigned to the owners. Any abnormal condition in the resource usage will alert the administrators to take preventive action against the abnormality.
Target of the test : Apache Storm
Agent deploying the test : An internal/remote agent
Outputs of the test : One set of results for each owner (user) in the target Apache Storm.
Parameter | Description |
---|---|
Test period |
How often should the test be executed. |
Host |
The IP address of the target server that is being monitored. |
Port |
The port number through which the Apache Storm communicates. The default port is 8080. |
SSL |
By default, the SSL flag is set to No, indicating that the target Apache Storm is not SSL-enabled by default. To enable the test to connect to an SSL-enabled Apache Storm, set the SSL flag to Yes. |
Measurement | Description | Measurement Unit | Interpretation |
---|---|---|---|
Total topologies |
Indicates the total number of topologies used by this owner. |
Number |
|
Total executors |
Indicates the total number of executors used by this owner. |
Number |
|
Total workers |
Indicates the total number of worker nodes used by this owner. |
Number |
|
Total tasks |
Indicates the total number of tasks completed by this owner. |
Number |
A very high value is required for this measure. |
Total requested memory |
Indicates the total size of memory requested by this owner. |
MB |
|
Total memory usage |
Indicates the total size of memory used by this owner. |
MB |
A very low value is required for this measure. |
Total requested CPU core |
Indicates the total number of CPU cores requested by this owner. |
Number |
|
Total CPU core usage |
Indicates the total number of CPU cores used by this owner. |
Number |
A very low value is required for this measure. |
Memory guarantee |
Indicates the size of memory guaranteed for this owner. |
MB |
|
Memory remaining guarantee |
Indicates the size of memory remain guaranteed for this owner. |
MB |
|
CPU core guarantee |
Indicates the number of CPU cores guaranteed for this owner. |
Number |
Reservation specifies the guaranteed reservation for CPU cores. The Apache Storm server will execute a comfortable data processing only if the CPU and memory reservation is available. |
CPU core remaining guarantee |
Indicates the number of CPU cores remain guaranteed for this owner. |
Number |
|
Isolated nodes |
Indicates the number of isolated nodes for this owner. |
Number |
|
Total Requested on heap memory |
Indicates the total size of heap memory requested by this owner. |
MB |
|
Total assigned on heap memory |
Indicates the total size of heap memory assigned to this owner. |
MB |
As a rule of thumb, there should be enough heap memory to address data processing. If the heap memory is high, then it leads to garbage collection. |
Total requested off heap memory |
Indicates the total size of off-heap memory requested by this owner. |
MB |
|
Total assigned off heap memory |
Indicates the total size of off-heap memory assigned to this owner. |
MB |
If there is no off -heap memory, then you will be unable to perform the data processing. To avoid this, it would be good practice to allocate adequate off-heap memory. |