Ignite Persistence Test

Ignite Persistence, or Native Persistence, is a set of features designed to provide persistent storage. When it is enabled, Ignite always stores all the data on disk, and loads as much data as it can into RAM for processing.

Persistence ensures that all the data in the RAM is backed-up and can be used if the cache fails or for distribution to downstream systems. That is the reason it is important to regularly monitor persistence, so that administrator have full idea if there is any issue and can re-mediate in timely manner.

This tests monitors the persistence storage and collects key metrics like- Memory allocated size, Write-Ahead Logging archive segments, page reads etc, which can help administrator make informed decisions about storage's health.

Target of the test : Apache Ignite Server

Agent deploying the test : An internal or external agent

Outputs of the test : One set of results for each Apache Ignite Server

Configurable parameters for the test

Parameter

Description

Test period

How often should the test be executed.

Host

Enter the IP address of the Apache Ignite cluster.

Port

Enter the port number on which JMX connector listens to incoming connections requests.

JMX Remote Port

In this text box, enter the name of a virtual warehouse that needs to be monitored. The JMX connector listens on 8686 by default. If it listens on different port in your environment then specify the same.

JMX User

Specify the credentials of the user who is authorized to use JMX.

JMX Password

Specify the password for the authorized user.

Confirm Password

Confirm the password by retyping it here.

Measurements made by the test

Measurement

Description

Measurement Unit

Interpretation

Pages read

Indicates the number of pages read since last restart.

Number

 

Pages replaced

Indicates the number of pages replaced since last restart.

Number

Too many pages replaced may not be ideal for performance.

Pages written

Indicates the number of pages written since last restart.

Number

 

Dirty pages

Indicates the number of pages in memory that have been changed but not yet synchronized to disk. Those will be written to disk during next checkpoint.

Number

If the number of dirty pages is too high, it is too risky if the cache goes down there will be high data loss.

Used checkpoint buffer page

Indicates the total number of checkpoint buffer pages used since last restart.

Number

 

Off-heap size

Indicates the total memory in MB allocated in off-heap cache.

MB

Off-heap storage doesn't have memory management so it is fast, but the allocation should be optimal.

Off-heap used size

Indicates the total memory in MB used in off-heap cache.

MB

 

Checkpoint buffer size

Indicates the total size of checkpoint buffer.

MB

A low value is desired for this measure.

Used checkpoint buffer size

Indicates the total size of checkpoint buffer which is currently in use.

MB

You need to take an action if the used checkpoint reaches near the total size of checkpoint buffer.

Last checkpoint duration

Indicates the total time it took to create the last checkpoint.

Seconds

 

Total allocated size

Indicates the size of the space allocated on disk for the entire data storage (in MB). Note that when Native persistence is disabled, this metric shows the total size of the allocated space in RAM.

MB

This metrics should be actively monitored and administrators should ensure that there is always enough memory available to support the applications and users.

Write-Ahead Logging archive segments

Indicates the number of WAL segments in the archive.

Number

The write ahead logs should be actively manages and cleared when not required.

Write-Ahead Logging buffer poll spins rate

Indicates the WAL buffer poll spins number over the last time interval.

Number/sec

 

Write-Ahead Logging fsync time average

Indicates the total duration of write-ahead logging fsync.

Microseconds

 

Write-Ahead Logging log rate

Indicate the average number of WAL records per second written during the last time interval

Records /sec

 

Write-Ahead Logging total size

Indicates the total size of the WAL files in MB, including the WAL archive files.

MB

The write ahead log size should be optimal for the performance of the system.

Write-Ahead Logging write rate

Indicates the average number of MB per second written during the last time interval.

MB/sec

Ideally this number should be high, but if the write rate is going down over ht measurements then it may be a matter of concern.