Cluster Shared Volume Manager Test

One of the key modules of the CSV file system stack is the CSV Volume Manager. This is the driver that makes sure that the CSVs are showed as local volumes. This driver sits in the volume layer and processes I/O in the Direct mode and/or in the Block Level Redirected I/O Mode.

In Direct Mode, I/O operations from the application on the cluster node can be sent directly to the storage via the Cluster Volume Manager. It therefore, bypasses the NTFS or ReFS volume stack.

In Block Level Redirected I/O Mode, I/O passes through the CSV Volume Manager in the local CSVFS proxy file system stack and is written directly to Disk.sys on the coordinator node.

By closely monitoring the I/O traffic to a CSV Volume Manager, administrators will be able to gauge the level of I/O activity on the corresponding CSV. In the process, overloaded CSVs can be isolated and the nature of I/O traffic contributing to the load - i.e., whether Direct I/O or Block Level Redirected I/O - can be pinpointed. This is exactly what the Cluster Shared Volume Manager test. For each CSV, this test reports the rate of direct and redirected reads and writes to that CSV. This way, the test sheds light on the I/O load on every CSV, pinpoints overloaded CSVs, and thus reveals irregularities in load balancing across CSVs.

Target of the test : A Hyper-V / Hyper-V VDI server running Windows 2012

Agent executing the test : An internal agent

Output of the test : One set of results will be reported for every CSV on the server

Configurable parameters for the test
  1. Test period - How often should the test be executed
  2. Host - The host for which the test is to be configured.
Measurements reported by the test
Measurement Description Measurement Unit Interpretation

Direct read throughput

Indicates the rate at which this CSV reads data from the disk in the Direct I/O Mode.

Kbps

Direct write throughput

Indicates the rate at which this CSV writes data to the disk in the Direct I/O Mode.

Kbps

 

Total direct throughput

Indicates the rate at which this CSV reads data from and writes data to the disk in the Direct I/O Mode.

Kbps

The value of this measure is the sum of the values of the Direct read throughput and Direct write throughput measure.

This is a good indicator of the level of direct I/O activity on a CSV. By comparing the value of this measure across CSVs, you can figure out which CSV is experiencing maximum direct traffic. If this max value is abnormally high for that CSV, you may want to investigate the reasons for the same.

Redirected read throughput

Indicates the rate at which this CSV reads data from the disk by redirecting the I/O to the co-ordinator node via SMB in the Block Level Redirected I/O mode.

Kbps

The technologies that let CSV-enabled volumes operate require one cluster node that's responsible for the coordination of file access. This cluster node is called the coordinator node, with each individual LUN having its own coordinator node.

I/O redirection can also occur if slave nodes in a cluster are unable to access the disk directly. In this case, the CSV Volume Manager on the slave nodes will redirect the I/O to the co-ordinator node via the SMB Client protocol. The coordinator node then processes the redirected I/O it receives using the SMB Server protocol. The Cluster Shared Volume Manager performs this redirection in the Block Level Redirected Redirected Mode only.

From this, we can conclude that for a CSV attached to a slave/non-coordinator node, the value of the Redirected read throughput measure will indicate the rate at which that CSV redirected the read I/Os to the coordinator node and read data from the disk, in the Block Level Redirected I/O Mode.

For a slave/non-coordinator node, the value of the Redirected write throughput measure will represent only the rate at which that CSV redirects write I/Os to the coordinator node and writes data to the disk, in the Block Level Redirected I/O Mode.

For a Coordinator Node on the other hand, these measures denote the rate at which the Coordinator Node services read/write I/Os (as the case may be) redirected to it by all slave nodes, in the Block Level Redirected I/O Mode.

Redirected write throughput

If the node being monitored is a co-ordinator node, then this measure indicates the rate at which this CSV writes data to the physical disk, in the Block Level Redirected I/O Mode. If the node being monitored is a non-coordinator node, then this measure indicates the rate at which this CSV writes data to the disk by redirecting the I/O to the co-ordinator node via SMB, in the Block Level Redirected I/O Mode.

Kbps

Redirected total throughput

Indicates the rate at which this CSV writes data to the disk by redirecting the I/O to the co-ordinator node via SMB, in the Block Level Redirected I/O Mode.

Kbps

This is the sum of the values of the Redirected read throughput and Redirected write throughput measures.

This is a good indicator of the level of redirected I/O activity on a CSV. By comparing the value of this measure across CSVs, you can figure out which CSV is experiencing maximum redirected traffic. If this max value is abnormally high for that CSV, you may want to investigate the reasons for the same.

Read throughput

Indicates the rate at which data was read by this CSV, both directly and via redirection - i.e.,in the Direct I/O and Block Level Redirected I/O modes.

Kbps

This is the sum of the values of the Direct read throughput and Redirected read throughput measures.

Write throughput

Indicates the rate at which data was written by this CSV, both directly and via redirection - i.e.,in the Direct I/O and Block Level Redirected I/O modes.

Kbps

This is the sum of the values of the Direct write throughput and Redirected write throughput measures.

Throughput

Indicates the rate at which data was read and written by this CSV, both directly and via redirection - i.e.,in the Direct I/O and Block Level Redirected I/O modes.

Kbps

This is the sum of the values of the Read throughput and Write throughput measures.

This is a good indicator of the level of I/O activity on a CSV. By comparing the value of this measure across CSVs, you can figure out which CSV is experiencing maximum traffic. If this max value is abnormally high for that CSV, you may want to investigate the reasons for the same.

Direct read rate

Indicates the rate at which this CSV performs disk reads in the Direct I/O Mode.

Reads/Sec

Direct write rate

Indicates the rate at which this CSV performs disk writes in the Direct I/O Mode.

Writes/Sec

 

Total direct IOPS

Indicates the rate at which this CSV performs IOPS in the Direct I/O Mode.

Operations/Sec

This is a good indicator of the level of I/O activity on the CSV in the Direct I/O Mode.

Redirected read rate

If the node being monitored is a co-ordinator node, then this measure indicates the rate at which this CSV reads from the disk, in the Block Level Redirected I/O Mode. If the node being monitored is a non-coordinator node, then this measure indicates the rate at which this CSV reads from the disk by redirecting the read requests to the co-ordinator node via SMB, in the Block Level Redirected I/O Mode.

Reads/Sec

 

Redirected write rate

If the node being monitored is a co-ordinator node, then this measure indicates the rate at which this CSV writes to the disk, in the Block Level Redirected I/O Mode. If the node being monitored is a non-coordinator node, then this measure indicates the rate at which this CSV writes to the disk by redirecting the write requests to the co-ordinator node via SMB, in the Block Level Redirected I/O Mode.

Writes/Sec

 

Total redirected IOPS

Indicates the rate at which I/O reads and writes were performed by this CSV on the disk, in the Block Level Redirected I/O Mode.

Operations/Sec

This is a good indicator of the level of I/O activity in the Block Level Redirected I/O Mode.

Read IOPS

Indicates the rate at which read I/O operations were performed on this CSV, both directly and via redirection - i.e., in the Direct I/O and Block Level Redirected I/O, Modes.

Reads/Sec

The value of this measure is the sum of the values of the Direct read rate and Redirected read rate measures.

Write IOPS

Indicates the rate at which write I/O operations were performed on this CSV, both directly and via redirection - i.e., in the Direct I/O and Block Level Redirected I/O I/O Modes.

Writes/Sec

The value of this measure is the sum of the values of the Direct write rate and Redirected write rate measures.

IOPS

Indicates the rate at which read and write I/O operations were performed on this CSV, both directly and via redirection - i.e., in the Direct I/O and Block Level Redirected I/O.

Operations/Sec

The value of this measure is the sum of the values of the Read IOPS and Write IOPS measures.

This is a good indicator of the level of I/O activity on the CSV.