Google Cloud Filestore Test

Filestore instances are fully managed NFS file servers on Google Cloud for use with applications running on Compute Engine virtual machine (VM) instances, Google Kubernetes Engine clusters, external datastores such as Google Cloud VMware Engine, or your on-premises machines. The Filestore offers the following benefits:

Managed Service : Google Cloud Filestore is a fully managed service that handles the provisioning, scaling, and maintenance of the underlying infrastructure, allowing you to focus on the applications.

High Performance : Filestore provides high-performance file storage with low latency and high throughput, suitable for a wide range of workloads, including data-intensive applications.

NFSv3 and SMB Support : Filestore supports both the Network File System (NFS) version 3 protocol and the Server Message Block (SMB) protocol, making it compatible with a variety of operating systems and applications.

High Scale : Filestore offers low latency storage operations for applications. For workloads that are latency sensitive, like high performance computing, data analytics, or other metadata intensive applications, Filestore supports capacity up to 100 TB and throughput of 25 GB/s and 920K IOPS.

Snapshots and Backups : Filestore allows you to create snapshots of your file shares for data protection and disaster recovery purposes. You can also export snapshots to Cloud Storage for long-term archival.

Security and Access Control: Filestore provides features for securing your file shares, including VPC Service Controls, encryption at rest, and Identity and Access Management (IAM) for fine-grained access control.

Scalability : Filestore allows you to dynamically scale your file shares up or down to accommodate changing storage requirements and workload demands.

For a Filestore instance to perform effectively, adequate disk space should be allocated to the Filestore. Periodical monitoring of the Filestore instances for the space usage of each of the instance is mandatory to identify probable space contentions which may indirectly slowdown the performance of the instances and the applications that depend on those instances. This is why you need the Google Cloud Filestore test!

This test auto-discovers the Filestore instances on the Google Cloud, and for each instance, reports its current state. This reveals how well the read and write operations were performed by each Filestore instance. In the process, this test also reports statistics related to disk space utilization. In addition, this test measures the latency while performing the read and write operations. This revelation sheds light on the processing delays, if any, and enables administrators to take necessary actions immediately.

Note:

This test will report metrics only if the Cloud Filestore API is enabled in the target Google Cloud project. If you want to know how to turn on a service API in the Google Cloud project, refer Enabling Service APIs.

Target of the test : Google Cloud

Agent deploying the test : A remote agent

Outputs of the test : One set of results for each Filestore instance on the target Google Cloud

Configurable parameters for the test
Parameters Description

Test Period

How often should the test be executed. By default, this is set to 180 minutes.

Host

The host for which the test is to be configured.

Get Location Mints

Specify the maximum time duration in minutes within which this test should connect to the instances across the various regions and report metrics. By default, this parameter is set to 60 minutes.

Private Keyfile Name

To connect to the Google Cloud Project in which the services are running, the eG agent requires a private key of a service account with Compute Viewer, Monitoring Viewer, and Cloud Asset Viewer roles in the target project. If a service account pre-exists in the project, then you can download the private key as a JSON file. Save this JSON file in the <eG_Install_Dir>/agent/lib folder and provide the name of that file against this parameter. However, if no such service account pre-exists, you will have to create one for monitoring the project. To know how to create a service account and download its private key, refer to How does eG Enterprise Monitor Google Cloud?.

Detailed Diagnosis

To make diagnosis more efficient and accurate, the eG Enterprise embeds an optional detailed diagnostic capability. With this capability, the eG agents can be configured to run detailed, more elaborate tests as and when specific problems are detected. To enable the detailed diagnosis capability of this test for a particular server, choose the On option. To disable the capability, click on the Off option.

The option to selectively enable/disable the detailed diagnosis capability will be available only if the following conditions are fulfilled:

  • The eG manager license should allow the detailed diagnosis capability
  • Both the normal and abnormal frequencies configured for the detailed diagnosis measures should not be 0.
Measurements made by the test
Measurement Description Measurement Unit Interpretation

Status

Indicates the current status of this Filestore instance.

 

The values reported by this measure and its numeric equivalents are mentioned in the table below:

Measure Value

Numeric Value
Unknown 0
Creating 1
Ready 2
Repairing 3
Deleting 4
Resuming 5
Restoring 6
Suspended 7
Suspending 8
Error 9

Note:

By default, this measure reports the Measure Values listed in the table above to indicate the current status of each Filestore instance. In the graph of this measure however, the same is represented using the corresponding numeric equivalents only.

Maximum capacity

Indicates maximum amount of space that can be provisioned to this Filestore instance.

GB

 

Disk capacity

Indicates the amount of disk space allocated for this Filestore instance.

GB

 

Average read latency

Indicates the average time taken by this Filestore instance to process read requests during the last measurement period.

Seconds

Ideally, the values of these measures should be very low.

By comparing the values of these measures, administrators can figure out where the slowness is maximum - when processing read requests? or write requests?

Average write latency

Indicates the average time taken by this Filestore instance to process write requests during the last measurement period.

Seconds

Free disk space

Indicates the amount of disk space that is available for use in this Filestore instance.

GB

A high value is desired for this measure. A very low value for this measure indicates that the Filestore instance is currently running out of space.

Free disk space percentage

Indicates the percentage of disk space that is available for use in this Filestore instance.

Percent

 

Metadata operations count

Indicates the number of metadata operations performed in this Filestore instance.

Number

 

Procedure call count

Indicates the number of procedure calls made by this Filestore instance.

Number

 

Bytes read

Indicates the amount of bytes that this instance read from the disk during the last measurement period.

MB

By comparing the value of this measure across the Filestore instances, you can find out which instance read maximum amount of bytes.

Bytes written

Indicates the amount of bytes that this instance wrote on this instance during the last measurement period.

MB

By comparing the value of this measure across the Filestore instances, you can find out which instance maximum amount of bytes.

Time spent on read operations

Indicates the time taken by this instance to perform read operations on the disk during the last measurement period.

Seconds

Compare the value of this measure across the Filestore instances to identify the instance that spent maximum time to perform read operations.

Time spent on write operations

Indicates the time taken by this instance to perform write operations on the disk during the last measurement period.

Seconds

Compare the value of this measure across the Filestore instances to identify the instance that spent maximum time to perform write operations.

Disk read operation count

Indicates the number of read operations performed on the disk by this instance.

Number

Comparing the value of this measure reveals the Filestore instance that performed maximum number of read operations on the disk.

Disk write operation count

Indicates the number of write operations performed on the disk by this instance.

Number

 

Used disk space

Indicates the amount of disk space used by this instance.

MB

A low value is preferred for this measure.

Compare the value of this measure across the Filestore instances to identify the instance that is being over utilized.

Disk space utilization

Indicates the percentage of disk space used by this instance.

Percent

When the utilization of the disk space is close to 100%, many applications using the Filestore instance on the cloud could begin to experience failures. Therefore, ensure that adequate disk space is always available to the Filestore instance.