Snowflake Credit Usage by Pipes Test

Snowpipe enables loading data from files as soon as they’re available in a stage. This means you can load data from files in micro-batches, making it available to users within minutes, rather than manually executing COPY statements on a schedule to load larger batches. Snowflake provides and manages the compute resources, automatically growing or shrinking capacity based on the current Snowpipe load. Accounts are charged based on their actual compute resource usage; in contrast with customer-managed virtual warehouses, which consume credits when active, and may sit idle or be overutilized. This makes it difficult to predict the credit usage of snowpipes for data load. eG Enterprise makes it possible for administrators to monitor the usage of snowpipes in real-time so that there are no surprises in billing.

This test monitors the usage of Snowpipes and collects credit usage-related metrics as files and bytes are inserted and credits used.

Target of the test : Snowflake Database server

Agent deploying the test : A remote agent

Outputs of the test : One set of results for each Snowflake pipes present in the service account being monitored.

Configurable parameters for the test

Parameter	Description
Test period	How often should the test be executed.
Host	The IP address of the Snowflake.
Port	The port number through which the snowflake database server communicates. The default port is 443.
Warehouse Name	In this text box, enter the name of a virtual warehouse that needs to be monitored.
Database Name	In this text box, enter the name of a default database that will connect the snowflake server.
User	Specify the name of the user who has any of the following privileges to the specified.
Password	The password of the specified USER.
Confirm Password	Confirm the password by retyping it here.

Measurements made by the test

Measurement	Description	Measurement Unit	Interpretation
Total credits used	Indicates the total number of credits used by pipes during the last measurement period.	Number
Average credits used	Indicates the average credits used by pipes.	Number	A high value of this measure is the cause for concern. Detailed diagnosis of this measure will indicate error details.
Credits used rate	Indicates the rate at which credits were consumed during the last measurement period.	Credits / Second
Total bytes inserted	Indicates the data inserted by pipes in the last measurement period.	MB
Average bytes inserted	Indicates the data inserted by pipes in the last measurement period.	MB
Total files inserted	Indicates the total number of files inserted by pipes during the last measurement period.	Number
Average files inserted	Indicates the average number of files inserted by pipes in one measurement period.	Number