2022-12-09

Snowflake Resource Management with Terraform

Data Engineering

Snowflake

Terraform

Snowflake Resource Management with Terraform

Snowflake resources can be managed using Terraform. The specific resources that can be managed are as follows:

Database
Schema
Warehouse
Stage
Role
User
Snowpipe

Creating Tasks by Reading SQL from Files

For resources that Terraform does not provide out-of-the-box, you can read SQL files to handle them.

task.tf

resource "snowflake_task" "serverless_task" {
  comment = "my serverless task"

  database = "EXIST_DB"
  schema   = "EXIST_SCHEMA"

  name          = "SERVERLESS_TASK"
  schedule      = "10 MINUTE"
  sql_statement = file("./task.sql")

  enabled = false
}

task.sql

select 1
;

Terraform also provides the templatefile function to pass variables to SQL statements from Terraform.

Executing CI/CD

By executing Terraform in tools like GitHub Actions, you can automate the changes to Snowflake resources. For example, you can automate the following:

Snowflake Resource Management with Terraform

Snowflake Resource Management with Terraform

Creating Tasks by Reading SQL from Files

Executing CI/CD

References

Machine Learning in Snowflake

Stored Procedures vs. UDFs in Snowflake

Ryusei Kakujo