Name: Orchestrate BigQuery Workloads with Dataform
Availability: InStock
Rating: 4.6 (5878 reviews)

Duration:

16.00 hours

13.0 CPD hours

Overview:

Dataform is a service for data analysts to develop, test, version control, and schedule complex SQL workflows for data transformation in BigQuery. In this course you will explore the components of Dataform core, learn how to define tables and dependencies in SQLX, document BigQuery tables and views, understand BigQuery security settings and how to manage these with Dataform, write assertions, execute SQL workflows, and explore additional advanced use cases.

Description:

Dataform is a service for data analysts to develop, test, version control, and schedule complex SQL workflows for data transformation in BigQuery. In this course you will explore the components of Dataform core, learn how to define tables and dependencies in SQLX, document BigQuery tables and views, understand BigQuery security settings and how to manage these with Dataform, write assertions, execute SQL workflows, and explore additional advanced use cases.

Course Outline:

Module 1 - Dataform Core Components

Topics:

- SQL workflow
- Repositories and workspaces
- Default files and folders
- Compiled graphs
Objectives:

- Understand the components of Dataflow core.
Module 2 - Table Definitions and Dependencies

Topics:

- Declare a data source.
- Create a table.
- Create an incremental table.
- Set partitioning and clustering options.
- Create an empty table.
- Create an external BigLake table.
- Create views and materialized views.
- Define dependencies.
Objectives:

- Create tables and views in BigQuery using Dataform
Module 3 - Document BigQuery Tables and Views

Topics:

- Use column descriptions.
- Use globally defined JavaScript constants.
- Add labels.
Objectives:

- Document BigQuery tables and views.
Activities:

- Lab: Build SQL Workflows with Dependencies in Dataform
Module 4 - BigQuery Security Settings

Topics:

- IAM dataset and table/view access
- Column-level security
- Row-level security
Objectives:

- Understand BigQuery security settings using Dataform
Module 5 - Assertions

Topics:

- Use built-in assertions.
- Create manual assertions.
Objectives:

- Use assertions to validate data in Dataform workflows.
Activities:

- Lab: Work with Assertions and BigQuery Security Settings in Dataform.
Module 6 - SQL Workflow Executions

Topics:

- Dataform code lifecycle.
- What happens during compilation.
- Customize and schedule compilation results.
- Execute workflows (UI, Cloud Scheduler, Cloud Composer).
- Logging and monitoring.
Objectives:

- Execute Dataform SQL workflows in an automated fashion.
Activities:

- Lab: Automate and Monitor SQL Workflow Executions in Dataform
Module 7 - Advanced Use Cases

Topics:

- Create a BigLake table after file upload using Cloud Run functions.
- Build a Machine Learning pipeline with BigQuery ML.
- Work with Slowly Changing Dimensions Type 2.
Objectives:

- Explore additional use cases for Dataform.
Activities:

- Lab: Create a BigLake Table with Dataform Using Cloud Run Functions., Dataform Core Components, Table Definitions and Dependencies, Document BigQuery Tables and Views, BigQuery Security Settings, Assertions, SQL Workflow Executions, Advanced Use Cases

Available Delivery Options for Orchestrate BigQuery Workloads with Dataform

Live Instructor Led Classroom Online (Live Online)
Traditional Instructor Led Classroom training (TILT/ILT)
Delivery at your offices in United Kingdom
Private dedicated course for your staff

How many CPD hours does Orchestrate BigQuery Workloads with Dataform provide?

The 2 day Orchestrate BigQuery Workloads with Dataform course gives you up to 13.0 CPD hours/structured learning hours.

Do you provide training for Orchestrate BigQuery Workloads with Dataform?

Yes, we provide corporate training, dedicated training and closed classes for Orchestrate BigQuery Workloads with Dataform. This can take place anywhere in United Kingdom including London, Manchester, Birmingham, Edinburgh or live online.

What is the duration of Orchestrate BigQuery Workloads with Dataform?

The Orchestrate BigQuery Workloads with Dataform training takes place over 2 day(s), with each day lasting approximately 16.00 hours including breaks.

What other terms do people search for?

Popular related searches include: Orchestrate BigQuery Workloads with Dataform, Data Analysis, OBWD, Google Cloud, vILT

Why are Nexus Human the best provider for Orchestrate BigQuery Workloads with Dataform?

Nexus Human are recognised as one of the best training companies. Our trainers have won awards including Small Firms Best Trainer, national training partner of the year for Ireland, and global top 30 instructor awards in 2012, 2019 and 2021.

Is there a discount code for Orchestrate BigQuery Workloads with Dataform?

Yes, the discount code PENPAL5 is currently available for Orchestrate BigQuery Workloads with Dataform training. Only one discount code can be used per booking.

Orchestrate BigQuery Workloads with Dataform