DBT - Data Build Tool

Introduction

• Difference between ETL and ELT
• What is DBT
• What is DBT Cloud
• Essential steps in the development of data pipelines
• Need for ELT templatization
• Pre-requisites, installing DBT and configuring a DBT project.
• Discussion on supporting databases
• Creating a Snowflake account and creating needed database objects
• Introduction to Jinja

Project files and folders

• Familiarizing with existing files and folders
• Compiler, Runner, Package manager
• Communication between the files and folders
• Configure and run a simple job

Understanding git

• Whisare git desktop, git server, GitHub and GitLab
• Download, Install, and configure the git for the DBT directory
• Practicing add, status, commit, and git log
• Working with branches
• Working with git on-premise
• Understanding and working with GitHub
• practicing add, push, and pull requests for GitHub

Working with Models

• Types of materialization

               - Table

               - View

               - Incremental

               - Ephemeral

          Working with configurations

          Working with variables

          Running the models by giving the values for the variables

Performing data testing

• Advantages of the Test feature
• Working with basic tests and tests folder
• Unique, not null, and relationship/or references
• Running the DBT tests
• Wring the custom tests

Working with DBT Cloud