Introduction to Data Engineering
  • What is Data Engineering?
  • Data Engineering Processes - Part 1
  • Data Engineering Processes - Part 2
  • Batch Processing v/s Stream Processing
  • ETL v/s ELT
  • Data Lake v/s Data Warehouse
  • Change Data Capture
Introduction to Kestra
  • Kestra: Orchestration Platform for Engineers
  • Kestra UI Overview
  • Flows and Tasks
  • Namespaces
Kestra Architecture and Installation
  • Kestra Architecture
  • Installing Kestra using Docker Compose
  • Other Kestra Installations
ETL using Kestra
  • Flow Architecture
  • Installing Postgres and MongoDB
  • Installing Kestra with Secrets
  • Flow Creation - HTTP Download
  • Flow Creation - Using Postgres Plugin
  • Flow Creation - Query Postgres and Upload Data to MongoDB
  • Outputs and Metrics
  • Plugin Defaults
Kestra Triggers
  • Introduction to Triggers
  • Triggers in Action
Kestra Industry Adoption
  • Kestra Plugins
  • Kestra Adoption