Course Introduction
  • Important Pre-Requisites
  • Course Objectives
  • Course Structure
  • About Your Instructor
Code Download
  • Code Download
Kafka Connect Concepts
  • What is Kafka Connect?
  • Kafka Connect Architecture Design
  • Connectors, Configuration, Tasks, Workers
  • Standalone vs Distributed Mode
  • Distributed Architecture in Details
Setup and Launch Kafka Connect Cluster
  • Important information about installation
  • Docker on Mac (recent versions)
  • Docker Toolbox on Mac (older versions)
  • Docker on Linux (Ubuntu as an example)
  • Docker on Windows 10 64bit
  • Docker Toolbox on Windows (older versions)
  • Important note for Docker Toolbox users
  • Starting Kafka Connect Cluster using Docker Compose
Troubleshooting Kafka Connect
  • It's not working! What to do?
  • Where to view logs?
  • Asking a question in the Q&A
Kafka Connect Source - Hands On
  • Kafka Connect Source Architecture Design
  • FileStream Source Connector - Standalone Mode - Part 1
  • FileStream Source Connector - Standalone Mode - Part 2
  • FileStream Source Connector - Distributed Mode
  • List of Available Connectors
  • Twitter Source Connector - Distributed Mode - Part 1
  • Twitter Source Connector - Distributed Mode - Part 2
  • Section Summary
Kafka Connect Sink - Hands On
  • Kafka Connect Sink Architecture Design
  • ElasticSearch Sink Connector - Distributed Mode - Part 1
  • ElasticSearch Sink Connector - Distributed Mode - Part 2
  • Kafka Connect REST API
  • JDBC Sink Connector - Distributed Mode
Writing your own Kafka Connector
  • Goal of the section: GitHubSourceConnector
  • Finding the code and installing required software
  • Description of the GitHub Issues API
  • Using the Maven Archetype to get started
  • Config Definitions
  • Connector Class
  • Writing a schema
  • Data Model for our Objects
  • Writing our GitHub API HTTP Client
  • Source Partition & Source Offsets
  • Source Task
  • Building and running a Connector in Standalone Mode
  • Command for next lecture
  • Deploying our Connector on the Landoop cluster
  • More Resources for Developers
Advanced Concepts
  • Setting up Kafka Connect in Production (1/2)
  • Setting up Kafka Connect in Production (2/2)
  • What's next?
  • Congratulations and Thank you!
  • THANK YOU!
  • Bonus Lecture