How to Sync PostgreSQL Data w/ Airbyte

2024 ж. 14 Мам.
5 779 Рет қаралды

One of the most common data sources in data architectures is a PostgreSQL database.
It might be the backend of an internal application or used by a third party tool.
Therefore, it's really important to be able to easily extract data from this source in an efficient way.
So in today's video, you're going to see how you can do this by setting up a Postgres connector using Airbyte.
We're going to cover:
- Step by step how to configure it
- Different options for extracting the data (ex. CDC)
- Performance considerations when dealing with really large data sets
Enjoy!
►► The Starter Guide for The Modern Data Stack (Free PDF)
Simplify the “modern” data stack + better understand common tools & components → bit.ly/starter-mds
Timestamps:
00:00 - Intro
00:35 - What is Airbyte?
01:32 - Configure PostgreSQL
02:46 - Setup Source Connector
04:39 - Enable Change Data Capture
07:34 - Create Connection to BigQuery
08:46 - Performance w/ Airbyte & PostgreSQL
10:03 - Review Results in BigQuery
Title & Tags:
How to Sync PostgreSQL Data w/ Airbyte
#kahandatasolutions #dataengineering #Airbyte

Пікірлер
  • ►► Setup your own playground modern data stack for free in 1 hour → www.kahandatasolutions.com/jumpstart

    @KahanDataSolutions@KahanDataSolutions7 ай бұрын
  • I did this yesterday and today this video poped up. Looks like we have some connections. Spiritual 😅

    @abiddeveloper1@abiddeveloper17 ай бұрын
KZhead