Data Architecture 101: The Lambda Strategy

2024 ж. 14 Мам.
5 880 Рет қаралды

A huge decision for any data team is how often to refresh data.
While the most common approach is simply running on a batch (hourly, daily, etc.)...
Sometimes that's just not fast enough.
Sometimes there's data you'd rather get access to in near-real time.
But how can you make that happen?
There are a handful of ways to go about it, but in this video I want to break down one approach known as The Lambda Strategy.
When done right, it can unlock both batch & streaming capabilities for your architecture.
So by the end of this video, you'll learn what this strategy is about and whether or not it makes sense for your team.
Enjoy!
►► The Starter Guide for The Modern Data Stack (Free PDF)
Simplify the “modern” data stack + better understand common tools & components → bit.ly/starter-mds
Timestamps:
0:00 - Intro
0:35 - What is The Lambda Approach?
1:33 - Things to Consider
2:46 - Examples (w/ tools)
Title & Tags:
Data Architecture 101: The Lambda Strategy
#kahandatasolutions #dataengineering #dataarchitecture

Пікірлер
  • ►► Setup your own playground modern data stack for free in 1 hour → www.kahandatasolutions.com/jumpstart

    @KahanDataSolutions@KahanDataSolutions4 ай бұрын
  • Please share more about delta architecture.

    @hungnguyenthanh4101@hungnguyenthanh41018 ай бұрын
  • Thanks nice addition to the architecture video series ! Like how you split content of your vids into archi, methodology/management and hands-on.

    @julienjulien9801@julienjulien98018 ай бұрын
    • Glad you enjoyed it!

      @KahanDataSolutions@KahanDataSolutions8 ай бұрын
  • Nice video! Seeing a lot of companies go this route these days.

    @nicky_rads@nicky_rads8 ай бұрын
  • Hey, I would love to see a video doing these process

    @moverecursus1337@moverecursus13372 ай бұрын
  • Thanks for the series, it is very informative.

    @idris.adebisi@idris.adebisi7 ай бұрын
    • You bet - thanks for watching

      @KahanDataSolutions@KahanDataSolutions7 ай бұрын
  • First! Already know this is gonna be a good one!

    @summer_xo@summer_xo8 ай бұрын
  • amazing

    @Levy957@Levy9578 ай бұрын
KZhead