My First Petabyte Scale Architecture
Lecturer: Omid Vahdaty 6.9.2023
In this lecture, I will teach you the principles of how to build a big data architecture that stores and processes 1 PB worth of data using different technologies (Redshift, Databricks, BigQuery, SQream).
What will you learn?
1. Challenges with such a big data scale.
2. Consideration set of the use case.
3. The architecture of each technology, relevant features for the use case, and pro/cons analysis.
4. Cost estimation.
5. Performance challenges.
Lecturer: Omid Vahdaty, CTO at Jutomate, a company that specializes in end-to-end data solutions
Part 1
Video
Slides
Part 2
Video
Slides
Part 3
Video
Slides
——————————————————————————————————————————
I put a lot of thoughts into these blogs, so I could share the information in a clear and useful way.
If you have any comments, thoughts, questions, or you need someone to consult with,
feel free to contact me via LinkedIn – Omid Vahdaty: