architecture

Semantic Layer vs. Metric Layer in Business Intelligence

Semantic Layer vs. Metric Layer in Business Intelligence

Lecturer: Graham Watts, 16.11.2023

Metrics are an emerging type of BI artifact that packages data into a format optimized for consumption by non-technical business users. Over the last few years two types of technologies, the semantic layer and metric layer, have arisen independently. They both support the creation of metrics.

 In this talk, you will learn:

 👉 Which needs do metric and semantic layers address – for data teams and business teams?
👉 What differentiates these technologies and why do they have such similar capabilities?
👉How can these technologies be used together in BI tools to take advantage of the strengths of both?
Speaker: Graham Watts, Senior Software Architect @Klipfolio

Panel Discussion
Thought leaders will discuss the opportunities for data teams and how these technologies will shape the future of BI.

Panelists:
Nick Handel
, Director of Product @dbt Labs Previously Co-Founder and CEO of Transform.
In his early days as a Data Scientist at Airbnb, Nick learned that most businesses were continuing to track the same North Star metrics from the very early days. This observation inspired him to work on a foundation for the revamped dbt Semantic Layer in his days at Transform.

Magnus Dahlbäck, Senior Director Data and Platform @Voi Former Head of Data Engineering at Telia. Magnus is advocating for a new approach to making data-driven decisions: “Metrics are the core of running a data-driven business. However, most data teams continue to overlook this. Instead, there’s too much emphasis on data and dashboards rather than on metrics.”

Graham Watts, Senior Software Architect @Klipfolio As one of the first thought leaders and metric experts in the space, Graham has worked on and helped design the Klipfolio PowerMetrics metrics layer. He’s been a driving force behind building the first hybrid solution that combines the metric and semantic layer.

Video

Slides


——————————————————————————————————————————
I put a lot of thoughts into these blogs, so I could share the information in a clear and useful way.
If you have any comments, thoughts, questions, or you need someone to consult with,

feel free to contact me via LinkedIn – Omid Vahdaty:

architecture

Software 3.0: Software Development in the AI era

Software 3.0: Software Development in the AI era

Lecturer: Dan Leshem 21.9.2023

The landscape of software development is evolving faster than ever before. Join us as we explore the future of software development in the era of AI coding assistants. In this talk, we’ll discover why technical specifications are gaining increasing relevance in 2023 and how AI agents are reshaping the software development life cycle. We’ll then move to a workshop in which each participant will build, deploy, and run their first AI agent.

Language: English

Speaker: Dan Leshem, CTO @ Fine.
A seasoned engineering leader with over 13 years of experience in software development. For the past ten years, Dan has grown successful engineering teams to be problem-solvers first, and programmers later. He believes happy, independent developers drive successful products.

Video

Slides


——————————————————————————————————————————
I put a lot of thoughts into these blogs, so I could share the information in a clear and useful way.
If you have any comments, thoughts, questions, or you need someone to consult with,

feel free to contact me via LinkedIn – Omid Vahdaty:

architecture

Rise, Fall and re-Rise of the Semantic Layer

Rise, Fall and re-Rise of the Semantic Layer

Lecturer: David Krakov 12.9.2023

In the data-driven dream everyone knows where the data is, what it means, and how to use it. When you wake up, managing truth and enabling data is hard work fraught with data errors and miscommunication. Data teams tackle this challenge daily – some with tools, some with process and some by building. Nothing seems to scale.
Can “Semantic Layers” help?
* There were SAP Business Objects, Then the cloud happened.
* Sharing the truth: How ETL and catalogs fail us.
* Emergence of the “Metric Store” in Airbnb and Uber.
* Semantics for mortals: is it just having a better process?
* The new semantic layers: dbt metrics, Looker/Malloy.
* What’s next: will the Semantic Layer rise from the ashes?
In this talk we will go over the history of the semantic layer, how it looks today in different data teams, and where the industry might be headed.
We will elaborate on the advantages of that direction.

Lecturer: David Krakov, CEO & Co-Founder of Honeydew. Previously, the co-founder of Verada, a data acceleration engine acquired by Starburs.

Video

Slides


——————————————————————————————————————————
I put a lot of thoughts into these blogs, so I could share the information in a clear and useful way.
If you have any comments, thoughts, questions, or you need someone to consult with,

feel free to contact me via LinkedIn – Omid Vahdaty:

architecture

My First Petabyte Scale Architecture

My First Petabyte Scale Architecture

Lecturer: Omid Vahdaty 6.9.2023

In this lecture, I will teach you the principles of how to build a big data architecture that stores and processes 1 PB worth of data using different technologies (Redshift, Databricks, BigQuery, SQream). 

What will you learn?
1. Challenges with such a big data scale.
2. Consideration set of the use case.
3. The architecture of each technology, relevant features for the use case, and pro/cons analysis.
4. Cost estimation.
5. Performance challenges. 

Lecturer: Omid Vahdaty, CTO at Jutomate, a company that specializes in end-to-end data solutions

Part 1

Video

Slides

Part 2

Video

Slides

Part 3

Video

Slides

Part4

Video

Slides

If you have any questions or need some help, you can fill in this form and we’ll get back to you:


    ——————————————————————————————————————————
    I put a lot of thoughts into these blogs, so I could share the information in a clear and useful way.
    If you have any comments, thoughts, questions, or you need someone to consult with,

    feel free to contact me via LinkedIn – Omid Vahdaty:

    architecture

    Architectural Evolution of Amazon internal Data Platform

    Architectural Evolution of Amazon internal Data Platform

    Lecturer: Filipp Fediakov 5.9.2023

    In this talk, we will delve into how our team built a self-service platform PXT DaaS. PXT DaaS is an internal serverless data platform built on top of AWS. PXT DaaS facilitates data exchange between software and analytical teams in Amazon HR. To scale our platform to support 100s of datasets our team decided to build self-service portal. We will discuss the challenges faced by the team during each step of this project and how we overcame them.

    Lecturer- Filipp Fediakov, a Senior Software Development Engineer at Amazon. I have been a lead engineer in a team of 12 building an internal data platform for software, analysts, data engineering teams in Amazon People Experience Technology. Now I work in a team that works on intranet search to help Amazon employees find the information they need to stay productive. Apart from work at Amazon I also write blogs and contribute to AWS CDK.

    Video

    Slides


    ——————————————————————————————————————————
    I put a lot of thoughts into these blogs, so I could share the information in a clear and useful way.
    If you have any comments, thoughts, questions, or you need someone to consult with,

    feel free to contact me via LinkedIn – Omid Vahdaty: