Post Content
Video of a conference talk about building a PostgreSQL data warehouse. PostgreSQL is designed as an operational database. The planner, executor, storage layer and other architectural aspects are all optimized for running a high rate of transactions.
Most organizations use a variety of other platforms for analytics, but none are as versatile as PostgreSQL. Integrating operational and analytical database systems requires a huge amount of glue code to orchestrate ETL processes, and in the end, you can do a lot less, except run faster analytical queries.
Last year, we set out on a journey to turn PostgreSQL into a modern data warehouse. One built using data lake table formats such as Iceberg, easy access to blob storage, high analytics performance, built using extensions. This talk is about what we learned along the way about turning PostgreSQL into a data warehouse.
Marco Slot works at Crunchy Data, where he designs and implements advanced data management products and features by extending PostgreSQL. He currently leads the development of Crunchy Data Warehouse, a modern PostgreSQL OLAP store built using DuckDB and a constellation of PostgreSQL extensions. Marco spent much of the past decade working on Citus (distributed PostgreSQL) and other PostgreSQL extensions, first as a founding engineer at Citus Data and later at Microsoft after Citus Data was acquired. Before Citus Data, Marco helped create Amazon CloudFront and Route 53 at AWS. He also obtained a PhD from Trinity College Dublin, and an MSc from VU Amsterdam, both in distributed systems.
► Video bookmarks:
00:00 Introduction
01:50 Differences between OLTP & OLAP
06:39 Hybrid OLTP / OLAP Architecture
09:01 Hybrid Table Storage
12:54 Crunchy Data Warehouse
23:30 DEMO – Logical Replication from Postgres to Iceberg
24:56 Summary
Everything you need to know about POSETTE: An Event for Postgres 2025 can be found at: https://posetteconf.com
Learn more:
Watch more POSETTE talks: https://aka.ms/posette-playlist
Let’s connect:
LinkedIn – https://www.linkedin.com/company/posetteconf/
X – @PosetteConf, https://twitter.com/PosetteConf
Mastodon – @posetteconf, https://mastodon.social/@posetteconf
Bluesky – @posetteconf.com, https://bsky.app/profile/posetteconf.com
_________________________________
#PosetteConf #PostgreSQL #DataWarehouse Read More Microsoft Developer
