Building Modern Databases with the FDAP Stack • Andrew Lamb & Olimpiu Pop

This interview was recorded for GOTO Unscripted. https://gotopia.tech Check out more here: https://gotopia.tech/articles/412 Andrew Lamb - Staff Engineer at InfluxData, ASF Member & PMC Apache DataFusion & Apache Arrow Olimpiu Pop - Technologist & Tech Journalist RESOURCES Andrew https://bsky.app/profile/andrewlamb1111.bsky.social https://x.com/andrewlamb1111 https://github.com/alamb https://www.linkedin.com/in/andrewalamb https://andrew.nerdnetworks.org Olimpiu https://x.com/olimpiupop https://github.com/zroll https://www.linkedin.com/in/olimpiupop Links https://www.influxdata.com/blog/flight-datafusion-arrow-parquet-fdap-architecture-influxdb https://www.cidrdb.org/cidr2005/papers/P19.pdf DESCRIPTION Olimpiu Pop speaks with Andrew Lamb, staff engineer at InfluxData and PMC member of Apache DataFusion and Apache Arrow, about how modern data systems are built using standardized open source components rather than being developed from scratch. Andrew discusses the FDAP Stack (Flight, DataFusion, Arrow & Parquet), the shift from row-based to columnar data storage, and how technologies like Apache Iceberg are enabling a new era of interoperability across data platforms. The discussion covers why this modular approach saves years of development time while providing better performance and compatibility. RECOMMENDED BOOKS Kasun Indrasiri & Danesh Kuruppu • gRPC: Up and Running • https://amzn.to/3sBGBJJ Tomer Shiran, Jason Hughes & Alex Merced • Apache Iceberg: The Definitive Guide • https://amzn.to/488Z30k William Smith • Arrow Flight Protocols and Practices • https://amzn.to/4o2Q2fd Matthew Topol • In-Memory Analytics with Apache Arrow • https://amzn.to/4oJQ6BM Apache Parquet A Complete Guide • https://amzn.to/4i7HVN6 Bluesky (https://bsky.app/profile/gotocon.com) Twitter (https://twitter.com/GOTOcon) Instagram (https://www.instagram.com/goto_con) LinkedIn (https://www.linkedin.com/company/goto-) Facebook (https://www.facebook.com/GOTOConferences) CHANNEL MEMBERSHIP BONUS Join this channel to get early access to videos & other perks: https://www.youtube.com/channel/UCs_tLP3AiwYKwdUHpltJPuA/join Looking for a unique learning experience? Attend the next GOTO conference near you! Get your ticket: gotopia.tech (https://gotopia.tech) SUBSCRIBE TO OUR YOUTUBE CHANNEL (https://www.youtube.com/user/GotoConferences/?sub_confirmation=1) - new videos posted daily!