April 15, 2024

Apache Iceberg is an open supply high-performance format for large information tables. Iceberg permits using SQL tables for giant information, whereas making it attainable for engines like Spark and Hive to soundly work with the identical tables, on the identical time.

Iceberg was began at Netflix by Ryan Blue and Dan Weeks, and was open-sourced and donated to the Apache Software program Basis in November 2018. It has now been adopted at many different firms together with Airbnb, Apple, and Lyft.

Ryan Blue joins the podcast to explain the origins of Iceberg, the way it works, the issues it solves, collaborating with Apple and others to open-source it, and extra.

This episode is hosted by Lee Atchison. Lee Atchison is a software program architect, writer, and thought chief on cloud computing and software modernization. His best-selling ebook, Architecting for Scale (O’Reilly Media), is an important useful resource for technical groups trying to preserve excessive availability and handle threat of their cloud environments.

Lee is the host of his podcast, Modern Digital Business, an interesting and informative podcast produced for folks trying to construct and develop their digital enterprise with the assistance of contemporary purposes and processes developed for at present’s fast-moving enterprise setting. Pay attention at mdb.fm. Comply with Lee at softwarearchitectureinsights.com, and see all his content material at leeatchison.com.

Sponsors

This episode of Software program Engineering Each day is dropped at you by Starburst. Struggling to ship analytics on the velocity your customers need with out your prices snowballing?

For information engineers who battle to construct and scale prime quality information pipelines, Starburst’s information lakehouse platform helps you ship distinctive consumer experiences at peta-byte scale, with out compromising on efficiency or value.

Trusted by the groups at Comcast, Doordash, and MIT, Starburst delivers the adaptability and suppleness a lakehouse ecosystem guarantees on an open structure that helps – Apache Iceberg, Delta Lake and Hudi, so that you all the time preserve possession of your information. Wish to see Starburst in motion? Get began at present with a free trial at starburst.io/sed.

You’ve tried each Kanban and collaboration device to maintain your staff in sync love you discover the one which’s United everybody to propel your initiatives ahead. Whereas being intuitive to make use of and graphically pleasing. You may both method Miro from the form of staff you’re on engineering or product administration, for instance, or by use case possibly technical diagramming or scale product planning. I notably just like the inbuilt assist for product improvement like estimation and retrospectives, check out what 60 million customers already know that Miro is a safe and visible workspace for innovation. Discover simplicity in your most advanced initiatives with Miro. Your first three mural boards are FREE if you join at present at miro.com/podcast.

WorkOS is a contemporary id platform constructed for B2B SaaS. It gives seamless APIs for authentication, consumer id, and complicated enterprise options like SSO and SCIM provisioning. It’s a drop-in alternative for Auth0 (auth-zero) and helps as much as 1 million month-to-month lively customers free of charge.

It’s excellent for B2B SaaS firms annoyed with excessive prices, opaque pricing, and lack of enterprise capabilities supported by legacy auth distributors. The APIs are versatile and straightforward to make use of, designed to supply a simple expertise out of your first consumer all the best way to your largest enterprise buyer.

At this time, lots of of high-growth scale-ups are already powered by WorkOS, together with ones you most likely know, like Vercel, Webflow, and Loom. Try workos.com/SED to be taught extra.