An Intellyx Brain Candy Brief
Starburst Data offers a massively parallel data management platform that uses the Trino engine to query multiple data lakes with open and proprietary data formats which in conjunction with the Iceberg persistence layer forms a bigger data “Icehouse” that allows business logic and analytics workloads to leverage some of the world’s biggest big data sets.
Enterprises must find new ways to collaborate between departments and business partners that each have unique data stores and event streams, without creating redundant storage costs or excess lags on query performance.
While the principle of applying metadata and access policies to achieve federated data access has been around for a while, the massive scale of today’s distributed data volumes and asynchronous data feeds has created interoperability and speed challenges. To solve this, Starburst contributes to and supports several open source tools, tables and data formats within its Galaxy managed service stack, and several major integration players and cloud platforms are already using their offering as a data backplane.
The data management platform can be operated pretty much anywhere you can install Kubernetes cloud infrastructure or on-prem environments, and because data gravity and open standards are respected, end customers can migrate without vendor lock-in, unlike some proprietary approaches. Still, it seems unlikely they would move if they are actively dealing with bigger-than-big data within multiple data lakes and warehouses.
Copyright ©2024 Intellyx B.V. Intellyx is an industry analysis and advisory firm focused on enterprise digital transformation. Covering every angle of enterprise IT from mainframes to artificial intelligence, our broad focus across technologies allows business executives and IT professionals to connect the dots among disruptive trends. At the time of writing, Starburst Data is not an Intellyx customer. No AI was used to write this article. To be considered for a Brain Candy article or event visit, email us at pr@intellyx.com.
