Data management in 2024. Featuring Peter Corless, Director of Product Marketing at StarTree, and Alex Merced, Developer Advocate at Dremio

Orchestrate all the Things

11-01-2024 • 53 mins

For many organizations today, data management comes down to handing over their data to one of the "Big 5" data vendors: Amazon, Microsoft Azure and Google, plus Snowflake and Databricks.

But analysts David Vellante and George Gilbert believe that the needs of modern data applications coupled with the evolution of open storage management may lead to the emergence of a "sixth data platform".

The sixth data platform hypothesis is that open data formats may enable interoperability, leading the transition away from vertically integrated vendor-controlled platforms towards independent management of data storage and permissions.

It's an interesting scenario, and one that would benefit users by forcing vendors to compete for every workload based on the business value delivered, irrespective of lock-in. But how close are we to realizing this?

To answer this question, we have to examine open data formats and their interoperability potential across clouds and formats, as well as on the semantics and governance layer.

We caught up with Peter Corless and Alex Merced to talk about all of that.

Article published on Orchestrate all the Things: https://linkeddataorchestration.com/2024/01/11/data-management-in-2024-open-data-formats-and-a-common-language-for-a-sixth-data-platform/