Databricks acquires Redash, introduces Delta Engine

Ali Ghodsi, co-founder and CEO at Databricks. Ali Ghodsi, co-founder and CEO at Databricks.

Databricks has acquired Redash, the company behind the successful Redash open source project, to create a “larger and more thriving” open source system.

Alongside Apache Spark, Delta Lake, and MLflow, Redash will allow data scientists and SQL analysts to eliminate the complexity of moving data into other systems for analysis.

“Most organizations who want to do data science and data warehousing are using multiple architectures. Data is stuck in organisational silos, defined by closed and proprietary systems that slow organisations down and make it harder to arrive at high quality decisions because information is fragmented and out of date,” said Ali Ghodsi, co-founder and CEO at Databricks.

The data company has also introduced Delta Engine, a high-performance query engine on cloud data lakes.

Tailored for use with Delta Lake, Delta Engine is a high-performance query engine on cloud data lakes, meaning organisations can now build curated data lakes that include structured and semi-structured data and run all their analytics on data in the cloud.

Delta Lake was released in 2017 by Databricks and donated to the Linux Foundation in 2019. Since its introduction, Delta Lake has been adopted by Comcast, Condé Nast, Nielsen, FINRA, Shell, and thousands of other organizations. Today’s announcements build upon the success of the Delta Lake project to extend beyond storing and managing data into how data is used and consumed.

Combined, these new capabilities make it easier for Databricks’ unified data analytics platform to be used for data science, machine learning, and a broad range of data analytics use cases. Further, the enhancements are a response to the emerging “Lakehouse” design trend, which Databricks said many enterprise organisations have adopted to bring structured transactions, quality and performance to their cloud data lakes.

“Curated cloud data lakes provide organisations a way to run any kind of analytics, including data science and machine learning, on all their most recent data. Our introduction of Delta Engine and the acquisition of Redash are significant steps forward in helping organisations build these high quality, curated data lakes that some call Lakehouses,” Ghodsi added.