Oracle has announced the general availability of MySQL HeatWave Lakehouse, delivering an industry first by enabling customers to query data in object storage as fast as querying data inside the database. MySQL HeatWave Lakehouse supports a variety of object store file formats such as CSV, Parquet, and export files from other databases, and can combine object storage file data and MySQL database transactional data together in the same query. Object store files are queried directly by HeatWave without copying the data into the MySQL database. As a result, MySQL HeatWave Lakehouse sets new standards for scalability and performance for query processing, speed of loading data, cluster provisioning time, and automation to query data in object storage.
“More than 80 percent of data is stored in file systems and that number is growing. Customers want to integrate and analyze this varied external data with their internal transactional data, but it’s often too complex or too expensive to process,” said Edward Screven, chief corporate architect, Oracle. “MySQL HeatWave Lakehouse makes it easy for customers to get valuable real-time insights by combining their data in object storage with database data while gaining significantly higher query performance and much faster data loading at a lower cost.”
Querying data in object storage is as fast as querying data inside the database
As demonstrated by a 10 TB TPC-H* benchmark, querying data in object storage in popular file formats with MySQL HeatWave Lakehouse is as fast as querying data in the MySQL database. This is made possible by MySQL Autopilot, a built-in capability of MySQL HeatWave that provides machine learning-powered automation, which learns from the execution of queries and improves the execution plan of future queries. MySQL Autopilot is an innovation in MySQL HeatWave that is not available anywhere else. MySQL HeatWave on Oracle Cloud Infrastructure (OCI) is powered by AMD EPYC™ processors.
“The AMD and MySQL HeatWave engineering teams are closely collaborating to optimize MySQL HeatWave for AMD EPYC processors to take advantage of new processor capabilities,” said Forrest Norrod, executive vice president and general manager of the Data Center Solutions Business Group, AMD. “Thanks to this collaboration, MySQL customers running MySQL HeatWave on AMD EPYC CPU-powered OCI instances benefit from an outstanding price performance advantage for their business-critical workloads, including real-time analytics on massive amounts of data stored in object storage.”
Best performance for Lakehouse use cases
As demonstrated by a 500 TB TPC-H* benchmark, the query performance of MySQL HeatWave Lakehouse is:
- 9X faster than Amazon Redshift
- 17X faster than Snowflake
- 17X faster than Databricks
- 36X faster than Google BigQuery
The performance to load data from the object store with MySQL HeatWave Lakehouse is:
- 9X faster than Amazon Redshift
- 2X faster than Snowflake
- 6X faster than Databricks
- 8X faster than Google BigQuery
MySQL HeatWave’s unrivaled performance is a result of its scale-out architecture that enables massive parallelism to provision the cluster, load data, and process queries with up to 512 nodes. In addition, enhancements to MySQL Autopilot automate metadata creation for object files and dynamically adapt to the performance of the underlying object store to provide the best performance in any OCI region.
MySQL HeatWave is the only cloud service that provides transaction processing, real-time analytics, machine learning, data lake querying, and machine learning-based automation within a single MySQL database service. A core part of Oracle’s distributed cloud strategy, MySQL HeatWave is available in OCI, natively on Amazon Web Services, as part of the Oracle Database Service for Azure, and in customers’ data centers with OCI Dedicated Region.
