Dremio, a data analytics, visualization, and storage platform, has announced new features to enhance query performance on Apache Iceberg tables.
The new features include 1) Live Reflections, which automatically updates materialized views and aggregations when changes occur in base Iceberg tables; 2) Result Set Caching, which speeds up retrieval by storing frequently accessed query results; and 3) Auto Ingest Pipes for seamless data loading from Amazon S3 to Iceberg tables. Additionally, a merge-on-read feature accelerates Iceberg table writes and ingestions.
Dremio states that these features have the potential to significantly improve query performance, with Result Set Caching potentially increasing response speeds by up to 28x across various data sources. The merge-on-read feature may also enhance Iceberg table writes and ingestions by up to 85%. These updates are intended to simplify data movement and improve the setup and management of data pipelines for organizations.
By using this site, you agree to allow SPEEDA Edge and our partners to use cookies for analytics and personalization. Visit our privacy policy for more information about our data collection practices.