Release 1.5.0

Key Features

AreaFeature
Star Tree1. Support for optimizing join queries such as star schema queries.
2. Optimized the query plan by eliminating unnecessary aggregations on top of the cube since the cube already contains the rolled up results. The performance optimizations benefits queries whose group by clause exactly matches the cube’s group.
3. Bug fixes to further enhance the usability, and robustness of cubes.
Memory Connector1. Improved performance of memory connector by adding support for memory table partitioning to allow data skipping of entire partitions
2. Collect statistics on memory table to support openLooKeng cost based optimizers.
Task RecoveryFixed several important bugs to address data inconsistency issues, and query hanging issues that occasionally occur during high concurrency, and during worker failures.
OLK-on-YarnSupport deploying an HA-enabled openLooKeng cluster instance on-yarn, that contains a reverse proxy (ngnix by default), and 2 or more coordinator nodes. The cluster can be horizontally scaled manually by adding and removing yarn containers to the coordinator and worker components.
Spill to DiskOptimized the spill to disk mechansim to directly write Pages to disk instead of buffering it. Changed the strategy to spill those operators which can free up maximum memory. This resulted in improvement of spill to disk performance by 30%

Known Issues

CategoryDescriptionGitee issue
Task RecoveryWhen the query process reaches stage1,a worker is killed result some values become smaller(occasionally).I4M2LW
Memory ConnectorWhen a table with the index_columns parameter is queried, an error message is displayed:java.lang.NullPointerException.I4NVW3
When drop and then create a same partitioned table with data type double, query result rows is greater than expected.I4LUDF

Obtaining the Document

For details, see https://gitee.com/openlookeng/hetu-core/tree/1.5.0/hetu-docs/en