pixelsdb/pixels

📋 Changes

• Commit: 83ad4923e509db60132396fa6db615b718840c8f
• Java: openjdk version "1.8.0_492"
• CMake: cmake version 3.31.6
• C++: g++ (Ubuntu 13.3.0-6ubuntu2~24.04.1) 13.3.0

📋 Changes

• Optimized columnar storage on HDFS, S3, MinIO, local FS, GCS, and Redis. Significantly outperforms Parquet and ORC.
• A distributed in-memory columnar cache that further improves I/O performance for data analytics.
• External query engine integrations for Trino, Presto, Hive, and DuckDB. Significantly improves query performance in these query engines.
• Metadata (database schema and data catalog) management for data lakes and warehouses.
• Internal query accelerator (Pixels-Turbo) in serverless computing environments, including AWS Lambda and vHive (K8S+Knative+Firecracker).
• REST query API that exposes Pixels as a serverless analytics service for external users.

📋 What's Changed

• debug hive by @bianhq in https://github.com/pixelsdb/pixels/pull/1
• make pixels-hive usable by @bianhq in https://github.com/pixelsdb/pixels/pull/7
• Finish pixels-hive by @bianhq in https://github.com/pixelsdb/pixels/pull/8
• refine docs of pixels-hive. by @bianhq in https://github.com/pixelsdb/pixels/pull/9
• refine pixels-hive doc and fix pixels-load. by @bianhq in https://github.com/pixelsdb/pixels/pull/10
• Refine code and docs. by @bianhq in https://github.com/pixelsdb/pixels/pull/11
• add comments by @bianhq in https://github.com/pixelsdb/pixels/pull/18
• Rename the prefix of packages to io.pixelsdb by @ray6080 in https://github.com/pixelsdb/pixels/pull/22
• + 284 more

✨ New Contributors

• @bianhq and @ray6080 were the first two authors of the project. They co-authored the basic framework of Pixels
• @taoyouxian made contributions to the Presto and Hive integrations of Pixels
• @mzp0514 made contributions to the initial implementation of data upserts in Pixels
• @xxchan made contributions to the Trino integration of Pixels and the initial implementation of snapshot query execution
• @TiannanSha made contributions to serverless query acceleration in AWS Lambda
• @josephhany made contributions to exploring query cost estimation solutions
• @Yeeef made contributions to extending in-memory columnar cache to SSDs
• @yuly16 made contributions to the implementation of the C++ reader and DuckDB integration of Pixels, and improved the query performance on SSDs
• + 4 more