Skip to content
@vortex-data

Vortex

Vortex is an extensible, state-of-the-art columnar format meant to replace Apache Parquet. Formerly at @spiraldb, now part of the Linux Foundation.
README.md

🌪️ Vortex

📚 Documentation | 📊 Performance Benchmarks

Overview

Vortex is a next-generation columnar file format and toolkit designed for high-performance data analytics. It provides:

  • ⚡️ Blazing Fast Performance

    • 100-200x faster random access reads than Apache Parquet
    • 2-10x faster scans with similar compression ratios and write throughput
    • Efficient support for wide tables with zero-copy/zero-parse metadata

  • 🔧 Extensible Architecture

    • Modeled after Apache DataFusion's extensible approach
    • Pluggable encoding system
    • Zero-copy compatibility with Apache Arrow

Project Information

License

Licensed under the Apache License, Version 2.0

Governance

Vortex is an independent open-source project and not controlled by any single company. The Vortex Project is a sub-project of the Linux Foundation Projects. The governance model is documented in CONTRIBUTING.md and is subject to the terms of the Technical Charter.

Contributing

See CONTRIBUTING.md for guidelines.

Acknowledgments 🏆

This project builds upon groundbreaking work from the academic and open-source communities:

Key Research Papers

Open Source Inspiration

Trademarks

Copyright © Vortex a Series of LF Projects, LLC For web site terms of use, trademark policy and other project policies please see https://lfprojects.org

Thanks to all contributors who have shared their knowledge and code with the community! 🚀

Pinned Loading

  1. vortex vortex Public

    An extensible, state-of-the-art framework for columnar compression, and the fastest FOSS columnar file format. Formerly at @spiraldb, now an Incubation Stage project at LFAI&Data, part of the Linux…

    Rust 3.2k 218

Repositories

Showing 10 of 14 repositories
  • vortex Public

    An extensible, state-of-the-art framework for columnar compression, and the fastest FOSS columnar file format. Formerly at @spiraldb, now an Incubation Stage project at LFAI&Data, part of the Linux Foundation.

    vortex-data/vortex's past year of commit activity
    Rust 3,186 Apache-2.0 218 209 (4 issues need help) 145 Updated Sep 9, 2026
  • benchmarks-website Public

    Benchmark Results for Vortex

    vortex-data/benchmarks-website's past year of commit activity
    TypeScript 0 0 1 5 Updated Sep 9, 2026
  • duckdb-vortex Public

    DuckDB extension allowing reading/writing of vortex files

    vortex-data/duckdb-vortex's past year of commit activity
    CMake 53 MIT 7 1 2 Updated Sep 8, 2026
  • vortex.dev Public

    Source code for https://vortex.dev

    vortex-data/vortex.dev's past year of commit activity
    TypeScript 4 1 6 3 Updated Sep 7, 2026
  • vortex-datafusion-cli Public

    CLI tool to run DataFusion benchmarks on Vortex data

    vortex-data/vortex-datafusion-cli's past year of commit activity
    Rust 0 Apache-2.0 0 1 10 Updated Sep 5, 2026
  • datasets Public
    vortex-data/datasets's past year of commit activity
    Python 0 0 1 2 Updated Sep 1, 2026
  • rfcs Public

    Project RFCs and discussions

    vortex-data/rfcs's past year of commit activity
    TypeScript 2 CC0-1.0 1 0 16 Updated Aug 27, 2026
  • cudf-test-harness Public
    vortex-data/cudf-test-harness's past year of commit activity
    C++ 0 Apache-2.0 0 0 1 Updated Jun 17, 2026
  • ClickBench Public Forked from ClickHouse/ClickBench

    ClickBench: a Benchmark For Analytical Databases

    vortex-data/ClickBench's past year of commit activity
    HTML 0 317 0 0 Updated May 19, 2026
  • cargo-public-api Public Forked from cargo-public-api/cargo-public-api

    List and diff the public API of Rust library crates between releases and commits. Detect breaking API changes and semver violations via CI or a CLI.

    vortex-data/cargo-public-api's past year of commit activity
    Rust 0 MIT 46 0 0 Updated Apr 30, 2026
View all repositories

Most used topics

Loading…