the real-time analytics database built on open data formats

2 min read Original article ↗

Pivot brings the speed and concurrency the AI era demands to the lakehouse. Run low-latency, high-concurrency queries on a single architecture that unifies real-time analytics and lakehouse workloads.

$ curl https://pivotlake.io | sh copy

REAL-TIME DATABASES LAKEHOUSES ClickHouse StarRocks Druid Pinot Databricks Snowflake Spark Trino pivot sub-second queries on open formats Fast, but runs on proprietary formats and local disks. Open, but queries take seconds and are expensive.

01 - FASTOpen data formats just got fast.

Relative query time, lower is better.Why is Pivot fast? →

ClickBench

43 queries

DataFusion (Parquet)3.09×

ClickHouse (Parquet)3.61×

TPC-H

SF1000

DataFusion (Parquet)7.37×

ClickHouse (Parquet)27.14×

Star Schema Benchmark

SF1000

DataFusion (Parquet)12.86×

ClickHouse (Parquet)120.51×

02 - ARCHITECTUREBuild a lakehouse with Pivot, or query the one you already have.

Ingest, compact, and query data with Pivot. Already have Iceberg tables? Connect your catalog and query them in place.

Pivotserver · standalone

Ingest

Stream small changes or load large batches.

Compact

Continuously merge and reorder files so queries read less data.

Soft ordering →

Query

Run sub-second SQL queries at high concurrency.

Object storageIceberg · Delta Lake

Amazon S3

Google Cloud

Azure Blob

03 - PORTABLERun anywhere. Query the same Parquet.

Run Pivot as a shared server or locally for ad hoc queries and AI agents. Both access the same tables in object storage, with no extra copies to maintain.

Server mode

Connect applications, BI tools, and SQL clients to a shared Pivot server or cluster using the Postgres protocol.

Standalone mode

Run Pivot locally from your terminal or AI agent and query object storage directly, with no server to manage.

Terminal

pivot open s3://lake

└ opened 3 tables

AI agent

pivot open s3://lake

└ opened 3 tables

Pivot server

pivot server

└ listening on :5432

Shared tables in object storage

Same tables. Same source of truth.

04 - SCALABLEScale up, down, or to zero - almost instantly.

With object storage as its backing store and only state, Pivot can be scaled up, down, or to zero almost instantly.

instance 4

pivot server

scaled to zero

instance 5

pivot server

scaled to zero