Small files
Streaming writes and frequent commits leave thousands of tiny files. Every query pays for opening them, and planning slows to a crawl.
LakeTune reads your table metadata and tells you exactly what to fix — compaction, sort and Z-order, snapshot expiry, partitioning — with estimated impact. Read-only. No data scanned.
pip install laketune❯
// the problem
Nobody notices until dashboards slow down and the storage bill grows. These three issues cause most of it.
Streaming writes and frequent commits leave thousands of tiny files. Every query pays for opening them, and planning slows to a crawl.
Without regular expiry, old snapshots pin deleted data and grow metadata. You keep paying for storage nobody can query.
Partitions and sort order that don't match how the table is queried mean min/max pruning can't skip anything.
// how it works
LakeTune only observes. It recommends; you decide what to run.
Pass a catalog table or a storage path. LakeTune uses your existing cloud credentials.
laketune inspect s3://warehouse/eventsManifests, snapshots, file stats and partition specs. Never your data files, never a write.
metadata.json · manifest lists · manifestsEach finding comes with the exact maintenance command and an estimated impact, so you choose what to run.
→ rewrite_data_files target=512MB// table formats
One set of checks, adapted to each format's metadata model.
// surfaces
Same engine, three ways in.
Scriptable, CI-friendly. JSON output for pipelines and pull-request checks.
$ laketune inspect <table> --json
Browse a catalog, drill into partitions and findings, all from the keyboard.
$ laketune tui
Runs entirely on your machine with DuckDB-WASM. Metadata never leaves your browser.
$ localhost · DuckDB-WASM
// roadmap
Built in the open. Priorities shift with feedback from people running real tables.
Small-file, snapshot and layout checks with suggested maintenance commands.
in progressEstimated scan reduction and storage savings per recommendation.
nextInteractive catalog browser with drill-down into partitions and files.
plannedLocal-only web UI powered by DuckDB-WASM.
plannedSame checks against Delta transaction logs.
plannedExtend coverage across the open table formats.
planned// open source
LakeTune is licensed under Apache-2.0. Read the code, open issues, and help shape which checks come next.