LoginSign Up
← Back to all sparks
O

OpenHouse

ANALYTICS
Velocity6.3

Control plane for managing tables in open-source data lakehouse deployments

www.openhousedb.org ↗

OpenHouse breaks ground on Iceberg views while tightening storage lifecycle and authorization

icebergdata-lakehouselinkedinopen-sourcestorage-lifecyclecatalog
◆Current state
OpenHouse (LinkedIn's managed Iceberg tables service) is shipping at a rapid v0.5.x pace with multiple improvements per week. Recent work spans three areas: storage lifecycle management (native snapshot expiration with reference age defaults, orphan file reclamation), authorization hardening (routing RTAS operations through proper table privilege checks), and the first scaffolding for Iceberg view support (entityType discriminator, table-scoped HTS queries).
◆Where it's heading
The entityType discriminator in v0.5.490 is the most directional move in this window — it creates the data model prerequisite for treating views as first-class entities alongside tables, something OpenHouse has not supported. Storage lifecycle work is converging on Iceberg-native mechanisms, reducing custom expiration logic. The post-commit operations framework in v0.5.492 is infrastructure that will allow OpenHouse to add downstream hooks (compaction triggers, notifications) without catalog coupling.
◆Prediction
Iceberg view read support will arrive in the next several releases, building on the discriminator and HTS scaffolding now in place. The authorization model for views will be an open question — watch whether they reuse the table ACL path or introduce a parallel model.

◆Recent moves

  1. 11h ago

    v0.5.492: Add a generic bounded post commit operations framework (#729)

    v0.5.492 introduces a generic, best-effort post-commit operations framework inside the internal catalog. Arbitrary logic can now hook into a successful table commit without the catalog needing to know what that logic does, and without any hook being able to destabilize the commit itself. This is the infrastructure foundation for adding compaction triggers, cache invalidation, or event notifications in future releases.

    View source ↗
  2. 5d ago

    v0.5.491

    Refactors OpenHouseViewOperations into a dedicated class as view support scaffolding accumulates. Pure restructuring; no user-visible change.

    View source ↗
  3. 5d ago

    v0.5.490: Add entityType discriminator and table-scoped HTS queries (#696)

    ⚡ SPARK

    v0.5.490 adds an entityType discriminator to the internal catalog and introduces table-scoped HTS queries — the first concrete infrastructure step toward Iceberg view support in OpenHouse. Views will share the existing ACL and HTS infrastructure rather than requiring a parallel implementation, per the PR's design.

    View source ↗
  4. 7d ago

    v0.5.489: Backfill history.expire.max-ref-age-ms with Snapshot Expiration (#708)

    v0.5.489 adopts Iceberg's native reference expiration during snapshot maintenance and backfills a seven-day history.expire.max-ref-age-ms default on legacy tables that lack it. This replaces custom expiration logic with the Iceberg-standard mechanism, improving correctness and reducing maintenance surface.

    View source ↗
  5. 11d ago

    v0.5.488: [RTAS] Use table privileges for replacement (#711)

    v0.5.488 fixes RTAS (Replace Table As Select) to route both phases through the standard UPDATE_TABLE_METADATA authorization path instead of a direct string comparison. Closes an authorization bypass where the configured authorization handler was skipped during table replacement.

    View source ↗
  6. 12d ago

    v0.5.487

    v0.5.487 extends snapshot expiration to reclaim orphan files that were part of prior snapshots — files that snapshot deletion alone would not have removed. Improves storage reclamation completeness for long-running tables.

    View source ↗