← Back to all sparks
O

OpenHouse

ANALYTICS
Velocity5.0

Control plane for managing tables in open-source data lakehouse deployments

OpenHouse adds time-zone-aware retention and per-database table caps.

data lakehouseicebergdata retentiongovernanceviews
◆Current state
OpenHouse ships small versioned releases straight from merged pull requests. On November 13 it shipped five: retention policies on string date columns can now take a time zone, operators can cap live tables per database with metrics on usage and rejections, view requests and operations are now audited in full, and two fixes make view property SET/UNSET and REPLACE behave. Earlier in November failed Spark maintenance jobs began exiting as failed.
◆Where it's heading
OpenHouse is adding the controls a shared lakehouse needs at scale: quotas, audit trails and retention that matches business calendars. Views are getting the same governance tables already had.
◆Prediction
Expect more views milestones after audit (the release is labeled Views M1), and further operator controls for quotas and maintenance.

◆Recent moves

  1. 13h ago

    Retention policies on string date columns accept a time zone

    Retention on string date partitions can now count days in a named time zone instead of UTC, so a Pacific team keeps exactly 30 Pacific days. A small SQL addition with real effect on what gets deleted.

    View source ↗
  2. 15h ago

    OpenHouse adds an optional per-database table count limit

    Operators can set a maximum number of live tables per database, with HTTP 422 on creates past the limit, bypass rules and usage metrics. Off by default, it gives shared clusters a quota lever.

    View source ↗
  3. 17h ago

    Fix: ALTER VIEW UNSET now removes view properties

    Removing a view property used to report success without deleting it. A correctness fix in the views work.

    View source ↗
  4. 1d ago

    Fix view REPLACE property validation

    Fixes property validation on view REPLACE and adds Spark 3.5 integration coverage. Follow-up fix.

    View source ↗
  5. 1d ago

    OpenHouse audits view requests and operations in full

    View requests and operations are now audited, and payload redaction is removed, so audit logs include view SQL and schema. Custom audit sinks need to adjust to the removed redactor interface.

    View source ↗
  6. 4d ago

    Failed Spark maintenance jobs now exit as failed

    BaseSparkApp used to record FAILED but exit successfully, hiding errors such as rejected commits from Spark-level monitoring. Rethrowing the failure fits the November push to record and surface why maintenance fails.

    View source ↗