LoginSign Up
← Back to all sparks
D

Delta Lake

ANALYTICS
Velocity5.0

Open table format bringing ACID transactions to data lakes

delta.io ↗

Delta Lake's public stream is Databricks builds and code cleanup on the way to 4.5.

lakehousedelta-kernelsparkrelease-mechanics
◆Current state
Recent Delta Lake activity is release mechanics. The newest entries are a Delta Kernel 4.5.0 Databricks build, the removal of unused V2 streaming snapshot code, and CI changes that pause idle source-build jobs now that Spark 4.0 to 4.3 use published artifacts. The last user-facing fix in the window is still 3.3.3's log cleanup correction.
◆Where it's heading
The 4.5 line is being prepared in the open through kernel builds and cleanup, with the Spark connector consolidating V2 streaming onto the V1 snapshot path. The feed shows no 4.5 release notes yet.
◆Prediction
A 4.5.0 release candidate or tag is the next visible step; until then expect more kernel builds and cleanup PRs.

◆Recent moves

  1. 7d ago

    Delta Kernel 4.5.0 Databricks build, November 6

    Another Databricks runtime kernel build on the 4.5.0 line, with no notes. It adds to the run of builds pointing at the next minor release.

    View source ↗
  2. 8d ago

    Spark connector drops unused V2 streaming snapshot code

    V2 streaming already reuses the V1 initial-snapshot path, so the unused cache, wrappers and a setting are removed. The PR states no user-facing change.

    View source ↗
  3. 9d ago

    Idle Spark source-build CI jobs paused

    With Spark 4.0 to 4.3 on published artifacts, the empty source-build CI jobs are commented out until the next Spark snapshot. Build plumbing only.

    View source ↗
  4. 9d ago

    Delta Kernel 4.5.0 Databricks build stamped

    Another Databricks runtime kernel build, now formally stamped 4.5.0. It confirms the next minor line is in progress but carries no notes for open-source users.

    View source ↗
  5. 1mo ago

    Delta Kernel 4.5.0 Databricks runtime build

    Another internal Databricks runtime kernel build with no notes, notable only because it is versioned 4.5.0. It points to the next minor line being in preparation without saying what it adds.

    View source ↗
  6. 1mo ago

    Delta Lake 4.4.1 patch release tagged

    A version bump to cut the 4.4.1 artifacts, with no runtime changes described. Release plumbing on the 4.x line.

    View source ↗