Group/key lease: after an upgrade the first-start key move waited ~10 minutes for the old pod's lease #1020

Closed
opened 2026-10-26 22:55:40 +00:00 by Cordy · 0 comments
Owner

Seen on files (cairn-enc) at the v0.6.358 rollout, 2026-10-26.

The new pod started at 22:39:49Z and logged no key move at start. The move ran at 22:50:19Z, on the first pass after the old v0.6.357 pod's advisory lease (2 × 5 min) ran out. files-bao ran it at start (22:39:50Z).

Impact: none on data. Until the move ran, every space kept its lookup by name. But the handbook and CHANGELOG say the move runs "at start, before serving", and the stage-2 upgrade has the same dependency on the lease.

To check: whether the v0.6.357 shutdown path releases the lease (T7 "shutdown lease" wiring) on a normal SIGTERM with Recreate. Then either fix the release, or have a first start of a new version take a lease whose holder reports an older version, or correct the docs.

Seen on files (cairn-enc) at the v0.6.358 rollout, 2026-10-26. The new pod started at 22:39:49Z and logged no key move at start. The move ran at 22:50:19Z, on the first pass after the old v0.6.357 pod's advisory lease (2 × 5 min) ran out. files-bao ran it at start (22:39:50Z). **Impact:** none on data. Until the move ran, every space kept its lookup by name. But the handbook and CHANGELOG say the move runs "at start, before serving", and the stage-2 upgrade has the same dependency on the lease. **To check:** whether the v0.6.357 shutdown path releases the lease (T7 "shutdown lease" wiring) on a normal SIGTERM with `Recreate`. Then either fix the release, or have a first start of a new version take a lease whose holder reports an older version, or correct the docs.
Cordy closed this issue 2026-10-27 03:15:04 +00:00
Sign in to join this conversation.
No labels
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: Cordy/Cairn#1020
No description provided.