v0.6.399: name search index (#1102) #1130

Merged
Cordy merged 25 commits from ix1102 into main 2026-11-04 22:01:59 +00:00
Owner

Closes #1102 once live.

  • In-memory name index per instance (posix and s3): prepared in the background at start, kept fresh from the change journal, checked hourly, repaired from listings and stale hits; .snapshot/.zfs never indexed on posix. Accent folding, NFC/NFD, best 1,000 matches ranked, one row per item.
  • GET /api/v1/search on the index with server-side Type and Last modified filters, page tokens, complete/more/capped/reason fields (truncated kept one release); walk fallback while not ready or off.
  • Web: count, notices, Load more, cancelled stale searches, follow-on for empty pages; a capped answer never says "No matches" (new line searchCapFiltered, approved); with Last year set, files already older than the bound rank first.
  • Admin: Name search card (Storage & quotas › Usage) with Prepare again, Overview row, audit search-index-rebuild, metrics cairn_search_*, config search.index.* (rollback: remove the search block first).
  • Journal-bypass inventory test over all writers below the change journal.

Follow-up: #1119 (filters for tag: searches). Reviews: W1-W2, W3, final, three fix rounds (.superpowers/sdd/2026-11-04-ix1102). Main (v0.6.398) merged in.

Closes #1102 once live. - In-memory name index per instance (posix and s3): prepared in the background at start, kept fresh from the change journal, checked hourly, repaired from listings and stale hits; `.snapshot`/`.zfs` never indexed on posix. Accent folding, NFC/NFD, best 1,000 matches ranked, one row per item. - `GET /api/v1/search` on the index with server-side Type and Last modified filters, page tokens, `complete`/`more`/`capped`/reason fields (`truncated` kept one release); walk fallback while not ready or off. - Web: count, notices, Load more, cancelled stale searches, follow-on for empty pages; a capped answer never says "No matches" (new line `searchCapFiltered`, approved); with Last year set, files already older than the bound rank first. - Admin: Name search card (Storage & quotas › Usage) with Prepare again, Overview row, audit `search-index-rebuild`, metrics `cairn_search_*`, config `search.index.*` (rollback: remove the `search` block first). - Journal-bypass inventory test over all writers below the change journal. Follow-up: #1119 (filters for tag: searches). Reviews: W1-W2, W3, final, three fix rounds (`.superpowers/sdd/2026-11-04-ix1102`). Main (v0.6.398) merged in.
s3fake gains Paginate (max-keys and continuation tokens, opt-in) so the S3 request count is testable.
Merge remote-tracking branch 'origin/main' into ix1102
Some checks failed
ci / test-and-build (pull_request) Failing after 1m44s
434adf95b4
ci: re-run (TestTwinNewFileRace flaked in run 3991, filed separately)
All checks were successful
ci / test-and-build (pull_request) Successful in 3m42s
31bea8aa14
Cordy merged commit 666c3d3bc8 into main 2026-11-04 22:01:59 +00:00
Sign in to join this conversation.
No reviewers
No labels
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: Cordy/Cairn#1130
No description provided.