v0.6.375: personal data export (#1023) #1051

Merged
Cordy merged 52 commits from dx1023 into main 2026-10-30 02:10:06 +00:00
Owner

Personal data export (#1023, GDPR Art. 15/20, nDSG Art. 25/28): Account › Your data self-service copy (fresh confirmation, 7 days / 5 downloads, 24 h slot), administrator exports from Users & access (row menu, Departed users, Personal data tab) delivered to the account or via a handover link with an 8-character code (lock after 5 wrong codes, scoped cookie, log redaction). Async engine with a lease and resumable parts (#742), collectors over 37 data places with third-party redaction, streaming audit scan, ZIP with README (EN/DE/FR/IT, operator texts) and manifest (SHA-256), file-content parts (≤ 4 GB, home only), bells, audit group data (12 verbs), sealed blobs on s3. Includes the account e-mail address and language from #896 in the profile part. Docs: personal-data-export.md, data-protection-operators.md, compliance-support.md, ARCHITECTURE.md.

Reviewed: W1, W2/W3, two fix rounds, final whole-branch review, final fixes; merged with main through v0.6.374.

Personal data export (#1023, GDPR Art. 15/20, nDSG Art. 25/28): Account › Your data self-service copy (fresh confirmation, 7 days / 5 downloads, 24 h slot), administrator exports from Users & access (row menu, Departed users, Personal data tab) delivered to the account or via a handover link with an 8-character code (lock after 5 wrong codes, scoped cookie, log redaction). Async engine with a lease and resumable parts (#742), collectors over 37 data places with third-party redaction, streaming audit scan, ZIP with README (EN/DE/FR/IT, operator texts) and manifest (SHA-256), file-content parts (≤ 4 GB, home only), bells, audit group `data` (12 verbs), sealed blobs on s3. Includes the account e-mail address and language from #896 in the profile part. Docs: personal-data-export.md, data-protection-operators.md, compliance-support.md, ARCHITECTURE.md. Reviewed: W1, W2/W3, two fix rounds, final whole-branch review, final fixes; merged with main through v0.6.374.
Frames C1 to C5, D1, D2, E3 (administrator), F1, F2, G1 of the approved
mockup: the row menu entry after a separator, the export dialog and its
confirm step, the row chip and toast, the result dialog with per-file
downloads and the handover link and code, the Personal data block between
Seat and Devices, the Personal data tab (switch, README texts per language,
exports by administrators, Tell now), the amber note, the audit group data,
the administrator's bell items and Preferences row.

Existing tests changed with a reason: departed654 and qa888 pin ADM_TABS.users
(Personal data follows Departed users); departed654 pins AUD_DESTRUCTIVE
(data-export-admin drawn red, G1) and its fake panel gains pdDuBlock;
qa693 counts askDanger dialogs (+1 Tell now).
Conflicts resolved keeping both sides:
- CHANGELOG: v0.6.375 above v0.6.373 above v0.6.372; chart version 0.6.1
  unchanged; a rollback note to v0.6.373 added to v0.6.375's upgrade notes.
- Chart.yaml: version 0.6.1 (main), appVersion v0.6.375.
- audit/verbs.go: group comment lists scanning and data; main's blocks
  (scanning, auth-session-extended) first, then the data group.
- settings.go: Scan then DataExport. api.go: /me gains both lang and session.
- main.go: scan health loop beside the export engine (rest auto-merged:
  avscan above hold, exportRead below audit, OldSessions, SignInWindow,
  /auth/done, data export build and /handover/ mount).
- statepaths(.go,_test): scan store and the export stores.
- share/public.go: the drop write runs WithVisitor (#1023) and carries
  avscan.WithSource plus the scan precheck (#1022).
- index.html: audit group labels, admin tabs (scan, personal-data), bell
  cases and icons of both, the account row menu keeps Export personal
  data and passes the row name to accKebab (#638).
- docs: ARCHITECTURE, admin-policy, deployment, index, security-standards.

Fixed what the merge broke:
- qa693: fact-row dialog count 45 = 42 + 1 (#1022) + 2 (#1023).
- dataexport1023b: the directory menu source pin follows #638's
  accKebab(acts, dkEntries, s.user).
- #1023's confirm step field (#pd-cf) and the Personal data tab's README fields use
  --field-rule borders (#638 contrast test).
Conflicts kept both sides: CHANGELOG v0.6.375, v0.6.374, v0.6.373,
v0.6.372 (our rollback target now v0.6.374); chart appVersion v0.6.375,
version 0.6.1; audit verbs append-only (mail-sent, mail-failed,
mail-test, account-email-set, then the data-export group); notify.go
mail items and data-export items; main.go mail and data export wiring;
state paths mail-outbox, account-profiles.json, mail-state.json,
data-exports, data-export-files; handbook sections of both; index.html
I18N, account sections, admin tabs, bell dispatch, notification notes,
row menus with Edit e-mail address and Export personal data.

Follow-up for #1023 after #896:
- One language store: #896 saves the language with the account
  (account-profiles.json, PUT /api/v1/me/lang). The export's duplicate
  route (which panicked on a second registration and clashed with
  Handler.meLang), its notify-seen.json lang and the web app's second
  PUT are removed; the export reads the profile's language.
- The account part exports the e-mail address and its source
  (account/profile email, emailSource) through LocalUsersAPI.EmailOf.
- mail-sent, mail-failed (as "Cairn") and account-email-set land in
  audit/about-your-account.
- data-protection-operators inventory: row 36 is account-profiles.json;
  the mail outbox and mail state listed as not exported.
Merge remote-tracking branch 'origin/main' into dx1023
Some checks failed
ci / test-and-build (pull_request) Failing after 12m48s
27f59dbf03
ci: install icu-data-full for the web checks (a fresh runner pod lacked non-English locale data)
All checks were successful
ci / test-and-build (pull_request) Successful in 30m44s
dc4fb3f794
Cordy merged commit 553f6c475f into main 2026-10-30 02:10:06 +00:00
Sign in to join this conversation.
No reviewers
No labels
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: Cordy/Cairn#1051
No description provided.