Data-quality roadmap: R-A–R-F + DQ-5 fixes (citations 590→1075, section signal 10%→95%) #16

Merged
user2595 merged 31 commits from integration/roadmap into main 2026-06-27 07:12:31 +00:00
Showing only changes of commit 49c251eafa - Show all commits

View File

@@ -4,21 +4,18 @@ Everything still open after this session. Done items are in
`docs/audit/DATA-QUALITY-2026-06-15.md` (DQ-1..DQ-5 + roadmap R-A,R-B,R-C,R-D,R-F all
DONE; R-E deferred). This file is only the **loose ends**.
## 1. BLOCKER — Jetson is offline
- The Jetson (`192.168.178.103`) went **unreachable** mid-session: `ping` 100 % loss,
`ssh:22` timeout. It hosts Postgres (the live corpus) **and** GROBID.
- **Blocks every live-DB action below.** First step next session: confirm it's powered
+ on the network, bring the SSH tunnel back up
(`ssh -f -N -L 5433:localhost:5432 alfred@192.168.178.103`).
## 1. ✅ RESOLVED — Jetson is online (the tunnel had dropped, not the host)
- What looked like the Jetson going offline was the **SSH tunnel** breaking, not the
host. The Jetson (`192.168.178.103`) is online. Re-open the tunnel with keepalive:
`ssh -o ServerAliveInterval=15 -f -N -L 5433:localhost:5432 alfred@192.168.178.103`.
Better still: run long ops in tmux-on-Jetson (item #4) to avoid the tunnel entirely.
## 2. PENDING — R-F accent re-clean (cosmetic, code already merged into the branch)
- R-F is functionally DONE (section signal 34/329 → **314/329 = 95 %**), but a few live
`chunks.section` labels still carry LaTeX accents/ties (e.g. `m\"obius`, `colin~de~…`).
- The `_clean_title` polish that fixes these is committed on `feat/section-labels`; the
**in-place re-clean of existing rows didn't finish** (Jetson went offline, item #1).
- **Action when Jetson is back (short UPDATE, no re-ingest):** apply
`codex.quality._clean_title` to every `chunks.section` containing `\` or `~` and write
it back. Quick + idempotent — exactly the kind of short op that survives a flaky link.
## 2. ✅ DONE — R-F accent re-clean
- R-F is functionally DONE (section signal 34/329 → **314/329 = 95 %**). The remaining
cosmetic accent/tie artifacts in live `chunks.section` labels were re-cleaned in place
once the tunnel was back: applied `codex.quality._clean_title` to every label
containing `\` or `~`**8 labels fixed**, no re-embed. Verified **0 artifacts**
remain. R-F fully complete.
## 3. Git — feature branches not merged to `main`
This session's work is on 5 branches off `audit/loop-1` (itself **18 commits ahead of