Refactor documentation and analysis in final master plan, opus47 analysis, and opus47 review of GPT-5.5

- Updated the final master plan to improve clarity and consistency in the status of various capabilities, including fixes and enhancements made as of 2026-05-12.
- Revised the opus47 analysis to provide a more structured overview of the system's production readiness, including detailed coverage of OWASP Top 10 risks and operational gaps.
- Enhanced the opus47 review of GPT-5.5 by clarifying severity ratings and rationales for various items, while adding new high-severity items that were previously overlooked.
This commit is contained in:
Simone
2026-05-13 00:08:19 +02:00
parent 5d1b47e943
commit 3592dcab78
13 changed files with 350 additions and 343 deletions
+20 -20
View File
@@ -241,26 +241,26 @@ The other GPT-5.5 recommendations respect PS 5.1, VMware Workstation single-host
## 7. Priority Validation
| GPT-5.5 Severity | Item | My Verdict | Rationale |
| --- | --- | --- | --- |
| CRITICAL | Composite action outputs structure | Should be HIGH | Step-level outputs work today; only caller-facing action interface is broken. Latent, not active. |
| CRITICAL | Linux extra guest env secret logging | CRITICAL (concur) | Active leak path. |
| CRITICAL | Linux Mode 2 PAT in SSH command | HIGH-CRITICAL boundary | PAT visibility limited to host argv + guest /proc. Real but bounded. I would put HIGH; CRITICAL is defensible. |
| HIGH | vmrun unbounded calls | HIGH (concur) | |
| HIGH | Stale vm-start.lock | HIGH (concur) | |
| HIGH | Setup-Host stale dirs | HIGH (concur) | |
| HIGH | Backup default path | HIGH (concur) | |
| HIGH | Failure-path diagnostics | Should be MEDIUM | Quality-of-life, not operational-trust. |
| HIGH | Test plan PS7 / wrong params | Should be MEDIUM | Documentation-only. |
| HIGH | Shared cache not wired | Should be MEDIUM | Documented feature missing, performance impact only. |
| MEDIUM | JobId not sanitized | Should be LOW | Local-only attack surface in single-tenant homelab. |
| MEDIUM | Wait-VMReady TCP-only check | MEDIUM (concur) | |
| MEDIUM | CI-FLOW doc claims partial artifacts | Should be LOW | Pure docs. |
| MEDIUM | Validate-SetupState PasswordExpires | MEDIUM (concur) | Validation failure mode. |
| MEDIUM | Ubuntu VMDK no hash | MEDIUM (concur) | |
| MEDIUM | Installer hash placeholders | MEDIUM (concur for homelab) | |
| MEDIUM | Event Log / task name drift | Should be LOW | Tests fail not scripts. |
| MEDIUM | _Transport.psm1 host-key handling | MEDIUM (concur) | |
| GPT-5.5 Severity | Item | My Verdict | Rationale |
| ---------------- | ------------------------------------ | --------------------------- | -------------------------------------------------------------------------------------------------------------- |
| CRITICAL | Composite action outputs structure | Should be HIGH | Step-level outputs work today; only caller-facing action interface is broken. Latent, not active. |
| CRITICAL | Linux extra guest env secret logging | CRITICAL (concur) | Active leak path. |
| CRITICAL | Linux Mode 2 PAT in SSH command | HIGH-CRITICAL boundary | PAT visibility limited to host argv + guest /proc. Real but bounded. I would put HIGH; CRITICAL is defensible. |
| HIGH | vmrun unbounded calls | HIGH (concur) | |
| HIGH | Stale vm-start.lock | HIGH (concur) | |
| HIGH | Setup-Host stale dirs | HIGH (concur) | |
| HIGH | Backup default path | HIGH (concur) | |
| HIGH | Failure-path diagnostics | Should be MEDIUM | Quality-of-life, not operational-trust. |
| HIGH | Test plan PS7 / wrong params | Should be MEDIUM | Documentation-only. |
| HIGH | Shared cache not wired | Should be MEDIUM | Documented feature missing, performance impact only. |
| MEDIUM | JobId not sanitized | Should be LOW | Local-only attack surface in single-tenant homelab. |
| MEDIUM | Wait-VMReady TCP-only check | MEDIUM (concur) | |
| MEDIUM | CI-FLOW doc claims partial artifacts | Should be LOW | Pure docs. |
| MEDIUM | Validate-SetupState PasswordExpires | MEDIUM (concur) | Validation failure mode. |
| MEDIUM | Ubuntu VMDK no hash | MEDIUM (concur) | |
| MEDIUM | Installer hash placeholders | MEDIUM (concur for homelab) | |
| MEDIUM | Event Log / task name drift | Should be LOW | Tests fail not scripts. |
| MEDIUM | _Transport.psm1 host-key handling | MEDIUM (concur) | |
Items I would add at HIGH that GPT-5.5 missed: `act_runner` SYSTEM-vs-user SSH alias mismatch (verifiable, runtime-reachable), `ci-report-ip.service` missing from `Validate-DeployState.ps1` (silent 120 s timeout), `capacity: 4` burn-in not run (concurrency claim unmeasured).