docs(runbook): add B8 static IP baseline (WinBuild2022, 4 iterations)

Static IP via ip_pool: 24 s boot-to-ready vs 102 s DHCP (4x faster),
IP acquire now deterministic (σ < 0.03 s vs σ ≈ 57 s with DHCP).

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-05-25 22:26:09 +02:00
parent e538c0c037
commit c9549c1db2
+40
View File
@@ -415,3 +415,43 @@ Windows (σ ≈ 26 s). This is VMware Tools DHCP/guestinfo reporting latency,
not a regression in orchestrator logic. With 4 samples the avg is not stable; not a regression in orchestrator logic. With 4 samples the avg is not stable;
additional runs may close the gap. No non-IP phase regressed. additional runs may close the gap. No non-IP phase regressed.
---
## 8. Static IP baseline — WinBuild2022 with ip_pool (B8 result)
Recorded 2026-05-25 — `Measure-CIBenchmark.ps1 -StaticIP 192.168.79.200 -Iterations 4`,
Linux Mint host, template `WinBuild2022` / snapshot `BaseClean`.
`guestinfo.ip-assignment` injected into cloned VMX before start;
`ci-static-ip.ps1` scheduled task applies IP at boot and writes back
`guestinfo.ci-ip`. IP column = time until `guestinfo.ci-ip` readable via
`vmrun readVariable` (`-GuestInfoOnly` mode — DHCP fallback disabled).
Ready column = WinRM/5986 TCP probe after IP known.
| Iter | Clone (s) | Start (s) | IP acquire (s) | Ready (s) | Destroy (s) | Boot total (s) |
| ------- | --------- | --------- | -------------- | --------- | ----------- | -------------- |
| 1 | 0.41 | 1.86 | 21.80 | 0.00 | 9.75 | 24.07 |
| 2 | 0.40 | 1.88 | 21.74 | 0.00 | 9.81 | 24.02 |
| 3 | 0.40 | 1.90 | 21.75 | 0.00 | 12.26 | 24.05 |
| 4 | 0.40 | 1.89 | 21.77 | 0.00 | 9.77 | 24.06 |
| **avg** | **0.40** | **1.88** | **21.77** | **0.00** | **10.40** | **24.05** |
**Comparison vs B7 DHCP baseline (WinBuild2025, same host):**
| Metric | B7 DHCP avg | B8 static avg | Delta |
| ----------- | ----------- | ------------- | ------------- |
| IP acquire | 99.7 s | 21.8 s | **78 s (78%)** |
| Boot total | 102.3 s | 24.1 s | **78 s (76%)** |
| Clone | 0.44 s | 0.40 s | ≈ same |
| Start | 2.12 s | 1.88 s | ≈ same |
| Ready | 0.01 s | 0.00 s | ≈ same |
**Key findings**:
- Static IP reduces boot-to-ready from ~102 s to ~24 s — **4× faster**.
- IP acquire is now deterministic: σ < 0.03 s (vs σ ≈ 57 s with DHCP).
- Ready = 0 s: WinRM is already listening on the static IP by the time
`guestinfo.ci-ip` is written — no additional TCP probe wait.
- `ci-static-ip.ps1` startup latency (~21.8 s) is the new floor; it reflects
Windows boot + Task Scheduler + NIC reconfiguration time.
- Destroy is slower on WinBuild2022 (~10 s vs ~5 s on WinBuild2025) —
unrelated to static IP; likely VMDK or snapshot difference.