SikongJueluo/pi-extensions
1
0
Fork 0
mirror of https://github.com/SikongJueluo/pi-extensions.git synced 2026-10-05 11:52:55 +08:00
Code Issues Packages Projects Releases Wiki Activity

docs(research): archive shadow replay rounds and analyzer round-1 fixes

Browse Source 
- rejoin round-1 rows hidden by terminal-event handling: normalize denied_with_reason, collapse forwarded double terminal rows, print quarantine counts, add --before window bound
- archive rounds 1-3 reports with blind-deny protocol, cross-round totals, and PIEXTENSIO-11 latency evidence
This commit is contained in:
SikongJueluo
2026-08-17 18:59:19 +08:00
parent ea7d93d63f
commit 850f36c7a4
8 changed files with 211 additions and 22 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/research/rounds/round-1-report.txt
+11 -10
View File
@@ -1,26 +1,27 @@
AI Bash Judge — Shadow diagnostic report
grade: DIAGNOSTIC (reconstructed join; not promotion-grade)
asOf: 2026-08-17T07:27:08.851Z
asOf: 2026-08-17T09:56:55.094Z
source: /home/sikongjueluo/.pi/agent/extensions/pi-permission-system/logs/pi-permission-system-permission-review.jsonl
enrollments (N): 9
joined rows: 5
joined judgments: 5
joined rows: 9
joined judgments: 6
completion coverage: 55.6%
human-join coverage: 55.6%
judgment coverage: 55.6%
completion coverage: 100.0%
human-join coverage: 100.0%
judgment coverage: 66.7%
comparison matrix [verdict|human]:
allow|allow: 3
allow|deny: 1
defer|allow: 1
deny|allow: 1
false allows: 0 (rate 0.0%)
false allows: 1 (rate 25.0%)
conservative: deny 1, defer 1 (rate 40.0%)
preflight defers: 0
preflight defers: 3
infrastructure failures: 0
judge latency: p50=6009ms p95=9052ms max=9052ms missing=0
model latency: p50=6009ms p95=9052ms max=9052ms missing=0
judge latency: p50=4231ms p95=9052ms max=9052ms missing=0
model latency: p50=4317ms p95=9052ms max=9052ms missing=3
docs/research/rounds/round-2-report.txt
+26
View File
@@ -0,0 +1,26 @@
AI Bash Judge — Shadow diagnostic report
grade: DIAGNOSTIC (reconstructed join; not promotion-grade)
asOf: 2026-08-17T10:22:22.035Z
source: /home/sikongjueluo/.pi/agent/extensions/pi-permission-system/logs/pi-permission-system-permission-review.jsonl
enrollments (N): 5
joined rows: 5
joined judgments: 5
completion coverage: 100.0%
human-join coverage: 100.0%
judgment coverage: 100.0%
comparison matrix [verdict|human]:
allow|allow: 2
allow|deny: 1
defer|allow: 2
false allows: 1 (rate 33.3%)
conservative: deny 0, defer 2 (rate 50.0%)
preflight defers: 0
infrastructure failures: 0
judge latency: p50=3427ms p95=4367ms max=4367ms missing=0
model latency: p50=3427ms p95=4367ms max=4367ms missing=0
docs/research/rounds/round-3-report.txt
+26
View File
@@ -0,0 +1,26 @@
AI Bash Judge — Shadow diagnostic report
grade: DIAGNOSTIC (reconstructed join; not promotion-grade)
asOf: 2026-08-17T10:43:52.269Z
source: /home/sikongjueluo/.pi/agent/extensions/pi-permission-system/logs/pi-permission-system-permission-review.jsonl
enrollments (N): 5
joined rows: 5
joined judgments: 5
completion coverage: 100.0%
human-join coverage: 100.0%
judgment coverage: 100.0%
comparison matrix [verdict|human]:
allow|allow: 3
defer|allow: 1
defer|deny: 1
false allows: 0 (rate 0.0%)
conservative: deny 0, defer 1 (rate 25.0%)
preflight defers: 0
infrastructure failures: 0
judge latency: p50=4223ms p95=11949ms max=11949ms missing=0
model latency: p50=4223ms p95=11949ms max=11949ms missing=0