Precision100.0% (±0.0%)
MODULE DETAIL
External Corpus Validation (PyJWT) Third-party
Classification claim · 4 test cases · tool: 1.171.0
This corpus is unmodified code from an independent third-party project, not something QShield's team generated — see the corpus notes below for provenance, licensing, and how ground truth was derived.
Every test case in this module: the expected result (ground truth -- for aws_discovery this includes the exact Moto resource configuration each case was scored against) paired with what the real scanner/collector actually reported, for all 4 cases -- not just the false positive/negative samples shown below.
Recall100.0% (±0.0%)
F11.000
Accuracy100.0% (±0.0%)
CONFUSION MATRIX
Outcome counts
True positives1
True negatives3
False positives0
False negatives0
RUN NOTES
Notes
- semgrep available: True
- 4 files vendored unmodified from jpadilla/pyjwt (MIT license, pinned commit 7144e4534c34810f4525dc4578a32addd8212cff) -- see benchmark/corpus/vendor/pyjwt/NOTICE.md
- Ground truth is QShield's own file-level classification, not borrowed from any PyJWT documentation -- see benchmark/corpus/pyjwt_quantum.py CLASSIFICATION for the evidence behind every verdict. Surfaced a real ES256/PS256 (JWA ECDSA/RSA-PSS) detection gap during construction, fixed before this corpus was scored.
CORPUS
Corpus composition
Cases4
Wall time3.8s
- semgrep available: True
- 4 files vendored unmodified from jpadilla/pyjwt (MIT license, pinned commit 7144e4534c34810f4525dc4578a32addd8212cff) -- see benchmark/corpus/vendor/pyjwt/NOTICE.md
- Ground truth is QShield's own file-level classification, not borrowed from any PyJWT documentation -- see benchmark/corpus/pyjwt_quantum.py CLASSIFICATION for the evidence behind every verdict. Surfaced a real ES256/PS256 (JWA ECDSA/RSA-PSS) detection gap during construction, fixed before this corpus was scored.
MISCLASSIFICATIONS
False positives & false negatives
None observed in this run.