Precision100.0% (±0.0%)
MODULE DETAIL
AWS Discovery Self-generated
Classification claim · 2,136 test cases · tool: qshield.aws.collectors
Every test case in this module: the expected result (ground truth -- for aws_discovery this includes the exact Moto resource configuration each case was scored against) paired with what the real scanner/collector actually reported, for all 2,136 cases -- not just the false positive/negative samples shown below.
Recall100.0% (±0.0%)
F11.000
Accuracy100.0% (±0.0%)
CONFUSION MATRIX
Outcome counts
True positives1,286
True negatives850
False positives0
False negatives0
RUN NOTES
Notes
- corpus composition: {'acm_certs': 480, 'acm_occurrences': 960, 'kms_keys': 500, 's3_buckets': 400, 'rds_instances': 76, 'ecr_repos': 200, 'total_ground_truth': 2136}
- Moto's ACM backend raises AttributeError describing Ed25519/Ed448 certificates (assumes every key has .key_size); excluded from this corpus, covered instead by the standalone certificates module corpus.
CORPUS
Corpus composition
Cases2,136
Wall time98.9s
- corpus composition: {'acm_certs': 480, 'acm_occurrences': 960, 'kms_keys': 500, 's3_buckets': 400, 'rds_instances': 76, 'ecr_repos': 200, 'total_ground_truth': 2136}
- Moto's ACM backend raises AttributeError describing Ed25519/Ed448 certificates (assumes every key has .key_size); excluded from this corpus, covered instead by the standalone certificates module corpus.
MISCLASSIFICATIONS
False positives & false negatives
None observed in this run.