MODULE DETAIL

Network Services Self-generated

Classification claim · 770 test cases · tool: python-ssl/local-server

Every test case in this module: the expected result (ground truth -- for aws_discovery this includes the exact Moto resource configuration each case was scored against) paired with what the real scanner/collector actually reported, for all 770 cases -- not just the false positive/negative samples shown below.

Precision100.0% (±0.0%)

Recall96.2% (±1.3%)

F10.981

Accuracy96.2% (±1.3%)

CONFUSION MATRIX

Outcome counts

True positives741

True negatives0

False positives0

False negatives29

RUN NOTES

Notes

29 handshake failures out of 770
cipher-suite observability: 370 cases forced to TLS 1.2 (cipher must be classified), 400 left at the server's TLS default (cipher must be honestly marked not-observable if it negotiates TLS 1.3); 0 mismatches

CORPUS

Corpus composition

Cases770

Wall time52.7s

29 handshake failures out of 770
cipher-suite observability: 370 cases forced to TLS 1.2 (cipher must be classified), 400 left at the server's TLS default (cipher must be honestly marked not-observable if it negotiates TLS 1.3); 0 mismatches

MISCLASSIFICATIONS

False positives & false negatives

False positives (0)

[]

False negatives (15)

[
  {
    "case_id": "network_services:DSA-2048:00714",
    "outcome": "FN",
    "detail": {
      "family": "DSA-2048",
      "observed_status": "not_reported",
      "observed_tls_version": null,
      "observed_cipher_status": null
    }
  },
  {
    "case_id": "network_services:DSA-2048:00715",
    "outcome": "FN",
    "detail": {
      "family": "DSA-2048",
      "observed_status": "not_reported",
      "observed_tls_version": null,
      "observed_cipher_status": null
    }
  },
  {
    "case_id": "network_services:DSA-2048:00716",
    "outcome": "FN",
    "detail": {
      "family": "DSA-2048",
      "observed_status": "not_reported",
      "observed_tls_version": null,
      "observed_cipher_status": null
    }
  },
  {
    "case_id": "network_services:DSA-2048:00717",
    "outcome": "FN",
    "detail": {
      "family": "DSA-2048",
      "observed_status": "not_reported",
      "observed_tls_version": null,
      "observed_cipher_status": null
    }
  },
  {
    "case_id": "network_services:DSA-2048:00718",
    "outcome": "FN",
    "detail": {
      "family": "DSA-2048",
      "observed_status": "not_reported",
      "observed_tls_version": null,
      "observed_cipher_status": null
    }
  },
  {
    "case_id": "network_services:DSA-2048:00719",
    "outcome": "FN",
    "detail": {
      "family": "DSA-2048",
      "observed_status": "not_reported",
      "observed_tls_version": null,
      "observed_cipher_status": null
    }
  },
  {
    "case_id": "network_services:DSA-2048:00720",
    "outcome": "FN",
    "detail": {
      "family": "DSA-2048",
      "observed_status": "not_reported",
      "observed_tls_version": null,
      "observed_cipher_status": null
    }
  },
  {
    "case_id": "network_services:DSA-2048:00721",
    "outcome": "FN",
    "detail": {
      "family": "DSA-2048",
      "observed_status": "not_reported",
      "observed_tls_version": null,
      "observed_cipher_status": null
    }
  },
  {
    "case_id": "network_services:DSA-2048:00722",
    "outcome": "FN",
    "detail": {
      "family": "DSA-2048",
      "observed_status": "not_reported",
      "observed_tls_version": null,
      "observed_cipher_status": null
    }
  },
  {
    "case_id": "network_services:DSA-2048:00723",
    "outcome": "FN",
    "detail": {
      "family": "DSA-2048",
      "observed_status": "not_reported",
      "observed_tls_version": null,
      "observed_cipher_status": null
    }
  },
  {
    "case_id": "network_services:DSA-2048:00724",
    "outcome": "FN",
    "detail": {
      "family": "DSA-2048",
      "observed_status": "not_reported",
      "observed_tls_version": null,
      "observed_cipher_status": null
    }
  },
  {
    "case_id": "network_services:DSA-2048:00725",
    "outcome": "FN",
    "detail": {
      "family": "DSA-2048",
      "observed_status": "not_reported",
      "observed_tls_version": null,
      "observed_cipher_status": null
    }
  },
  {
    "case_id": "network_services:DSA-2048:00726",
    "outcome": "FN",
    "detail": {
      "family": "DSA-2048",
      "observed_status": "not_reported",
      "observed_tls_version": null,
      "observed_cipher_status": null
    }
  },
  {
    "case_id": "network_services:DSA-2048:00727",
    "outcome": "FN",
    "detail": {
      "family": "DSA-2048",
      "observed_status": "not_reported",
      "observed_tls_version": null,
      "observed_cipher_status": null
    }
  },
  {
    "case_id": "network_services:DSA-2048:00728",
    "outcome": "FN",
    "detail": {
      "family": "DSA-2048",
      "observed_status": "not_reported",
      "observed_tls_version": null,
      "observed_cipher_status": null
    }
  }
]