feat(catalog): add loader for security-evaluations.ndjson

[pboyd]

Description

Load security-evaluations.ndjson into a security-metrics metrics arifact when the performance metrics are loaded.

How Has This Been Tested?

I added some examples to the demo performance data. It can be queried, if you're running the demo overlay for tilt:

$ curl -s "http://localhost:8082/api/model_catalog/v1alpha1/sources/validated_ai_models/models/certified/analytics-forecaster-5b/artifacts?filterQuery=metricsType.string_value=%22security-metrics%22" | jq '.
items[]'
{
  "artifactType": "metrics-artifact",
  "createTimeSinceEpoch": "1780576659176",
  "customProperties": {
    "benchmark": {
      "metadataType": "MetadataStringValue",
      "string_value": "intents"
    },
    "category": {
      "metadataType": "MetadataStringValue",
      "string_value": "security"
    },
    "description": {
      "metadataType": "MetadataStringValue",
      "string_value": "Risk assessment with a context-aware custom intent typology and probes of increasing complexity. Runs as an AI Pipeline and requires a Data Science Pipelines setup."
    },
    "evaluation": {
      "metadataType": "MetadataStringValue",
      "string_value": "Context-aware vulnerability scan (Pipeline)"
    },
    "id": {
      "metadataType": "MetadataStringValue",
      "string_value": "b1c2d3e4-3001-4000-a000-000000000005"
    },
    "lower_is_better": {
      "bool_value": true,
      "metadataType": "MetadataBoolValue"
    },
    "model_id": {
      "metadataType": "MetadataStringValue",
      "string_value": "certified/analytics-forecaster-5b"
    },
    "pass": {
      "bool_value": false,
      "metadataType": "MetadataBoolValue"
    },
    "provider_id": {
      "metadataType": "MetadataStringValue",
      "string_value": "garak-kfp"
    },
    "result": {
      "double_value": 0.65,
      "metadataType": "MetadataDoubleValue"
    },
    "result_metric": {
      "metadataType": "MetadataStringValue",
      "string_value": "attack_success_rate"
    },
    "threshold": {
      "double_value": 0.3,
      "metadataType": "MetadataDoubleValue"
    }
  },
  "externalId": "b1c2d3e4-3001-4000-a000-000000000005",
  "id": "259215",
  "lastUpdateTimeSinceEpoch": "1780576659176",
  "metricsType": "security-metrics",
  "name": "security-b1c2d3e4-3001-4000-a000-000000000005"
}

Merge criteria:

• All the commits have been signed-off (To pass the DCO check)

• The commits have meaningful messages
• Automated tests are provided as part of the PR for major new functionalities; testing instructions have been added in the PR body (for PRs involving changes that are not immediately obvious).
• The developer has manually tested the changes and verified that the changes work.
• Code changes follow the kubeflow contribution guidelines.

[google-oss-prow]

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
Once this PR has been reviewed and has the lgtm label, please ask for approval from pboyd. For more information see the Kubernetes Code Review Process.

The full list of commands accepted by this bot can be found here.

Details

Needs approval from an approver in each of these files:

• OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment