MimirAnalytics.Row.EvalOutcome.Case (mimir_analytics v0.8.1)

Copy Markdown View Source

One typed, named case record: an eval report's results[] entry joined with its matching judge_results[] entry (by case_id) — replaces the untyped positional c/judge-map digs that used to feed eval_row/4 directly at the MimirAnalytics.Mappers.EvalReport call site.

Summary

Types

t()

Functions

new(c, judge)

Join a decoded results[] case with its (possibly absent — mechanical mode runs carry no judge) matching judge_results[] entry.

Types

t()

@type t() :: %MimirAnalytics.Row.EvalOutcome.Case{
  case_id: String.t(),
  elapsed_ms: integer() | nil,
  judge_elapsed_ms: integer() | nil,
  judge_passed: boolean() | nil,
  judge_reasoning: String.t() | nil,
  passed: boolean() | nil,
  reason: String.t() | nil,
  session_id: String.t() | nil
}

Functions

new(c, judge)

@spec new(map(), map()) :: t()

Join a decoded results[] case with its (possibly absent — mechanical mode runs carry no judge) matching judge_results[] entry.