You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
CallableTarget passes the scenario's evaluation-only document marks to the wrapped function #126
In a multi-turn audit, run_scenario calls target.send(history=conversation). As described under Target.send, the conversation carries the engine's markers:
the first user turn has documents, with the evaluation-only marks (relevant, true, authority, source, validity dates), and file_uri;
a decision model's replies have decision.
CallableTarget.send passes history to the wrapped function unchanged (simpleaudit/targets/callable.py). A function that hands the history to its own model or pipeline therefore shows the scenario's ground truth to the system under test.
The documents argument stays None on this path, so the function can only reach the documents through the marker, marks included.
Activity