mirror of
https://github.com/ThearchyHelios/AgentLab.git
synced 2026-11-15 00:21:58 +00:00
文档:回归评测「发起评测」的变体补「分析工具」开 / 关(缺省开)和「分析工具贡献」预设(开 vs 关);关的那一臂助手建图看不到分析工具和分析卡、工作流题不受影响、开关不同算不同变体、对比写「分析工具:开 → 关」。「看结果」里可比性那句改成:期望不可比时,正文明确说了两期不能直接比的也算对但没引用,期望可比的只能靠引用。升级说明的评测那一条补上这个开关和预设(开着的和升级前的评测算同一变体)。中英两边标题层级不变,check-docs 0 问题
This commit is contained in:
@@ -18,7 +18,7 @@ This page lists, newest first, the changes in each update that affect users and
|
||||
- The report export and the verifiable report include analysis conclusions and their input snapshots, recomputed from the sealed inputs for verification.
|
||||
- Settings gain a Preferences → Analysis section (see [Analysis settings](configuration.md#analysis-settings)). It is snapshotted into a run only when the graph has an analysis card or an agent with analysis tools, so the start records of other runs don't change at all.
|
||||
- Ask Data: Copilot gains a graph shape for analytical questions, and its self-check reminds it to give the querying agent the analysis tools (one round only). The review merges several analyses that couldn't be done into one "n analyses couldn't be done" note, without an automatic redo; analysis calls that were wrong but later fixed no longer count as a gap, and ones never fixed no longer trigger a redo of the whole turn.
|
||||
- Evaluation gains contribution and verdict expectations (computed from the expected SQL with the same analyses, never typed in by hand), and the scoring rules move to version 3, so old evaluations can be re-scored under the new rules; Copilot's prompt fingerprint now includes the analysis method, so comparisons with evaluations from before the upgrade flag "Prompt changed" (see [Regression evaluation](evaluation-and-ledger.md#regression-evaluation)).
|
||||
- Evaluation gains contribution and verdict expectations (computed from the expected SQL with the same analyses, never typed in by hand), and the scoring rules move to version 3, so old evaluations can be re-scored under the new rules; Copilot's prompt fingerprint now includes the analysis method, so comparisons with evaluations from before the upgrade flag "Prompt changed"; variants gain an analysis tools switch (on by default) and an Analysis tools contribution preset, and a variant with analysis tools on counts as the same variant as evaluations from before the upgrade (see [Regression evaluation](evaluation-and-ledger.md#regression-evaluation)).
|
||||
|
||||
## 2026-10, orchestration improvements wave 2: PostgreSQL and multiple processes
|
||||
|
||||
|
||||
Reference in New Issue
Block a user