Skip to content
dsh-hot
Benchmark

feat(benchmark): H4/H6/H12改用LLM评分,取消引文硬匹配

Source excerpt

改了什么 H4、H6、H12原来靠关键词给诊断报告打分,现在接入LLM评委,并补齐各题的rubric。 实跑发现,要求评委逐字抄引文会把换行、缩进差异判成评分失败。这次改为直接读完整答案,只返回分项判定、简短理由和封顶判断,由程序计算分数。H4允许删除原有的lib/index.js和lib/tsconfig.tsbuildinfo,H6/H12保持只读。

Automatically summarized from source discussions. Sources and the full record are available below.

Review record and full evidence

Evidence & timeline

Verification

Not yet verified

Maintainer response

Untriaged

Author response

No response recorded

Earliest source found so far

Unknown

Sep 12, 2026, 10:50 AM

Research & review record

Lifecycle

Emerging

Source scope

1 automatically linked original sources; source relationships and independence are not human reviewed

Attribution confidence · 0%

First found by this site · Sep 12, 2026, 10:58 AM

Evidence, test conditions and updates
Research & review record · Reviewed propagation graph
06

Reviewed propagation graph

00

No source-to-source propagation relation recorded.

Related stories

  • BenchmarkNot yet verified

    Investigation lead: feat(benchmark): S18 terminal sprite render trap (half-block SGR leak, trim ghosting, timer pinning)

    The lead source, “feat(benchmark): S18 terminal sprite render trap (half-block SGR leak, trim ghosting, timer pinning),” says: “Summary Adds benchmark task S18-terminal-sprite-render-trap (static, read-only report): a terminal half-block sprite renderer whose three independent rendering bugs (SGR background.” 36 related sources are linked for comparison to determine whether they describe the same event.

    42 sources· GitHub / Blog
  • BenchmarkNot yet verified

    Investigation lead: feat(benchmark): H22 not-listed trap — the package that installs but never registers

    The lead source, “feat(benchmark): H22 not-listed trap — the package that installs but never registers,” says: “Distilled from a real top-tier failure: anywhere-labs/dsh-desktop (22k★) failed our 50-plugin live verification on 09-01 with exactly this shape — dsh plugin add succeeds, the entr.” 31 related sources are linked for comparison to determine whether they describe the same event.

    32 sources· GitHub / Blog
  • BenchmarkNot yet verified

    Investigation lead: benchmark: step5-preview S1-S24 双臂运行归档 + 双判分结果

    The lead source, “benchmark: step5-preview S1-S24 双臂运行归档 + 双判分结果,” says: “StepFun Step 5 Preview(OpenCode Zen 供应,公开发布名;预览端点背后精确 checkpoint 未经独立验证;opencode 编排)在 S 系列基准上的完整 24 题双臂运行、双判分与重跑 follow-up 归档。.” This is currently the only captured source.

    4 sources· GitHub