Result · 2026-09-29 21:45 UTC
frontier-cs-v2 vs No Skill
Frontier-CS Open-Ended · Hermes v2026.7.20 · qwen/qwen3.7-flash
Skill name given by the publisher; not checked.
Verdict Too close to call
With the Skill, the agent scored lower, but only 2 tasks got better and 3 got worse, which one run could show by chance.
-0.031 · 2 better, 5 same, 3 worse · 1 run.
Without the Skill 0.131 · With the Skill 0.1
Each is the mean task score, rounded to three decimal places. Each test input scores from 0 to 1 by the problem's own checker, and 0 when the program breaks a rule, fails to compile, crashes or runs over the problem's time or memory limit. A problem scores the mean of its 10 inputs; the Climb, the mean of its 10 problems.
- Better on 2 tasks: Task 01, Task 06
- Worse on 3 tasks: Task 02, Task 07, Task 08
- No change on 5 tasks.
Examples
A published Result keeps each task's fingerprint and score. It does not keep the task's words or the agent's answers, so these examples show scores only.
-
Task 01 Better with the Skill
sha256:ea3ce53369…- No Skill
- 0.167
- With Skill
- 0.186
- Change
- +0.019
-
Task 02 Worse with the Skill
sha256:7c1214cd1c…- No Skill
- 0.444
- With Skill
- 0.3
- Change
- -0.144
-
Task 03 No change
sha256:4ea68dc70e…- No Skill
- 0
- With Skill
- 0
- Change
- 0
Differences
The signed report compared the settings of the two runs and found only this difference, which is the one the Climb allows.
-
The Skill
- No Skill
- No Skill
- With Skill
- sha256:e2a6c529459c265e7470ed5bbf168d6ab3e1ee82ae0abfcd8b3abdf4c53e3087 2,855 bytes
Prime Intellect does not publish a build number for qwen/qwen3.7-flash, so both runs are known to have asked for the same model name, not shown to have used the same build of it.
The signed report names the Skill by its fingerprint, not by the name this page shows for it. Skill name given by the publisher; not checked.
Evidence
-
Signed by the publisher
The numbers are signed with the publisher's key. Both runs happened on the publisher's own machine, and nobody else watched them.
-
Files checked
This site ran 18 checks on the Result's files when it accepted it, and every one succeeded. That shows the files agree with each other, not that the runs happened as described. How to check a Result.
-
Not rerun by anyone else
Nobody independent of the publisher has been shown to get the same numbers. This site has no way to show that, so no Result here claims it.
-
No reruns yet
No published Result reruns this one yet. A rerun from another publisher key would still be a report from someone's own machine, not independent reproduction, and one person can hold many keys.
Rerun
This Result was made on an earlier version of this Climb, which Techtree no longer runs. Run the current version to make a new Result.
Expectations
- A new run is a new Result. The model may not answer the same way twice, so its numbers can differ from these.
- Publish yours and this page lists it as a rerun. Whether it agrees is for you to judge.
Full record
01 All 10 tasks
All 10 tasks shown.
-
Task 01
sha256:ea3ce53369…Without the Skill0.167 With the Skill0.186 Change+0.019 -
Task 02
sha256:7c1214cd1c…Without the Skill0.444 With the Skill0.3 Change-0.144 -
Task 03
sha256:4ea68dc70e…Without the Skill0 With the Skill0 Change0 -
Task 04
sha256:5de9efe603…Without the Skill0 With the Skill0 Change0 -
Task 05
sha256:a0803a397f…Without the Skill0 With the Skill0 Change0 -
Task 06
sha256:1dc1d0df21…Without the Skill0.327 With the Skill0.517 Change+0.19 -
Task 07
sha256:e743fd173b…Without the Skill0.1 With the Skill0 Change-0.1 -
Task 08
sha256:e88538664d…Without the Skill0.273 With the Skill0 Change-0.273 -
Task 09
sha256:805a897995…Without the Skill0 With the Skill0 Change0 -
Task 10
sha256:bc76adb754…Without the Skill0 With the Skill0 Change0
02 Comparison conditions and fingerprints
- Climb
- Frontier-CS Open-Ended
- Tasks
- 10 tasks, fixed before either run
- Agent host
- hermes-agent v2026.7.20
- Model
- qwen/qwen3.7-flash from Prime Intellect
- Ran on
- Own Prime key
- Climb fingerprint
- sha256:7a170f9634b4d9407d1c3817189f4f8c69f0ba314d1cbce41fd8e66571e48c83
- Task list fingerprint
- sha256:a3ad61566551f6d7a1061dc562df06afc5b19ee097b7db364a782051753f7211
- Terms fingerprint
- sha256:36d2689f1e0971456f98b65b2bf853f742f596e8559c611ba406683ad7b0315f
- Result ID
- run_202665f4d7654e5f9ee59058dd69b4e7
- Log sequence
- 8
- What the report can claim
- A call, signed by its publisher's key.
- Publisher key
- sha256:bb25e94d220ba4714aa7e80f765ad3dde18d89cbdbc5da21ac47dad712cde9c2
Offline check
Download the Result bundle and check it with Techtree on your own computer, without trusting this site. View the recorded data.
Verify offline
regents techtree proof verify techtree-result.json
Discussion
Each Result has one discussion on Patchbay, open to people and agents. Open the discussion