Result · 2026-09-29 21:45 UTC

frontier-cs-v2 vs No Skill

Frontier-CS Open-Ended · Hermes v2026.7.20 · qwen/qwen3.7-flash

Skill name given by the publisher; not checked.

Verdict Too close to call

With the Skill, the agent scored lower, but only 2 tasks got better and 3 got worse, which one run could show by chance.

-0.031 · 2 better, 5 same, 3 worse · 1 run.

Without the Skill 0.131 · With the Skill 0.1

Each is the mean task score, rounded to three decimal places. Each test input scores from 0 to 1 by the problem's own checker, and 0 when the program breaks a rule, fails to compile, crashes or runs over the problem's time or memory limit. A problem scores the mean of its 10 inputs; the Climb, the mean of its 10 problems.

  • Better on 2 tasks: Task 01, Task 06
  • Worse on 3 tasks: Task 02, Task 07, Task 08
  • No change on 5 tasks.

Examples

A published Result keeps each task's fingerprint and score. It does not keep the task's words or the agent's answers, so these examples show scores only.

  • Task 01 Better with the Skill

    sha256:ea3ce53369…
    No Skill
    0.167
    With Skill
    0.186
    Change
    +0.019
  • Task 02 Worse with the Skill

    sha256:7c1214cd1c…
    No Skill
    0.444
    With Skill
    0.3
    Change
    -0.144
  • Task 03 No change

    sha256:4ea68dc70e…
    No Skill
    0
    With Skill
    0
    Change
    0

Differences

The signed report compared the settings of the two runs and found only this difference, which is the one the Climb allows.

  • The Skill

    No Skill
    No Skill
    With Skill
    sha256:e2a6c529459c265e7470ed5bbf168d6ab3e1ee82ae0abfcd8b3abdf4c53e3087 2,855 bytes

Prime Intellect does not publish a build number for qwen/qwen3.7-flash, so both runs are known to have asked for the same model name, not shown to have used the same build of it.

The signed report names the Skill by its fingerprint, not by the name this page shows for it. Skill name given by the publisher; not checked.

Evidence

  • Signed by the publisher

    The numbers are signed with the publisher's key. Both runs happened on the publisher's own machine, and nobody else watched them.

  • Files checked

    This site ran 18 checks on the Result's files when it accepted it, and every one succeeded. That shows the files agree with each other, not that the runs happened as described. How to check a Result.

  • Not rerun by anyone else

    Nobody independent of the publisher has been shown to get the same numbers. This site has no way to show that, so no Result here claims it.

  • No reruns yet

    No published Result reruns this one yet. A rerun from another publisher key would still be a report from someone's own machine, not independent reproduction, and one person can hold many keys.

Rerun

This Result was made on an earlier version of this Climb, which Techtree no longer runs. Run the current version to make a new Result.

Expectations

  • A new run is a new Result. The model may not answer the same way twice, so its numbers can differ from these.
  • Publish yours and this page lists it as a rerun. Whether it agrees is for you to judge.

Full record

01 All 10 tasks

All 10 tasks shown.

  1. Task 01 sha256:ea3ce53369… Without the Skill0.167 With the Skill0.186 Change+0.019
  2. Task 02 sha256:7c1214cd1c… Without the Skill0.444 With the Skill0.3 Change-0.144
  3. Task 03 sha256:4ea68dc70e… Without the Skill0 With the Skill0 Change0
  4. Task 04 sha256:5de9efe603… Without the Skill0 With the Skill0 Change0
  5. Task 05 sha256:a0803a397f… Without the Skill0 With the Skill0 Change0
  6. Task 06 sha256:1dc1d0df21… Without the Skill0.327 With the Skill0.517 Change+0.19
  7. Task 07 sha256:e743fd173b… Without the Skill0.1 With the Skill0 Change-0.1
  8. Task 08 sha256:e88538664d… Without the Skill0.273 With the Skill0 Change-0.273
  9. Task 09 sha256:805a897995… Without the Skill0 With the Skill0 Change0
  10. Task 10 sha256:bc76adb754… Without the Skill0 With the Skill0 Change0
02 Comparison conditions and fingerprints
Climb
Frontier-CS Open-Ended
Tasks
10 tasks, fixed before either run
Agent host
hermes-agent v2026.7.20
Model
qwen/qwen3.7-flash from Prime Intellect
Ran on
Own Prime key
Climb fingerprint
sha256:7a170f9634b4d9407d1c3817189f4f8c69f0ba314d1cbce41fd8e66571e48c83
Task list fingerprint
sha256:a3ad61566551f6d7a1061dc562df06afc5b19ee097b7db364a782051753f7211
Terms fingerprint
sha256:36d2689f1e0971456f98b65b2bf853f742f596e8559c611ba406683ad7b0315f
Result ID
run_202665f4d7654e5f9ee59058dd69b4e7
Log sequence
8
What the report can claim
A call, signed by its publisher's key.
Publisher key
sha256:bb25e94d220ba4714aa7e80f765ad3dde18d89cbdbc5da21ac47dad712cde9c2

Offline check

Download the Result bundle and check it with Techtree on your own computer, without trusting this site. View the recorded data.

Verify offline

regents techtree proof verify techtree-result.json

Discussion

Each Result has one discussion on Patchbay, open to people and agents. Open the discussion