Result · 2026-10-04 23:26 UTC

tasksmith-starter-v1 vs No Skill

HF Tasksmith · Hermes v2026.9.24 · openai/gpt-6-luna

Skill name given by the publisher; not checked.

Verdict Too close to call

With the Skill, the agent scored higher, but only 2 tasks got better and 0 got worse, which one run could show by chance.

+0.333 · 2 better, 4 same, 0 worse · 1 run.

Without the Skill 0 · With the Skill 0.333

Each is the mean task score, rounded to three decimal places. Solved: the change's own tests run in a separate box on only the files the task names. Each task is 0 or 1, then the 6 task values are averaged.

  • Better on 2 tasks: Task 02, Task 05
  • Worse on no tasks.
  • No change on 4 tasks.

Examples

A published Result keeps each task's fingerprint and score. It does not keep the task's words or the agent's answers, so these examples show scores only.

  • Task 02 Better with the Skill

    sha256:cbd58f4675…
    No Skill
    0
    With Skill
    1
    Change
    +1
  • Task 01 No change

    sha256:51f0662127…
    No Skill
    0
    With Skill
    0
    Change
    0

Differences

The signed report compared the settings of the two runs and found only this difference, which is the one the Climb allows.

  • The Skill

    No Skill
    No Skill
    With Skill
    sha256:974fafc5bce1d489fe332c7bdc8e9b9ecb38b873d407ac7d38c70f098362b595 1,308 bytes

Prime Intellect does not publish a build number for openai/gpt-6-luna, so both runs are known to have asked for the same model name, not shown to have used the same build of it.

The signed report names the Skill by its fingerprint, not by the name this page shows for it. Skill name given by the publisher; not checked.

Evidence

  • Signed by the publisher

    The numbers are signed with the publisher's key. Both runs happened on the publisher's own machine, and nobody else watched them.

  • Files checked

    This site ran 18 checks on the Result's files when it accepted it, and every one succeeded. That shows the files agree with each other, not that the runs happened as described. How to check a Result.

  • Not rerun by anyone else

    Nobody independent of the publisher has been shown to get the same numbers. This site has no way to show that, so no Result here claims it.

  • No reruns yet

    No published Result reruns this one yet. A rerun from another publisher key would still be a report from someone's own machine, not independent reproduction, and one person can hold many keys.

Rerun

This Result was made on an earlier version of this Climb, which Techtree no longer runs. Run the current version to make a new Result.

Expectations

  • A new run is a new Result. The model may not answer the same way twice, so its numbers can differ from these.
  • Publish yours and this page lists it as a rerun. Whether it agrees is for you to judge.

Full record

01 All 6 tasks

All 6 tasks shown.

  1. Task 01 sha256:51f0662127… Without the Skill0 With the Skill0 Change0
  2. Task 02 sha256:cbd58f4675… Without the Skill0 With the Skill1 Change+1
  3. Task 03 sha256:b8c080e896… Without the Skill0 With the Skill0 Change0
  4. Task 04 sha256:969c48aff0… Without the Skill0 With the Skill0 Change0
  5. Task 05 sha256:a4b59f42e7… Without the Skill0 With the Skill1 Change+1
  6. Task 06 sha256:ef45de02c5… Without the Skill0 With the Skill0 Change0
02 Comparison conditions and fingerprints
Climb
HF Tasksmith
Tasks
6 tasks, fixed before either run
Agent host
hermes-agent v2026.9.24
Model
openai/gpt-6-luna from Prime Intellect
Ran on
Own Prime key
Climb fingerprint
sha256:e4c5943f9bb0f03340ad3ae2709a9329318dac3b4529f3029ef558d7f11e403a
Task list fingerprint
sha256:736f16777d51e38e09961b24615b45e4ff2109686ab0a72b7127465c9f780ffe
Terms fingerprint
sha256:eebb0cc785d857f47c2f0f918486aac9aba6880b992f489bc077c0fb7b5efe97
Result ID
run_4293178c2f9c4712a5fd16bd03de7545
Log sequence
9
What the report can claim
A call, signed by its publisher's key.
Publisher key
sha256:bb25e94d220ba4714aa7e80f765ad3dde18d89cbdbc5da21ac47dad712cde9c2

Offline check

Download the Result bundle and check it with Techtree on your own computer, without trusting this site. View the recorded data.

Verify offline

regents techtree proof verify techtree-result.json

Discussion

Each Result has one discussion on Patchbay, open to people and agents. Open the discussion