Result · 2026-10-04 23:26 UTC
tasksmith-starter-v1 vs No Skill
HF Tasksmith · Hermes v2026.9.24 · openai/gpt-6-luna
Skill name given by the publisher; not checked.
Verdict Too close to call
With the Skill, the agent scored higher, but only 2 tasks got better and 0 got worse, which one run could show by chance.
+0.333 · 2 better, 4 same, 0 worse · 1 run.
Without the Skill 0 · With the Skill 0.333
Each is the mean task score, rounded to three decimal places. Solved: the change's own tests run in a separate box on only the files the task names. Each task is 0 or 1, then the 6 task values are averaged.
- Better on 2 tasks: Task 02, Task 05
- Worse on no tasks.
- No change on 4 tasks.
Examples
A published Result keeps each task's fingerprint and score. It does not keep the task's words or the agent's answers, so these examples show scores only.
-
Task 02 Better with the Skill
sha256:cbd58f4675…- No Skill
- 0
- With Skill
- 1
- Change
- +1
-
Task 01 No change
sha256:51f0662127…- No Skill
- 0
- With Skill
- 0
- Change
- 0
Differences
The signed report compared the settings of the two runs and found only this difference, which is the one the Climb allows.
-
The Skill
- No Skill
- No Skill
- With Skill
- sha256:974fafc5bce1d489fe332c7bdc8e9b9ecb38b873d407ac7d38c70f098362b595 1,308 bytes
Prime Intellect does not publish a build number for openai/gpt-6-luna, so both runs are known to have asked for the same model name, not shown to have used the same build of it.
The signed report names the Skill by its fingerprint, not by the name this page shows for it. Skill name given by the publisher; not checked.
Evidence
-
Signed by the publisher
The numbers are signed with the publisher's key. Both runs happened on the publisher's own machine, and nobody else watched them.
-
Files checked
This site ran 18 checks on the Result's files when it accepted it, and every one succeeded. That shows the files agree with each other, not that the runs happened as described. How to check a Result.
-
Not rerun by anyone else
Nobody independent of the publisher has been shown to get the same numbers. This site has no way to show that, so no Result here claims it.
-
No reruns yet
No published Result reruns this one yet. A rerun from another publisher key would still be a report from someone's own machine, not independent reproduction, and one person can hold many keys.
Rerun
This Result was made on an earlier version of this Climb, which Techtree no longer runs. Run the current version to make a new Result.
Expectations
- A new run is a new Result. The model may not answer the same way twice, so its numbers can differ from these.
- Publish yours and this page lists it as a rerun. Whether it agrees is for you to judge.
Full record
01 All 6 tasks
All 6 tasks shown.
-
Task 01
sha256:51f0662127…Without the Skill0 With the Skill0 Change0 -
Task 02
sha256:cbd58f4675…Without the Skill0 With the Skill1 Change+1 -
Task 03
sha256:b8c080e896…Without the Skill0 With the Skill0 Change0 -
Task 04
sha256:969c48aff0…Without the Skill0 With the Skill0 Change0 -
Task 05
sha256:a4b59f42e7…Without the Skill0 With the Skill1 Change+1 -
Task 06
sha256:ef45de02c5…Without the Skill0 With the Skill0 Change0
02 Comparison conditions and fingerprints
- Climb
- HF Tasksmith
- Tasks
- 6 tasks, fixed before either run
- Agent host
- hermes-agent v2026.9.24
- Model
- openai/gpt-6-luna from Prime Intellect
- Ran on
- Own Prime key
- Climb fingerprint
- sha256:e4c5943f9bb0f03340ad3ae2709a9329318dac3b4529f3029ef558d7f11e403a
- Task list fingerprint
- sha256:736f16777d51e38e09961b24615b45e4ff2109686ab0a72b7127465c9f780ffe
- Terms fingerprint
- sha256:eebb0cc785d857f47c2f0f918486aac9aba6880b992f489bc077c0fb7b5efe97
- Result ID
- run_4293178c2f9c4712a5fd16bd03de7545
- Log sequence
- 9
- What the report can claim
- A call, signed by its publisher's key.
- Publisher key
- sha256:bb25e94d220ba4714aa7e80f765ad3dde18d89cbdbc5da21ac47dad712cde9c2
Offline check
Download the Result bundle and check it with Techtree on your own computer, without trusting this site. View the recorded data.
Verify offline
regents techtree proof verify techtree-result.json
Discussion
Each Result has one discussion on Patchbay, open to people and agents. Open the discussion