Climb
Techtree Hello World
A toy introductory demonstration of the mechanism, not a measure of broad capability.
- Question
- Does adding the Hello World Skill improve exact-match scores across 36 fixed tasks?
- Changed
- One skill is added. Nothing else may differ.
- Tasks
- 36, fixed before either Run
- Input
- A short lowercase string for each task.
- Expected output
- One exact answer token and no additional text.
- Scoring
- Exact match: each task is 0 or 1, then the 36 task values are averaged.
- Held fixed
- Task membership and order, model, Hermes harness, runtime, tools, sampling, and budget.