← Explore Harbor-Index
labbench
labbench-count-deg-in-pathway
18 trials · 27.8% solve rate · task definition on Harbor Hub ↗
TP 5TN 13
Instruction
The full question, answer options, and required response format for this run are in /app/instruction.md. Read that file and follow it.
You have up to 20 minutes (1200 seconds) to complete this task. Do not cheat by using online solutions or hints specific to this task.
Trials
| model | harness | outcome | reward | |
|---|---|---|---|---|
| Gemini 3.1gemini-cli | gemini-cli | TP | 1.00 | view →view trajectory → |
| GLM 5.2terminus-2 | terminus-2 | TP | 1.00 | view →view trajectory → |
| GPT-5.5codex | codex | TP | 1.00 | view →view trajectory → |
| GPT-5.5terminus-2 | terminus-2 | TP | 1.00 | view →view trajectory → |
| Opus 4.8claude-code | claude-code | TP | 1.00 | view →view trajectory → |
| DeepSeek V4claude-code | claude-code | TN | 0.00 | view →view trajectory → |
| DeepSeek V4terminus-2 | terminus-2 | TN | 0.00 | view →view trajectory → |
| Gemini 3.1terminus-2 | terminus-2 | TN | 0.00 | view →view trajectory → |
| GLM 5.2claude-code | claude-code | TN | — | view →view trajectory → |
| Kimi K2.6claude-code | claude-code | TN | 0.00 | view →view trajectory → |
| Kimi K2.6terminus-2 | terminus-2 | TN | 0.00 | view →view trajectory → |
| MiMo V2.5claude-code | claude-code | TN | — | view →view trajectory → |
| MiMo V2.5terminus-2 | terminus-2 | TN | 0.00 | view →view trajectory → |
| MiniMax M3claude-code | claude-code | TN | 0.00 | view →view trajectory → |
| MiniMax M3terminus-2 | terminus-2 | TN | 0.00 | view →view trajectory → |
| Opus 4.8terminus-2 | terminus-2 | TN | 0.00 | view →view trajectory → |
| Qwen3.7claude-code | claude-code | TN | 0.00 | view →view trajectory → |
| Qwen3.7terminus-2 | terminus-2 | TN | 0.00 | view →view trajectory → |