← Explore Harbor-Index
arcagi2
arcagi2-grid-transform-de80
18 trials · 11.1% solve rate · task definition on Harbor Hub ↗
TP 2TN 16
Instruction
Below is a list of input and output pairs with a pattern. Your goal is to identify the pattern or transformation in the training examples that maps the input to the output, then apply that pattern to the test input to give a final output. Write your answer as a JSON 2D array to `/testbed/output.json`. --Training Examples-- --Example 0--
INPUT
20×20
OUTPUT
20×20
--Example 1--
INPUT
20×20
OUTPUT
20×20
--End of Training Examples--
--Test Input--
30×30
--End of Test Input-- You have up to 30 minutes (1800 seconds) to complete this task. Do not cheat by using online solutions or hints specific to this task.
Trials
| model | harness | outcome | reward | |
|---|---|---|---|---|
| GPT-5.5codex | codex | TP | 1.00 | view →view trajectory → |
| GPT-5.5terminus-2 | terminus-2 | TP | 1.00 | view →view trajectory → |
| DeepSeek V4claude-code | claude-code | TN | 0.00 | view →view trajectory → |
| DeepSeek V4terminus-2 | terminus-2 | TN | 0.00 | view →view trajectory → |
| Gemini 3.1gemini-cli | gemini-cli | TN | 0.00 | view →view trajectory → |
| Gemini 3.1terminus-2 | terminus-2 | TN | 0.00 | view →view trajectory → |
| GLM 5.2claude-code | claude-code | TN | 0.00 | view →view trajectory → |
| GLM 5.2terminus-2 | terminus-2 | TN | 0.00 | view →view trajectory → |
| Kimi K2.6claude-code | claude-code | TN | 0.00 | view →view trajectory → |
| Kimi K2.6terminus-2 | terminus-2 | TN | 0.00 | view →view trajectory → |
| MiMo V2.5claude-code | claude-code | TN | 0.00 | view →view trajectory → |
| MiMo V2.5terminus-2 | terminus-2 | TN | 0.00 | view →view trajectory → |
| MiniMax M3claude-code | claude-code | TN | 0.00 | view →view trajectory → |
| MiniMax M3terminus-2 | terminus-2 | TN | 0.00 | view →view trajectory → |
| Opus 4.8claude-code | claude-code | TN | 0.00 | view →view trajectory → |
| Opus 4.8terminus-2 | terminus-2 | TN | 0.00 | view →view trajectory → |
| Qwen3.7claude-code | claude-code | TN | 0.00 | view →view trajectory → |
| Qwen3.7terminus-2 | terminus-2 | TN | 0.00 | view →view trajectory → |