bixbench

bix-immune-pathway-enrichment

18 trials · 0% solve rate · task definition on Harbor Hub ↗

TN 18

Instruction

Answer the following question.

What percentage of screening conditions, excluding no T cells control, showed significant enrichment (adjusted p-value < 0.05) of immune-relevant pathways?

Analyze the data files in /workspace/.

Write your final answer — just the number — to /workspace/answer.txt. For example, if your answer is 10%:

echo '10%' > /workspace/answer.txt

You have up to 20 minutes (1200 seconds) to complete this task. Do not cheat by using online solutions or hints specific to this task.

Trials

model	harness	outcome
DeepSeek V4claude-code	claude-code	TN	view →view trajectory →
DeepSeek V4terminus-2	terminus-2	TN	view →view trajectory →
Gemini 3.1gemini-cli	gemini-cli	TN	view →view trajectory →
Gemini 3.1terminus-2	terminus-2	TN	view →view trajectory →
GLM 5.2claude-code	claude-code	TN	view →view trajectory →
GLM 5.2terminus-2	terminus-2	TN	view →view trajectory →
GPT-5.5codex	codex	TN	view →view trajectory →
GPT-5.5terminus-2	terminus-2	TN	view →view trajectory →
Kimi K2.6claude-code	claude-code	TN	view →view trajectory →
Kimi K2.6terminus-2	terminus-2	TN	view →view trajectory →
MiMo V2.5claude-code	claude-code	TN	view →view trajectory →
MiMo V2.5terminus-2	terminus-2	TN	view →view trajectory →
MiniMax M3claude-code	claude-code	TN	view →view trajectory →
MiniMax M3terminus-2	terminus-2	TN	view →view trajectory →
Opus 4.8claude-code	claude-code	TN	view →view trajectory →
Opus 4.8terminus-2	terminus-2	TN	view →view trajectory →
Qwen3.7claude-code	claude-code	TN	view →view trajectory →
Qwen3.7terminus-2	terminus-2	TN	view →view trajectory →