Post by METR on X
METR@METR_Evals
XBased on reading the ExploitGym paper, agents were mistakenly concerned the automatic scorer would fail them if they clearly acquired the flag by cheating. Agents that had seen the reverse-engineered flag were considered “poisoned” because they thought it would disqualify them.

511 likes2 repliesPosted Aug 26, 2026