All issues

Search results

Reference oracle and required build output share ./executable, causing agents to overwrite the oracle

Status: Open.

#60In facebookresearch/ProgramBench;

· Kibrahacha opened on Aug 15, 2026

csview: evaluator compatibility issues resolved — unchanged submission reaches official SOLVED (✅ 335 tests)

Status: Open.

#59In facebookresearch/ProgramBench;

· andy6011960 opened on Aug 8, 2026

ProgramBench csview: false not_run records and missing results.xml

Status: Open.

#56In facebookresearch/ProgramBench;

· andy6011960 opened on Jul 31, 2026

eval_clean_hashes is missing or stale for some task_cleanroom_v6 images

Status: Open.

#54In facebookresearch/ProgramBench;

· Marquis03 opened on Jul 17, 2026

Right of Reply: Construct-validity Audit

Status: Open.

#50In facebookresearch/ProgramBench;

· kimjune01 opened on Jun 30, 2026

Clarify and harden cleanroom rules around reference executable instrumentation

Status: Open.

#44In facebookresearch/ProgramBench;

· BearCleverProud opened on Jun 18, 2026

Request for model trajectories

Status: Open.

#38In facebookresearch/ProgramBench;

· clumsycapy opened on Jun 12, 2026

Can the agent distinguish stdout and stderr?

bugSomething isn't workingSomething isn't working

Status: Open.

#37In facebookresearch/ProgramBench;

· Kazuki1450 opened on Jun 10, 2026

Request gold compile.sh scripts

questionFurther information is requestedFurther information is requested

Status: Open.

#23In facebookresearch/ProgramBench;

· LC-John opened on May 14, 2026

Some task_cleanroom Docker images do not contain all documentation

bugSomething isn't workingSomething isn't working

Status: Open.

#7In facebookresearch/ProgramBench;

· kolasleep opened on May 6, 2026