simPCL: An Open-Framework Simulator and Benchmark Generator for Programmable Cloud Laboratories

simulation
agents
benchmarking
ml-systems
Published

June 1, 2026

Problem

Evaluating autonomous agents for experimental orchestration on real laboratory hardware is slow and expensive. Progress on planning, fault recovery, closed-loop scientific discovery, and decision-making needs simulation environments and benchmarks that support controlled offline study.

Approach

I am building simPCL, an open-framework simulator and benchmark generator for programmable cloud laboratories. It supports controlled study of:

  • long-horizon experimental planning;
  • recovery from instrument and workflow failures;
  • reliable execution across multi-step protocols; and
  • closed-loop decisions in which measurements determine the next experiment.

simPCL complements our work on physical laboratory automation using MHS: real equipment demonstrates what an agent can accomplish, while simulation makes it possible to evaluate many scenarios reproducibly before using scarce laboratory time.

I am interested in taking this further into 3D laboratory simulation: sim-to-real transfer, reinforcement learning in MuJoCo, and world models for those environments.

Status

Manuscript in preparation. Related work was presented at the AI Scientist Summer Workshop (Microsoft Research, 2026) in a contributed talk on agentic fault recovery. Code and benchmarks will be released with the paper.