Keep useful work.
Represent grounded targets and bounded steps as reusable skills, rather than starting over.
A local execution layer between the model and the computer.
Designed to turn model guidance into reusable GUI skills and guarded local feedback loops. Bring the model back when the next step needs judgment.
View sourceOpen research · Linux/X11 evidence
Experimental. Not production-stable.
One fresh persistent-only run, shown at labelled 2× playback from 137 exact retained observations over 47.472 seconds. Unchanged intervals hold the latest observation. The run used 26,531 input tokens, made three model generations, admitted zero stale pointers, and verified 57/57 terminal input releases. This is one successful run, not a baseline comparison.
01 The execution layer
Let the model handle intent and uncertainty. Let the runtime handle bounded execution, fresh observations, and checks before the next action.
Return to the model for each next step.
Continue locally within guards. Escalate when needed.
Simplified architecture, not a live trace or a performance comparison.
Represent grounded targets and bounded steps as reusable skills, rather than starting over.
Observe, act, and check the result locally within an admitted program.
Recheck bindings and guards. Refuse a stale route rather than blindly replaying it.
Return evidence to the model when the local path is uncertain or no longer valid.
02 The real-time frontier
Freedoom is the stress test for the part that remains unresolved: bounded local control while slower model decisions are still pending.
The retained Astra-low attempt below ended in death without a MAP01 exit. It stays visible as failure evidence; later renewal and guard experiments are measured separately.
Inspect the failed run & limitationsOne frozen Astra-low attempt, shown in full at labelled 2× playback: 149.911 seconds, 13 decisions, one kill, then death without a MAP01 exit. The clock advanced at 35.016 tics/s. Fixed cover expired before seven model returns; later renewal work is measured separately.
03 Open by design
The code, experiments, and limitations belong together. Explore the work as it stands, including the attempts that did not work.
Source, a pinned setup path, retained desktop evidence, and a labelled failed real-time recording. Current real-app evidence is Linux/X11.
Bounded live threat exposure, fresh local policy guards, and a continuously advancing Freedoom MAP01 clear.
Production reliability, universal GUI support, and general speed or cost savings. APIs and behavior may change.
Building agents that use computers? Bring a workflow. Challenge an assumption.