Builds candidate actions from OCR and UI state for Jev to control macOS, calling a text model only when writing is needed.
E2 · source reviewedPublic material or source evidence was reviewed. A fixed-version source review requires checking a pinned revision; this is not a reproduction, performance endorsement, or safety guarantee.
Selects the next step from deterministically extracted controls and actions before desktop execution.
WHY IT HELPS
Separates screen reading, action selection, and text generation.
SOURCE NOTE
README cost and speed comparisons use the author’s limited screenshot and goal setup, with some reasoning supplied by deterministic code. They are not general savings multipliers and were not independently retested.
Explore macOS control through OCR and accessibility candidates with a separate text-writing helper.
Material analysed:
From input to action
Code captures the screen, combines OCR and accessibility items, and adds deterministic controls.
Jev chooses action kind, site and, where relevant, an on-screen or off-screen target.
Typing uses a writer; a further Noul check assesses the resulting field value.
Implementation details that matter
Confidence follows the action’s actual dependencies
Decision.confidence takes the minimum of kind and selected target confidence for target-bearing actions. An irrelevant head does not lower confidence for another action.
The README distinguishes a one-step proposal from --act, which drives the machine. Low confidence and repeated no-ops are stopping conditions, not evidence that all harmful actions are prevented.
Prefer this when a native screen needs both OCR and accessibility data. For a DOM-heavy web app, compare a browser-specific observer before accepting screen-capture and focus overhead.
How to inspect it yourself
Inspect Decision.confidence and verify_typed in decide.py. For an item click, compare the two confidences; for typing, trace the additional ok Noul. Check the README’s dry-run and --act distinction before trying any live run.
Limits of this review
The README’s cost multipliers were not reproduced here.
No clicks, typing or screen recording were performed.