REPOSITORY ANALYSIS

agent-desktop

A desktop-agent framework with an optional Jev skill that selects controls and actions from native accessibility data.

E2 · source reviewedPublic material or source evidence was reviewed. A fixed-version source review requires checking a pinned revision; this is not a reproduction, performance endorsement, or safety guarantee.
Stars
1,604
Forks
86
License
Apache-2.0
Last commit
2026-09-23

What Jev does here

Jev selects a target and action and estimates presence and risk; local policy decides whether to execute.

Keeps the full UI tree out of the main Agent context while exposing the selected action.

The separate Jev scripts were inspected; desktop behavior and end-to-end latency were not tested here.

What task does this project fit?

Inspect the optional single-step act.mjs path for selecting a native application control.

Material analysed:

From input to action

  1. A local snapshot is reduced to eligible controls and snapshot-qualified references.
  2. The optional Jev script asks about target, command, presence and risk.
  3. Local reconciliation matches the verb to the target’s capabilities; execution requires --execute and an act decision.

Implementation details that matter

Candidate truncation changes what can be found

act.mjs reserves a no-match outcome and caps ordinary targets at 254 in this revision. The script reports truncation and points readers toward --root for focused observation.

Inspect the supporting source ↗

The model’s verb is checked against native capabilities

act.mjs can replace an unsupported verb with the first supported fallback, beyond type/set-value equivalence. Capability compatibility is not proof of preserved intent: review the corrected command before --execute; the existing risk answers are not a fresh assessment of that replacement.

Inspect the supporting source ↗

The separate policy path has a different action space

policy.mjs builds one target table per advertised operation and consumes the chosen operation’s target. The single-step act.mjs truncation and reconciliation findings must not be generalized to every agent-desktop path.

Inspect the supporting source ↗

When to choose it

Choose it for accessibility-backed native controls. Before broad automation, inspect the smaller subtree containing the intended control and keep execution disabled while checking the proposed command.

How to inspect it yourself

Read MAX_OPTIONS, reconcile and the execute branch in scripts/jev/act.mjs. Follow a target without the requested action capability and confirm the emitted correction; distinguish the proposal output from the --execute branch.

Limits of this review

  • No desktop actions or OS permission changes were made.
  • The framework contains many non-Jev commands; this review covers the optional script.
Primary material used in this analysis