Skip to content

fix(computer): a field that holds text is never described by that text - #851

Open
OAraLabs wants to merge 1 commit into
mainfrom
fix/computer-field-content-not-logged
Open

OAraLabs wants to merge 1 commit into
mainfrom
fix/computer-field-content-not-logged

Conversation

@OAraLabs

Copy link
Copy Markdown
Owner

Why

GTK4 names a text view by its contents: GNOME Text Editor's document reached the candidate table as text box 'Rig note: …'. Element.describe() put that label into the chooser's view, the approval prompt, the persisted action log (computer_step.action.description) and every Beacon. After one task set the document, the next task's log carried the text the person typed, which the cockpit promises to keep as a character count. Found on an isolated computer-use test rig.

What

Roles whose name can be their content (text box, document text, paragraph) are described by role alone. Named entries and buttons are unchanged.

Verification

New tests/test_computer_field_content_not_described.py (2 of 3 red before). Computer-use suites 634 passed; ruff clean. On the rig the prompt and log then read "Set the text box to the text below".

🤖 Generated with Claude Code

GTK4 names a text view by its contents: GNOME Text Editor's document reached
the candidate table as "text box 'Rig note: water the plants on Friday.'".
Element.describe() put that label into the chooser's view, the approval
prompt, the persisted action log (computer_step.action.description) and
every Beacon. After one task set the document, the next task's log carried
the text the person typed, which the cockpit promises to keep as a count.

Roles whose name can be their content (text box, document text, paragraph)
are now described by role alone. Named entries and buttons are unchanged.

Found on the isolated computer-use rig.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant