Computer use

Computer use: An agent’s ability to operate graphical interfaces through observation and actions such as clicking and typing. It is useful when no API exists, but coordinates and visual state make execution more fragile. Isolated environments, confirmations and action limits reduce the impact of errors and malicious content.