Agent S

Agent S uses multimodal large language models MLLMs to autonomously control computers through graphical user interfaces. The framework employs an Agent-Computer Interface ACI to enhance reasoning and control capabilities, allowing agents to accomplish complex, multi-step tasks by interpreting visual interfaces and executing actions. It also supports code execution through the call code agent action for programming-based tasks, making it versatile for both GUI and programmatic automation. Agents can operate across macOS, Linux, and Windows platforms.

Open FounderOS desktop