We are happy to release MMBench-GUI, a hierarchical, multi-platform benchmark framework and toolbox, to evaluate GUI agents. MMBench-GUI is comprising four evaluation levels: GUI Content Understanding ...

Abstract: GUI testing automatically using the capture-replay technique is beneficial in shortening testing time. Some of the automated testing tools that implement this technique are Selenium Ide, ...

A fully-featured, GUI-powered local LLM Agent sandbox with complete support for the MCP protocol. Empower your Large Language Models (LLMs) with true "Computer Use" capabilities. EdgeBox is a powerful ...

One of the principal challenges in building VLM-powered GUI agents is visual grounding, i.e., localizing the appropriate screen region for action execution based on both the visual content and the ...

Should you have feedback on this article, please complete the fields below. Please indicate if your feedback is in the form of a letter to the editor that you wish to have published. If so, please be ...