AgentSmith achieves 82.4% success rate on the Halluminate WebBench — the industry standard for evaluating browser agents across 5,000+ real-world tasks.
Results from the Halluminate WebBench — 5,294 tasks across 350+ live websites in five categories (READ, CREATE, UPDATE, DELETE, FILE_MANIPULATION). Each task is evaluated by an LLM judge. Competitor scores sourced from their published results. AgentSmith tested under the same conditions with no task-specific tuning.