GitHub - steel-dev/awesome-web-agents: 🔥 A list of tools, frameworks, and resources for building AI web agents

A curated list of tools, frameworks, and resources for building AI agents that can browse and interact with the web.

About Steel

Steel is an open-source browser API built specifically for AI agents. We make it easy to build AI applications that can effectively interact with the web.

✨ Get started for free here.

Awesome Web Agents

Autonomous Web Agents

AI agents that autonomously navigate and interact with the web through a user-friendly interface. (a.k.a Browser Agents)

Surf.new - An open-source playground for chatting with different web agents.
OpenAI Operator - OpenAI's AI agents that can browse the web for you.
Browser-Use - SOTA agent and framework that makes the web LLM-friendly.
Skyvern-AI - Framework to automate browser-based workflows.
Google Project Mariner - A research prototype exploring the future of human-agent interaction, starting with your browser.
Sentience API - A tool for building more deterministic and explainable web agents using semantic geometry on web content.
Runner H - State-of-the-art AI agent that helps automate complex, cumbersome, multi-step tasks without repetitive manual input.
WebVoyager (Agent) - Vision-enabled web agent.
AgentGPT - Deploy autonomous AI agents in your browser.
Agent-E - Agent & framework with HTML DOM distillation.
Manus - A general AI agent that can execute long running tasks across tools like browsers, terminals, and text editors.
doBrowser - An AI-powered Chrome extension that understands natural language and takes actions in your browser on your behalf.
WebSurfer (Autogen) - MultimodalWebSurfer is a multimodal agent that can search the web and visit web pages.
Magentic-One - A generalist multi-agent system for solving complex tasks including surfing the web via Autogen's MultimodalWebSurfer.
Harpa.ai - An AI-powered Chrome extension & browser agent that understands natural language and takes actions on your behalf.
Yutori - A multi-agent system that executes browser-based tasks in parallel given a natural language prompt.
rtrvr.ai - AI web agent Chrome extension that autonomously does tasks, scrapes to Sheets, and calls APIs with prompts in your own browser.
Nanobrowser - An open-source & local-first AI web agent Chrome extension with flexible LLM options and multi-agent system.
Browserable - An open-source & self-hostable browser automation library for AI agents.
Tongyi WebAgent - WebAgent for information seeking built by Tongyi Lab, Alibaba Group.
Openwork - An MIT-licensed, open alternative to Anthropic's Cowork built with Opencode and dev-browser. Supports multiple LLM providers for launching computer-use agents to automate browser workflows.
Dassi - An AI coworking agent in your browser that automates tasks, navigates pages, and works with files and 2000+ apps from a side panel.

Computer-use Agents

AI Web Automation Tools

Tools, frameworks and libraries that translate natural language instructions into web interactions.

Asteroid.ai - Hosted browser agents for SMEs to automate complex workflows.
PulsarRPA - AI-powered browser automation for data extraction.
VimGPT - Experimental project using GPT-4 Vision to browse the web via the Vimium extension.
Cekura.io - An AI browser agent that helps companies maintain up-to-date documentation.
Dex by Dexterity - An AI coworker embedding into and controlling your browser.
Autobrowser - A free, experimental Chrome extension that leverages Claude Computer Use to automate tasks in your browser.
Bytebot - AI-powered scraping automations that evolve with your target sites.
Runcopycat - A no-code browser automation platform that turns screen recordings into reusable automated workflows.
Bardeen.ai - A Chrome extension that enables AI-powered browser automations, allowing users to automate tasks and workflows directly within the browser.
Starizon.ai - Browser assistant for web task automation.
BrowserGPT - Browser extension for page summaries and Q&A.
Browse.ai - Chrome extension webscraping that can leverage AI for structured data extraction.
Strawberry Browser - A personal assistant that sits in your browser, automates repetitive web actions, learns your workflows.
Deta.surf - An integrated platform that combines a browser, file manager, and AI assistant with browser-level context.
Comet by Perplexity - An AI-powered browser by Perplexity. Not much more details out yet.
Dia Browser - AI-first web browser envisioned by The Browser Company (Arc).
Reworkd - No-code web data extraction solution using agentic AI.
Onpiste - Chrome extension that uses AI to control and read webpages, including auto summaries, web automation, scraping, and MCP support.
Komos - AI browser workflow automation platform that turns recorded web tasks into reusable runs with API triggers, schedules, credentials, logs, and human review.
agent-qa - Self-improving QA harness for natural-language web test runs with execution memory and self-healing actions.

Dev Tools

Steel.dev - Open-source headless browser API built specifically for AI agents and apps.
Atlas - Open-source deep research harness for building cited web research agents with ledger-based coverage audits, pluggable search providers, and Steel-backed browser fetches.
Omniparser - Tool for parsing GUIs for vision based agents.
LaVague - Framework for natural language web automation.
LangChain Playwright Toolkit - Toolkit integration with AI agents.
Browserbase - A headless browser API for AI workflows.
Stagehand - AI web browsing framework.
Tarsier - Vision utilities library for web interaction agents.
AutoGPT - Experimental agent for task completion and web browsing.
TinyFish - Remote web agents that execute tasks on any website and return structured JSON via a single API call.
Bytebot - Containerized computer use agent framework with a virtual desktop environment.
Lumen - Vision-first browser agent with self-healing deterministic replay. Screenshot → model → action loop over CDP, multi-provider (Anthropic, Google, OpenAI), action caching for zero-token reruns.
Webagent-cloud - Open-source API for browser agents to automate repetitive workflows. Works with multiple browsers/LLM providers, and minimizes costs with a self-healing action cache.
BrowserTrace - Local-first trace viewer for debugging Playwright, Browser Use, Stagehand, and other web-agent runs with redacted shareable exports.
Notte - Browser infrastructure for AI agents with managed sessions, an agent runtime, and credential vault and persona authentication primitives.
invisible-playwright - Playwright wrapper for a stealth-patched Firefox 150 build. Drop-in replacement returning native Playwright Browser objects; spoofing happens in C++ source with no JS-level overrides.
Webwright - Browser agent framework from Microsoft Research where the agent writes and runs Playwright scripts in a terminal workspace; supports OpenAI, Anthropic, and OpenRouter backends.
BrowserAct - Browser automation CLI and skills for AI agents to operate real browsers, manage sessions, support human handoff, and capture screenshots and evidence.
Agent Browser Shield - Browser extension that sits between an AI agent and the page, stripping prompt injection, masking PII/credentials, and removing dark patterns before content reaches the model.
HUD - Open-source SDK for building browser and computer-use RL environments to evaluate and train web agents, with task-based verifiable rewards runnable as evals or RL training across any model.
Webfuse - Configurable web proxy and browser-as-a-service for deploying and operating AI agents in a sandbox layer on top of any third-party website, using client-side extensions and without source-code access.

AI Web Scrapers/Crawlers

Web crawlers & scrapers that leverage AI to navigate websites and extract content.

Web Search & Query Tools

Utilities that help agents search the web or query web data via natural language.

AgentQL - A query language and toolkit that makes the web AI-ready.
SerpAPI - Search API that provides Google Search results for your agents.
Serper.dev - Performant and cost effective search API that provides Google Search results for your agents.
Jina.ai - Neural search platform for web data.
Exa.ai - The fastest and most accurate web search API for AI agents.
Not Human Search - Search engine that indexes 1,750+ agent-first tools ranked by agentic readiness. Available as an MCP server with tools for searching, scoring, and monitoring agent infrastructure.
Superhighway - Web search API for AI agents with five tools (search, news, images, scrape, research); agents pay per call in USDC via the x402 protocol, or use a free API key.

Benchmarks & Research

Datasets, benchmarks, and notable research efforts for evaluating and advancing web-capable AI agents.

Tutorials & Guides

Resources for learning how to build, deploy, or utilize AI web agents.

LangGraph WebVoyager Tutorial - Tutorial demonstrating how to build a web navigation agent using LangGraph Agents, Vision Models, and Web Voyager.
Build an AI Browser Agent - Step-by-step guide to create an AI that browses the web using Playwright and the Browser-Use library.
Install & Run Browser-Use Locally - Instructions on installing the open-source Browser-Use agent with a local LLM.
Build a Browser Agent with DeepSeek - Walks through deploying a Browser-Use web UI agent powered by the DeepSeek model on a cloud VM.

Interested in implementing Steel?

Feel free to reach out at team@steel.dev or on Discord.

Steel is an open-source browser API built specifically for AI agents. Get started for free here.

Join the Community

Follow @steeldotdev on X.
Join the Discord community.
Feel free to reach out to us at team@steel.dev

Contributing

Contributions of any kind welcome, just follow the guidelines!

Contributors

Thanks goes to these contributors!