Awesome Web Agents
A curated list of tools, frameworks, and resources for building AI agents that can browse and interact with the web.
About Steel
Steel is an open-source browser API built specifically for AI agents. We make it easy to build AI applications that can effectively interact with the web.
✨ Get started for free here.
Contents
Autonomous Web Agents
AI agents that autonomously navigate and interact with the web through a user-friendly interface. (a.k.a Browser Agents)
Computer-use Agents
AI Web Automation Tools
Tools, frameworks and libraries that translate natural language instructions into web interactions.
Dev Tools
AI Web Scrapers/Crawlers
Web crawlers & scrapers that leverage AI to navigate websites and extract content.
Web Search & Query Tools
Utilities that help agents search the web or query web data via natural language.
- AgentQL - A query language and toolkit that makes the web AI-ready.
- SerpAPI - Search API that provides Google Search results for your agents.
- Serper.dev - Performant and cost effective search API that provides Google Search results for your agents.
- Jina.ai - Neural search platform for web data.
- Exa.ai - Semantic Search Engine for AI.
Benchmarks & Research
Datasets, benchmarks, and notable research efforts for evaluating and advancing web-capable AI agents.
Tutorials & Guides
Resources for learning how to build, deploy, or utilize AI web agents.
- LangGraph WebVoyager Tutorial - Tutorial demonstrating how to build a web navigation agent using LangGraph Agents, Vision Models, and Web Voyager.
- Build an AI Browser Agent - Step-by-step guide to create an AI that browses the web using Playwright and the Browser-Use library.
- Install & Run Browser-Use Locally - Instructions on installing the open-source Browser-Use agent with a local LLM.
- Build a Browser Agent with DeepSeek - Walks through deploying a Browser-Use web UI agent powered by the DeepSeek model on a cloud VM.
Interested in implementing Steel?
Feel free to reach out at team@steel.dev or on Discord.
Steel is an open-source browser API built specifically for AI agents. Get started for free here.
Join the Community
- Follow @steeldotdev on X.
- Join the Discord community.
- Feel free to reach out to us at team@steel.dev
Contributing
Contributions of any kind welcome, just follow the guidelines!