Show HN: Open-source version of OpenAI's Deep Research
github.comLast night, OpenAI launched Deep Research, a tool for AI-powered deep web searches. In a few hours, I built an open-source alternative using Next.js, Firecrawl, and Vercel's AI SDK. Instead of using a fine-tuned version of o3, this method uses Firecrawl's extract + search with a reasoning model to deep research the web.
The system is built using Vercel’s AI SDK for handling requests and streaming data, with an agent-based approach that manages search, extraction, and analysis. It uses Firecrawl to find and extract structured data, which is then processed through a progressive analysis system to refine and summarize results. The process follows an iterative cycle: Firecrawl’s /search API finds relevant URLs, /extract pulls structured data, and a planning function determines what to look for next. A research state tracker keeps track of findings, summaries, and progress while enforcing depth (maxDepth) and time limits to stay within Vercel’s function execution time constraint. The results stream into a live UI, showing search progress, sources, and key insights. The cycle continues until enough information is collected or limits are reached, producing a final structured summary.
This was a pretty fast built and I wanna keep iterating on it. Would love to hear your thoughts. It's great that it's "open" and a public repository!
Could you share any advantages your approach has over OpenAI's "Deep Research"? Also, if possible, I'd love to hear about the future prospects of Firecrawl.