Show HN: Web Ingest – Convert websites to LLM-friendly text
webingest.comI really love Git Ingest, but I needed something more general. So I built this!
It crawls websites and converts each page to Markdown.
It’s great for developer documentation.
And it’s free. I built it over the excellent Jina Reader. I hope you get some use out of it! Is it open source? Thanks for trying it! It's not open source, but it is a single-page app. You could download the source and run it locally. The web app is calling Jina Reader under the hood. If you needed something a little different, it wouldn't be too hard to write a CLI tool to call Jina and achieve similar results. It's cheap to host, so I'll be leaving this up for the foreseeable future.