Ask HN: Crawl HN Linked Articles
How much does it cost to crawl all urls that are linked from hackernews submissions and comments? Ballpark at least 3.5 million story urls.
Several services would likely do this for several thousand dollars but I'm hoping for something cheaper. Try freelancing website you can get it done for far less.