Ask HN: How to protect against scraping?
I own a website with lots of financial information in another country and from time to time I see a huge spike in traffic from certain IP addresses. I'm guessing they're trying to scrape the information I provide. I then go and block these IP addresses manually by updating my nginx config to deny requests from those addresses. This works fairly okay, but requires manual intervention.
The website runs on Node and nginx sits in front of the Express app. Are there good Node packages, nginx best practices that can protect against scraping automatically?
Thanks in advance!
No comments yet.