Finding Similar Items
This post describes an approach to the problem of finding similar items among crawled items and how this was implemented at Zyte.
Shane Evans · Founder, CEO at Zyte
6 min read ·
Try Zyte API
Build your first scraper in minutes
Free trial, no credit card. From a single request to production in an afternoon.
Get startedFounder, CEO at Zyte
Shane's articles trace Zyte's history and open-source projects, including the Scrapinghub-to-Zyte rebrand, Portia's visual scraping tool, and Dash. He also wrote on data-storage architecture decisions (why MongoDB was a poor fit for scraped data), remote-work transition lessons f…
More from this authorContinue reading
Teaching AI to scrape like a pro: how we measure LLMs’ data quality
AI-enabled code editors can now conjure scraping code on command. But is it any good? Here’s how Zyte re-engineered LLMs with Web Scraping Copilot to drive best-in-class output.
Analyze web data quickly with Jupyter Notebooks and Zyte API
With AI Scraping in Zyte API, you can pull data from any e-commerce website straight into your Jupyter notebooks.
Overcoming web scraping challenges of Puppeteer and Playwright
Discover the challenges of scaling web scraping with Playwright & Puppeteer, from browser farm management to IP rotation and anti-scraping tactics.
Inside Zyte's System Design Process: How We Build Scalable, Reliable Solutions
Explore Zyte’s approach to building scalable and reliable systems through PRDs, technical requirements, solution evaluation, and real-world design insights.
Leveraging Web Scraping and Big Data: The New Frontier in Optimized Delivery Solutions
Big Data Delivery isn’t just about moving information around—it’s about making it work for you, helping businesses spot trends, predict what’s next, and stay ahead in a cutthroat market.
AI Web Scraping as the Future of Scalable Data Collection
AI-powered web scraping is transforming data collection by making it faster, smarter, and highly scalable. Learn how it overcomes traditional scraping challenges and unlocks new opportunities for businesses across industries.
The Community · Newsletter
The best of Zyte and the data web, in your inbox.
One curated edition — new articles, product updates, and the stories shaping the data web. No noise.