Hybrid search vs. Token pooling benchmarking
blog.colivara.com
1 thread
Hi HN!
We benchmarked two ways to improve the latency in RAG workflows with a multi-vector setup. Hybrid search using Postgres native capabilities and a relatively new method of token pooling. Token pooling unlocked up to 70% faster latency with <1% performance cost.