Abstract:The Count-Min Sketch is a widely adopted structure for approximate event counting in large scale processing. In a previous work we improved the original version of the Count-Min-Sketch (CMS) with conservative update using approximate counters instead of linear counters. These structures are computationaly efficient and improve the average relative error (ARE) of a CMS at constant memory footprint. These improvements are well suited for NLP tasks, in which one is interested by the low-frequency items. However, if Log counters allow to improve ARE, they produce a residual error due to the approximation. In this paper, we propose the Count-Min Tree Sketch (Copyright 2016 eXenSa. All rights reserved) variant with pyramidal counters, which are focused toward taking advantage of the Zipfian distribution of text data.
Submission history
From: Geoffroy Fouquier [view email]
[v1]
Tue, 19 Apr 2016 09:51:34 UTC (64 KB)
[v2]
Thu, 21 Apr 2016 09:44:51 UTC (64 KB)
[v3]
Wed, 15 Jun 2016 06:15:34 UTC (64 KB)