The Hidden Bloat in Machine Learning Systems

The tool claims to reduce the GPU code size by up to 75% and the CPU code by up to 72% for ML workloads, resulting in total file size reductions of up to 55%.They also claim to achieve reductions in peak CPU memory usage, peak GPU memory usage, and execution time by up to 74.6%, 69.6%, and 44.6%. Authors claim they will opensource the tools here: https://github.com/negativa-ai