Refrag: Rethinking RAG Based Decoding

This LLM-generated abstract contains instances of pleonasm. While I am unsure if there is a required minimum word count for abstracts, the current version could be improved. Specifically, the abstract could more clearly described that it is an "efficient decoding framework that compresses, senses, and expands to improve latency in RAG applications."