Virtual Width Networks (VWN)
arxiv.orgA framework that decouples representational width from backbone width, offering the benefits of wider LLMs without the quadratic computational costs.
A framework that decouples representational width from backbone width, offering the benefits of wider LLMs without the quadratic computational costs.