Article Details
Retrieved on: 2024-02-06 16:53:42
Tags for this article:
Click the tags to see associated articles and topics
Excerpt
We present a novel inference scheme, self-speculative decoding, for accelerating Large Language Models (LLMs) without the need for an auxiliary ...
Article found on: ui.adsabs.harvard.edu
This article is found inside other hiswai user's workspaces. To start your own collection, sign up for free.
Sign UpAlready have an account? Log in here