Only Accepted Tokens Count: An Energy Accounting of Speculative Decoding Under Latency Targets
Measures speculative decoding energy by the tokens the target accepts.
Explainer · on the wire
The explainer for this story is still on the wire.
The claim, the mechanism, and the figures land here once generated.
Source · arXiv