Aaryam Sharma on X: "1/ When you run speculative decoding, when is a draft token actually accepted? For standard speculative sampling, the answer is elegant: with target distribution p and draft distribution q (assuming context is implicit), the acceptance probability is: 1 − TV(p, q) However, for https://t.co/gT9ZQWlAsl" / X
x.com · saved by 1 readers
1/ When you run speculative decoding, when is a draft token actually accepted? For standard speculative sampling, the answer is elegant: with target distribution p and draft distribution q (assuming context is implicit), the acceptance probability is: 1 − TV(p, q) However, for greedy decoding, th…