Fixed next-token distribution

The logits are fixed. Temperature rescales them; top-p includes tokens by cumulative probability. No random token is sampled.
evidence
45.2%
context
27.4%
answer
16.6%
guess
6.8%
maybe
4.1%

Expected outcomes

  • Compare deterministic and stochastic decoding
  • Explain probability truncation

Connected concepts