Making a ternary reasoning model fast in vLLM
Technical series · AI systems · GPU optimisation · Quantisation
A technical series on serving a compressed reasoning model in vLLM: kernel optimisation, careful measurement, speculative decoding and the final move from CUDA to Triton and Gluon.
10 chapters · 3 companion guides
Read the series



