Sohan Venkatesh
Toggle navigation
about
publications
blog
cv
bookshelf
ctrl k
nanoKimi
A custom implementation of the Kimi-K2 MoE architecture with a Muon optimizer and latent attention.