A complete, numpy-only implementation of the project task: a toy MoE (OLMoE-shaped), a GPU memory simulator, MoE token dispatch, block-wise quantization with a mixed-precision planner, an mmap weight ...
Some results have been hidden because they may be inaccessible to you
Show inaccessible results