DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understanding

DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model

System Level Intelligent Router for Mixture-of-Models at Cloud, Data Center and Edge

Together Mixture-Of-Agents (MoA) – 65.1% on AlpacaEval with OSS models

【TMM 2025🔥】 Mixture-of-Experts for Large Vision-Language Models

MoBA: Mixture of Block Attention for Long-Context LLMs

Code for the paper "PixelCNN++: A PixelCNN Implementation with Discretized Logistic Mixture Likelihood and Other Modifications"

DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models

A family of open-sourced Mixture-of-Experts (MoE) Large Language Models

Mixture is a powerful node-based tool crafted in unity to generate all kinds of textures in realtime

A collection of AWESOME things about mixture-of-experts

PyTorch Re-Implementation of "The Sparsely-Gated Mixture-of-Experts Layer" by Noam Shazeer et al. https://arxiv.org/abs/1701.06538

Kimi-VL: Mixture-of-Experts Vision-Language Model for Multimodal Reasoning, Long-Context Understanding, and Strong Agent Capabilities

OLMoE: Open Mixture-of-Experts Language Models

⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training (EMNLP 2024)

Tutel MoE: Optimized Mixture-of-Experts Library, Support GptOss/DeepSeek/Kimi-K2/Qwen3 using FP8/NVFP4/MXFP4

A mixture of tooling combined to produce JavaScript from OCaml & Reason

[ICLR 2025 Spotlight] Official implementation of "Time-MoE: Billion-Scale Time Series Foundation Models with Mixture of Experts"

Mixture of Agents using Groq

A Pytorch implementation of Sparsely-Gated Mixture of Experts, for massively increasing the parameter count of language models

支持Android图文混排、文字环绕图片等效果

Multilayer LSTM and Mixture Density Network for modelling path-level SVG Vector Graphics data in TensorFlow

From scratch implementation of a sparse mixture of experts language model inspired by Andrej Karpathy's makemore :)

A TensorFlow Keras implementation of "Modeling Task Relationships in Multi-task Learning with Multi-gate Mixture-of-Experts" (KDD 2018)

Generative Handwriting using LSTM Mixture Density Network with TensorFlow

A curated reading list of research in Mixture-of-Experts(MoE).

Gaussian mixture models in PyTorch.

Mixture-of-Recursions: Learning Dynamic Recursive Depths for Adaptive Token-Level Computation (NeurIPS 2025)

DanceNet -💃💃Dance generator using Autoencoder, LSTM and Mixture Density Network. (Keras)

Tiled Diffusion, MultiDiffusion, Mixture of Diffusers, and optimized VAE