About Me
lead you to my latest work!Hello! I am Zhenglin Cheng, a Ph.D. student of 
LINs lab, Westlake University (through joint program with ZJU), advised by Prof. Tao LIN. Before that, I received my bachelor’s degree in Software Engineering from 
Zhejiang University (ZJU).
I love to write and post something (from technical notes to life stuff). I also practice Chinese traditional calligraphy to relax occasionally.
Research Interests
My research interests are generally within the scope of efficiency and effectiveness of AI systems (such as large language models, diffusion models), specifically in model architectural optimization, training accelerating techniques, and efficient inference paradigms. Actively exploring! 🙌
Publications/Manuscripts (* denotes equal contribution)
📖 Dynamic Mixture of Experts: An Auto-Tuning Approach for Efficient Transformer Models
Yongxin Guo*, Zhenglin Cheng*, Xiaoying Tang, Zhaopeng Tu, Tao Lin
👉 DynMoE frees the burden of pivotal hyper-parameter selection for MoE training by enabling each token to activate different number of experts, and adjusting the number of experts automatically, acheiving stronger sparsity well maintaining performance.
📖 GMem: A Modular Approach for Ultra-Efficient Generative Models
Yi Tang*, Peng Sun*, Zhenglin Cheng*, Tao Lin
👉 GMem decouples diffusion modeling by network for generalization and external memory bank for memorization, achieving 50× training speedup compared to SiT, 25× speed up to REPA.
📖 Multimodal Self-Instruct: Synthetic Abstract Image and Visual Reasoning Instruction Using Language Model (inherited from my undergrad thesis)
Wenqi Zhang*, Zhenglin Cheng*, Yuanyu He, Mengna Wang, … , Weiming Lu, Yueting Zhuang
👉 Multimodal self-instruct utilizes LLMs and their code capabilities to synthesize massive abstract images and visual reasoning instructions across daily scenarios such as charts, graphs, visual puzzles, etc.
News
- 2025/01: 🥳 Dynamic Mixture of Experts (DynMoE) is accepted to ICLR’25, See you in Singapore🇸🇬 !
Educations
- 2024/09 - 2029/06, Westlake University, College of Engineering.
- 2020/09 - 2024/06, Zhejiang University, College of Computer Science and Technology.