Mingheng Wu

Mingheng Wu 吴明恒

I am a Research Scientist at ByteDance Seed, working on systems for large-scale language models. I build and optimize systems across the LLM stack: pretraining (PyTorch-native graph compilation, ND parallelism), inference (heterogeneous serving), and system performance modeling. I am a contributor to PyTorch and torchtitan.

I received my dual M.S. from the University of Washington and Tsinghua University, where I was advised by Yunhao Liu. Previously, I received my B.Eng. in Computer Science from Tsinghua University.

Publications

Charon simulator overview
Mengtian Yang · Zhekun Zhang · Mingheng Wu · Jianwen Yan · Hanshi Sun · Li-Wen Chang
MLSys 2026 May 2026  ·  arXiv
Fine-grained LLM training/inference simulation with 5.35% overall prediction error and over 30,000x lower evaluation cost.

Experience

Research Scientist
ByteDance Seed · Bellevue, WA · 2025 — Now
Research Engineer Intern
ByteDance Seed · Bellevue, WA · 2024
Quantitative Developer Intern
Metabit Trading · Shanghai, China · 2023
Machine Learning Engineer Intern
Microsoft · Beijing, China · 2023
Research Intern
Microsoft Research · Beijing, China · 2021 — 2022

Education

M.S. in Computer Science
University of Washington & Tsinghua University · Dual Degree · 2022 — 2025
B.Eng. in Computer Science
Tsinghua University · 2018 — 2022

Misc

I have a cute dog named Ollie 🌭🐶 — a long-haired Kaninchen dachshund. His birthday is October 3, 2024. A few pictures: