Experience

Senior Staff-level Research Scientist and Engineering Manager
Worked at GenAI, distributed training, AI compiler, AI intrastructure, PyTorch, OpenAI Triton, Tensorflow, ONNX, MLIR, OpenXLA, NPU ASICs
Delivered 1,000s models for in-house ASICs.
Managed a team and built veScale, a PyTorch native LLM training framework.
Mentored an intern and built ShadowKV, high-throughput long-context LLM inference.
Led a team and built Flux, a fast communication-overlapping library for tensor parallelism on GPUs.
Managed and led ByteIR team.
Managed ByteMLPerf team.
Bootstrapped some forward-looking projects, across LLM and vision, including many aspects of MLSys, compiler, automation, and acceleration.

ByteDance Seed/AML

Staff-level Research Scientist
Worked at AI compiler, AI intrastructure, libraries, PyTorch, MLIR, XLA, NPU ASICs Built a compiler for in-house ASICs.
Led a team and built ByteIR, a model compilation solution for various hardware.
Led a team and built ByteMLPerf, an AI accelerator benchmarking tool.

ByteDance AML

Senior Software Engineer
Worked at AI intrastructure, libraries, PyTorch, ONNX, NPUs

Microsoft Cloud & AI

Software Engineer
Worked at AI intrastructure, libraries and ONNX

Microsoft AI & Research

Research Assistant
Researched in high-performance computing and compiler optimizations

IMPACT Lab., UIUC

Intern
Developed real-time image inpainting for Tegra 3

NVIDIA

Research Assistant and Engineer
Developed a novel high-frequency (50MHz) real-time ultrasonic imaging system, using FPGAs and GPGPU. The system became a commercial product of a startup.

Ultrasonic Imaging Lab., NTU

Dan Vivoli Endowed Fellowship

ECE, UIUC

Integrative Graduate Education and Research Traineeship (IGERT): Neuroengineering

NSF, USA

Taiwan Merit Scholarship

Taiwan

Undergraduate Student Research Fellowship

National Science Council, Taiwan

Pan Wen-Yuan Scholarship

Pan Wen-Yuan Foundation, Taiwan

Presidential Awards

NTU, Taiwan

Gold medal in Asian Pacific Mathematics Olympiad (APMO)