Experience


A tiny Research Scientist and Engineering Manager
at ByteDance

Work Experience


May 2023-Present

Senior Staff-level Research Scientist and Engineering Manager
Worked at GenAI, distributed training, AI compiler, AI intrastructure, PyTorch, Tensorflow, ONNX, MLIR, OpenXLA, NPU ASICs
Delivered many models for in-house ASICs.
Managed a team and built veScale, a PyTorch native LLM training framework.
Led ByteIR team.
Co-managed ByteMLPerf team.
Bootstrapped some forward-looking projects.

ByteDance AML


Jun 2021-May 2023

Staff-level Research Scientist
Worked at AI compiler, AI intrastructure, libraries, PyTorch, MLIR, XLA, NPU ASICs Built a compiler for in-house ASICs.
Led a team and built ByteIR, a model compilation solution for various hardware.
Coled a team and built ByteMLPerf, an AI accelerator benchmarking tool.

ByteDance AML


Sept 2018-Jun 2021

Senior Software Engineer
Worked at AI intrastructure, libraries, PyTorch, ONNX, NPUs

Microsoft Cloud & AI


July 2017-Aug 2018

Software Engineer
Worked at AI intrastructure, libraries and ONNX

Microsoft AI & Research


Fall 2009-Summer 2017

Research Assistant
Researched in high-performance computing and compiler optimizations

IMPACT Lab., UIUC


Summer 2012

Intern
Developed real-time image inpainting for Tegra 3

NVIDIA


Feb. 2008-July 2009

Research Assistant and Engineer
Developed a novel high-frequency (50MHz) real-time ultrasonic imaging system, using FPGAs and GPGPU. The system became a commercial product of a startup.

Ultrasonic Imaging Lab., NTU


Education


Jul. 2017

Ph.D. in Electrical and Computer Engineering (ECE)
Under Dr. Wen-mei Hwu's supervision.

University of Illinois at Urbana-Champaign (UIUC), IL


Aug. 2014

Master in ECE
Under Dr. Wen-mei Hwu's supervision.

University of Illinois at Urbana-Champaign (UIUC), IL


Jun. 2007

BS in Electrical Engineering (EE), with a Minor degree in Mathematics

National Taiwan University (NTU), Taipei, Taiwan


Aug. 2006-May 2007

Visiting student in ECE

UIUC


Honors & Awards


2012-2013

Dan Vivoli Endowed Fellowship

ECE, UIUC


2009-2011

Integrative Graduate Education and Research Traineeship (IGERT): Neuroengineering

NSF, USA


2006-2007

Taiwan Merit Scholarship

Taiwan


2005

Undergraduate Student Research Fellowship

National Science Council, Taiwan


2005

Pan Wen-Yuan Scholarship

Pan Wen-Yuan Foundation, Taiwan


3 times

Presidential Awards

NTU, Taiwan


2001

Gold medal in Asian Pacific Mathematics Olympiad (APMO)


Let's Get In Touch!