Jianan (Oscar) Ji

"...and now nothing will be withheld from them which they have imagined to do."

prof_pic.jpg

I’m currently a second-year master student at Carnegie Mellon University. I’m a member of the CMU Catalyst research group, and am fortunate to work under the esteemed guidance of Prof. Zhihao Jia.

My research interests lie at the intersection of machine learning systems and large language models. I believe that research and engineering, systems and algorithms are equally indispensable in this exciting era of LLM. Currently, my primary work involves breaking the boundaries of traditional kernels by fusing them into a “megakernel” to push hardware utilization to the limit.

Prior to CMU, I graduated with a Bachelor’s degree in Computer Science from Peking University, where I worked with Prof. Tong Yang on network system and advanced algorithms for data stream.

news

Jun 18, 2025 Our first version of Mirage Persistent Kernel is released:sparkles:! We developed a compiler that automatically transforms LLM inference into a single megakernel — a fused GPU kernel that performs all necessary computation and communication in one launch. This end-to-end GPU fusion approach reduces LLM inference latency by 1.2-6.7x. Have a look at the blog and the codebase.
May 31, 2025 Excited to share that our paper Mirage: A Multi-Level Superoptimizer for Tensor Programs is accepted by OSDI ‘25 :confetti_ball:!

latest posts

selected publications

  1. OSDI 25
    Mirage: A Multi-Level Superoptimizer for Tensor Programs
    Mengdi Wu, Xinhao Cheng, Shengyu Liu, Chunan Shi, Jianan Ji, Kit Ao, Praveen Velliengiri, Xupeng Miao, Oded Padon, and Zhihao Jia
    2025
  2. ICDE 25
    DaVinci Sketch: A Versatile Sketch for Efficient and Comprehensive Set Measurements
    Yanshu Wang*, Jianan Ji*, Chao-Hsuan Liu, Hengyang Zhou, and Tong Yang
    In 2025 IEEE 41st International Conference on Data Engineering (ICDE), 2025
  3. SIGMOD 24
    Chainedfilter: Combining membership filters by chain rule
    Haoyu Li, Liuhui Wang, Qizhi Chen, Jianan Ji, Yuhan Wu, Yikai Zhao, Tong Yang, and Aditya Akella
    Proceedings of the ACM on Management of Data, 2023
  4. ICDE 24
    Bitmatcher: Bit-level counter adjustment for sketches
    Qilong Shi, Chengjun Jia, Wenjun Li, Zaoxing Liu, Tong Yang, Jianan Ji, Gaogang Xie, Weizhe Zhang, and Minlan Yu
    In 2024 IEEE 40th International Conference on Data Engineering (ICDE), 2024