Zedong Liu

Machine Learning Systems & Data Compression

Zedong Liu

Zedong Liu

First-Year Ph.D. Student
Institute of Computing Technology (ICT),
Chinese Academy of Sciences (CAS)

About

I am a first-year Ph.D. student at the Institute of Computing Technology, Chinese Academy of Sciences (ICT, CAS), advised by Prof. Dingwen Tao and Prof. Guangming Tan. Previously, I completed my undergraduate studies at the University of Electronic Science and Technology of China (UESTC).

My research interests primarily lie in Machine Learning Systems and Data Compression, with a particular focus on efficient large-scale distributed inference and compression for massive scientific data. Recently, I have also become interested in the co-optimization of data compression techniques and large model inference systems.

Please feel free to contact me if you’re interested in relevant research topics or would like to discuss potential collaborations!

News

  • 2026 🎉 Our paper Falcons: Pushing the Speed-Ratio Limits of Lossy Compression for Parallel Scientific Applications has been accepted to PPoPP 2027!
  • 2026 🎉 Excited to share that Evaluation and Optimization of Communication Compression for 10K-GPU LLM Training has been accepted to SC 2026!
  • 2026 🎉 KVServe has been accepted to SIGCOMM 2026—congratulations to all co-authors!
  • 2026 👏 PRISM and CCL-D have both been nominated for Best Paper at PPoPP 2026. What a great result!
  • 2025 🎉 ElasticMM was selected for an Oral presentation at NeurIPS 2025!

Publications

ElasticMM: Efficient Multimodal LLMs Serving with Elastic Multimodal Parallelism
Zedong Liu, Shenggan Cheng, Guangming Tan, Yang You, Dingwen Tao
NeurIPS 2025 (Oral, 0.3%)
KVServe: Service-Aware KV Cache Compression for Communication-Efficient Disaggregated LLM Serving
Zedong Liu, Xinyang Ma, Dejun Luo, Hairui Zhao, Bing Lu, Wenjing Huang, Yida Gu, Xingchen Liu, Zheng Wei, Jinyang Liu, Dingwen Tao, Guangming Tan
SIGCOMM 2026
SolarZip: An Efficient and Adaptive Compression Framework for Solar EUV Imaging Data
Zedong Liu*, Song Tan*, Alexander Warmuth, Frédéric Schuller, Yun Hong, Wenjing Huang, Yida Gu, Bojing Zhu, Guangming Tan, Dingwen Tao
Astronomy & Astrophysics (A&A)
PRISM: An Efficient GPU-Based Lossy Compression Framework for Progressive Data Retrieval with Multi-Level Interpolation
Bing Lu*, Zedong Liu*, Hairui Zhao, Dejun Luo, Wenjing Huang, Yida Gu, Jinyang Liu, Guangming Tan, Dingwen Tao
PPoPP 2026 Best Paper Nominee
ENEC: A Lossless AI Model Compression Method Enabling Fast Inference on Ascend NPUs
Jinwu Yang, Jiaan Wu, Zedong Liu, Xinyang Ma, Hairui Zhao, Yida Gu, Yuanhong Huang, Xingchen Liu, Wenjing Huang, Zheng Wei, ... , Guangming Tan, and Dingwen Tao
ISCA 2026
Falcons: Pushing the Speed-Ratio Limits of Lossy Compression for Parallel Scientific Applications
Bing Lu, Jinyang Liu, Xinyang Ma, Quantong Fu, Chenwei Hou, Zedong Liu, Wenjing Huang, Yida Gu, Xingchen Liu, Zheng Wei, Anbang Wu, Xiaofeng Hou, Chao Li, Guangming Tan, Minyi Guo, Dingwen Tao
PPoPP 2027
Evaluation and Optimization of Communication Compression for 10K-GPU LLM Training
Xingchen Liu, Daran Sun, Xingjian Tian, Man Liu, ..., Zedong Liu, ..., Zizhong Chen, Dingwen Tao, Guangming Tan
SC 2026
MANS: Efficient and Portable ANS Encoding for Multi-Byte Integer Data on CPUs and GPUs
Wenjing Huang, Jinwu Yang, Shengquan Yin, Haoxu Li, Yida Gu, Zedong Liu, Xing Jing, Zheng Wei, Shiyuan Fu, Hao Hu, Guangming Tan, Dingwen Tao
SC 2025
CCL-D: A High-Precision Diagnostic System for Slow and Hang Anomalies in Large-Scale Model Training
Yida Gu, Fakang Wang, Jianhao Fu, Zhenhang Sun, Qianyu Zhang, Hairui Zhao, Xingchen Liu, Yang Tian, Wenjing Huang, Zedong Liu, Yifan Chen, ... , Guangming Tan, Dingwen Tao
PPoPP 2026 (Best Paper Nominee)

Open-Source Projects

I actively develop open-source tools for efficient AI systems. Contributions are welcome—whether through issues, feature proposals, benchmarks, documentation, or pull requests.

LLM Serving & Compression

KVServe

A service-aware KV-cache compression framework for communication-efficient disaggregated LLM serving, designed to reduce KV transfer overhead while offering flexible compression configurations.

AI Agents & Efficient Reading

SparseRead

A training-free, token-efficient reading layer for AI agents. It selectively retrieves source-grounded evidence from large documents and workspaces, with integrations across agent frameworks.

Honors & Awards

  • 2025 Outstanding Graduate, Sichuan Province (Top 3%)
  • 2025 Outstanding Graduate, UESTC (Top 7%)
  • 2025 UESTC-YanBao Scholarship (Top 3%)
  • 2024 National Endeavor Scholarship
  • 2024 UESTC First-class Scholarship in 2023,2024,2025
  • 2024 National Second Prize | 17th Chinese Collegiate Computing Competition (Top 2%)