About
I am a 4th year Ph.D. student in the Computer Science Department at Carnegie Mellon University, where I am fortunate to work with Zhihao Jia as part of the Catalyst Lab and Parallel Data Lab.
I’m also a Research Scientist Intern at Snowflake AI Research, where I’m fortunate to work with Aurick Qiao.
I am interested in machine learning systems, parallel computing and distributed systems, with a particular focus on large language models (LLMs).
Interests
- Machine Learning
- Distributed Systems
- Parallel Computing
- Networking
Education
-
PhD in Computer Science, 2028
Carnegie Mellon University
-
MS in Advanced Computing, 2023
Tsinghua University
-
BS in Electrical Engineering, 2021
Harvard University
Recent Publications
Quickly discover relevant content by filtering publications.
First Author Publications
SuffixDecoding: A Model-Free Approach to Speeding Up Large Language Model Inference
NeurIPS 2025 (Spotlight 🏆)
SpecInfer: Accelerating Generative Large Language Model Serving with Tree-based Speculative Inference and Verification
ASPLOS 2024 (Cited 350+ times 🏆)
Collaborations
Quantized Side Tuning: Fast and Memory-Efficient Tuning of Quantized Large Language Models
ACL 2024 Oral (Outstanding paper award 🏆)
Work Experience
Research Intern
Work on Cortex Analyst and built SuffixDecoding
Software Engineer
Worked in the Systems Engineering Team
Contact
- goliaro@cs.cmu.edu
- Computer Science Department, Carnegie Mellon University, Pittsburgh, PA 15213