1

Quantized Side Tuning: Fast and Memory-Efficient Tuning of Quantized Large Language Models
Click the Cite button above to demo the feature to enable visitors to import publication metadata into their reference management software. Create your slides in Markdown - click the Slides button to check out the dta.
Zhengxin Zhang, Dan Zhao, Xupeng Miao, Gabriele Oliaro, Qing Li, Yong Jiang, Zhihao Jia
PDF Cite DOI
Quantized Side Tuning: Fast and Memory-Efficient Tuning of Quantized Large Language Models
SpecInfer: Accelerating Generative Large Language Model Serving with Tree-based Speculative Inference and Verification
Click the Cite button above to demo the feature to enable visitors to import publication metadata into their reference management software. Create your slides in Markdown - click the Slides button to check out the dta.
Xupeng Miao, Gabriele Oliaro, Zhihao Zhang, Xinhao Cheng, Zeyu Wang, Zhengxin Zhang, Rae Ying Yee Wong, Alan Zhu, Lijie Yang, Xiaoxiang Shi, Chunan Shi, Zhuoming Chen, Daiyaan Arfeen, Reyna Abhyankar, Zhihao Jia
PDF Cite Code DOI
SpecInfer: Accelerating Generative Large Language Model Serving with Tree-based Speculative Inference and Verification
Optimal Kernel Orchestration for Tensor Programs with Korch
Click the Cite button above to demo the feature to enable visitors to import publication metadata into their reference management software. Create your slides in Markdown - click the Slides button to check out the dta.
Muyan Hu, Ashwin Venkatram, Shreyashri Biswas, Balamurugan Marimuthu, Bohan Hou, Gabriele Oliaro, Haojie Wang, Liyan Zheng, Xupeng Miao, Jidong Zhai, Zhihao Jia
PDF Code
Optimal Kernel Orchestration for Tensor Programs with Korch
Direct Telemetry Access
Click the Cite button above to demo the feature to enable visitors to import publication metadata into their reference management software. Create your slides in Markdown - click the Slides button to check out the dta.
Jonatan Langlet, Ran Ben Basat, Gabriele Oliaro, Michael Mitzenmacher, Minlan Yu, Gianni Antichi
PDF Cite Code DOI
Direct Telemetry Access
Zero-CPU Collection with Direct Telemetry Access
Click the Cite button above to demo the feature to enable visitors to import publication metadata into their reference management software. Create your slides in Markdown - click the Slides button to check out the dta.
Jonatan Langlet, Ran Ben Basat, Sivaram Ramanathan, Gabriele Oliaro, Michael Mitzenmacher, Minlan Yu, Gianni Antichi
PDF Cite DOI
Zero-CPU Collection with Direct Telemetry Access