Machine Learning System

Parrot: Efficient Serving of LLM-based Applications with Semantic Variable
Chaofan Lin, Zhenhua Han*, Chengruidong Zhang, Yuqing Yang*, Fan Yang, Chen Chen*, Lili Qiu
(* Corresponding author)
18th USENIX Symposium on Operating Systems Design and Implementation (OSDI'24)
[arXiv] | [code] | [conference page]

Copyright© 2022 Chaofan Lin | Last Edited, Mar. 27, 2024 | Source code: Lambda, feel free to use and modify. 闽ICP备2022013458号