Zhuohan Li, Lianmin Zheng, Yinmin Zhong, Vincent Liu, Ying Sheng, Xin Jin, Yanping Huang, Zhifeng Chen, Hao Zhang, Joseph E. Gonzalez, Ion Stoica:
AlpaServe: Statistical Multiplexing with Model Parallelism for Deep Learning Serving. OSDI 2023: 663-679