zhengzangw/Sequence-Scheduling
PyTorch implementation of paper "Response Length Perception and Sequence Scheduling: An LLM-Empowered LLM Inference Pipeline".
正在读取项目信息…
开源雷达国内 GitHub 镜像站
加速通道已就绪
返回列表
开源雷达国内 GitHub 镜像站
PyTorch implementation of paper "Response Length Perception and Sequence Scheduling: An LLM-Empowered LLM Inference Pipeline".