It currently requires a version of vLLM that supports the necessary metrics to predict traffic load which is defined in the model server protocol. Support for Google ...