xinference.client.Client.get_model#

Client.get_model(model_uid: str) → RESTfulModelHandle[sorgente]#

Launch the model based on the parameters on the server via RESTful APIs.

Parametri:

model_uid (str) – The unique id that identify the model.

Ritorna:

The corresponding Model Handler based on the Model specified in the uid:

xinference.client.handlers.GenerateModelHandle -> provide handle to basic generate Model. e.g. Baichuan.
xinference.client.handlers.ChatModelHandle -> provide handle to chat Model. e.g. Baichuan-chat.

Tipo di ritorno:

ModelHandle

Solleva:

RuntimeError – Report failure to get the wanted model with given model_uid. Provide details of failure through error message.