Interface GPTBackendsService
-
- All Known Implementing Classes:
GPTBackendsServiceImpl
public interface GPTBackendsServiceA service managing the backends forGPTChatCompletionServiceetc.
-
-
Method Summary
All Methods Instance Methods Abstract Methods Modifier and Type Method Description List<String>getActiveBackends()Returns a list of active backends.List<String>getAllModels()List of all model names configured for the active backends, no matter from which backend.GPTBackendConfigurationgetConfigurationForModel(String model)Determines the backend a model is from.StringgetModelNameInBackend(String model)If the model is of the formbackendId:modelnamethen this returns the modelname, otherwise returns the model as it is.
-
-
-
Method Detail
-
getAllModels
@Nonnull List<String> getAllModels()
List of all model names configured for the active backends, no matter from which backend.
-
getActiveBackends
@Nonnull List<String> getActiveBackends()
Returns a list of active backends. Those can be used as prefix for unconfigured modelsbackendId:modelname.
-
getConfigurationForModel
@Nullable GPTBackendConfiguration getConfigurationForModel(@Nonnull String model)
Determines the backend a model is from.- Parameters:
model- the model name , possibly in the formbackendId:modelname- in that case it can be a model that is not configured explicitly in the backend.- Returns:
- the backend configuration for the model or null if no backend is found.
-
-