Interface GPTBackendsService
-
- All Known Implementing Classes:
GPTBackendsServiceImpl
public interface GPTBackendsService
A service managing the backends forGPTChatCompletionService
etc.
-
-
Method Summary
All Methods Instance Methods Abstract Methods Modifier and Type Method Description List<String>
getActiveBackends()
Returns a list of active backends.List<String>
getAllModels()
List of all model names configured for the active backends, no matter from which backend.GPTBackendConfiguration
getConfigurationForModel(String model)
Determines the backend a model is from.String
getModelNameInBackend(String model)
If the model is of the formbackendId:modelname
then this returns the modelname, otherwise returns the model as it is.
-
-
-
Method Detail
-
getAllModels
@Nonnull List<String> getAllModels()
List of all model names configured for the active backends, no matter from which backend.
-
getActiveBackends
@Nonnull List<String> getActiveBackends()
Returns a list of active backends. Those can be used as prefix for unconfigured modelsbackendId:modelname
.
-
getConfigurationForModel
@Nullable GPTBackendConfiguration getConfigurationForModel(@Nonnull String model)
Determines the backend a model is from.- Parameters:
model
- the model name , possibly in the formbackendId:modelname
- in that case it can be a model that is not configured explicitly in the backend.- Returns:
- the backend configuration for the model or null if no backend is found.
-
-