Uses of Class
com.composum.ai.backend.base.impl.RateLimiter
-
Packages that use RateLimiter Package Description com.composum.ai.backend.base.impl com.composum.ai.backend.base.service.chat.impl -
-
Uses of RateLimiter in com.composum.ai.backend.base.impl
Methods in com.composum.ai.backend.base.impl that return RateLimiter Modifier and Type Method Description static RateLimiter
RateLimiter. of(String errorbody)
Tries to find something like "Limit: 3 / min." in errorbody and returns a RateLimiter for that.Constructors in com.composum.ai.backend.base.impl with parameters of type RateLimiter Constructor Description RateLimiter(RateLimiter parent, int limit, int period, TimeUnit timeUnit)
Constructs a rate limiter with a parent. -
Uses of RateLimiter in com.composum.ai.backend.base.service.chat.impl
Fields in com.composum.ai.backend.base.service.chat.impl declared as RateLimiter Modifier and Type Field Description protected RateLimiter
GPTChatCompletionServiceImpl. embeddingsLimiter
Rate limiter for embeddings.protected RateLimiter
GPTChatCompletionServiceImpl. gptLimiter
If set, this tells the limits of ChatGPT API itself.protected RateLimiter
GPTChatCompletionServiceImpl. limiter
Limiter that maps the financial reasons to limit.
-