Uses of Class
com.composum.ai.backend.base.service.chat.RateLimiter
-
Packages that use RateLimiter Package Description com.composum.ai.backend.base.service.chat com.composum.ai.backend.base.service.chat.impl -
-
Uses of RateLimiter in com.composum.ai.backend.base.service.chat
Fields in com.composum.ai.backend.base.service.chat declared as RateLimiter Modifier and Type Field Description static RateLimiterRateLimiter. UNLIMITEDDoes not limit in any way.Methods in com.composum.ai.backend.base.service.chat that return RateLimiter Modifier and Type Method Description static RateLimiterRateLimiter. of(String errorbody)Tries to find something like "Limit: 3 / min." in errorbody and returns a RateLimiter for that.Constructors in com.composum.ai.backend.base.service.chat with parameters of type RateLimiter Constructor Description RateLimiter(RateLimiter parent, int limit, int period, TimeUnit timeUnit)Constructs a rate limiter with a parent. -
Uses of RateLimiter in com.composum.ai.backend.base.service.chat.impl
Fields in com.composum.ai.backend.base.service.chat.impl declared as RateLimiter Modifier and Type Field Description protected RateLimiterGPTChatCompletionServiceImpl. embeddingsLimiterRate limiter for embeddings.protected RateLimiterGPTChatCompletionServiceImpl. gptLimiterIf set, this tells the limits of ChatGPT API itself.protected RateLimiterGPTChatCompletionServiceImpl. limiterLimiter that maps the financial reasons to limit.protected RateLimiterGPTDictationServiceImpl. limiter
-