Package com.composum.ai.backend.base.service
-
Class Summary Class Description StringstreamSlowdown For a stream of String segments (like the ChatGPT tokens that trickle in from ChatGPT when streaming) this collects the parts and forwards the collected part every 500ms to a given consumer. -
Exception Summary Exception Description GPTException Any kind of error when accessing GPT.GPTException.GPTContextLengthExceededException GPTException.GPTRetryableResponseErrorException An exception that is thrown when the response from the GPT service is not as expected.