Does the TextEmbeddingGenerationService use retries on Azure? #9188
-
|
Hi, I'm wondering whether the TextEmbeddingGenerationService for Azure OpenAI is using retries. I keep seeing 429 errors in my logs, but I also see some lines mentioning retries. I checked the code for the AzureOpenAITextEmbeddingGenerationService for any clues, but it doesn't mention anything around retries. Not even in the base class. |
Beta Was this translation helpful? Give feedback.
Answered by
sophialagerkranspandey
Oct 14, 2024
Replies: 1 comment
-
|
The error you're getting with 429 is due to throttling. You can see the details for limitations within the headers. We recommend adjusting and then retrying after an interval. |
Beta Was this translation helpful? Give feedback.
0 replies
Answer selected by
sophialagerkranspandey
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
The error you're getting with 429 is due to throttling. You can see the details for limitations within the headers. We recommend adjusting and then retrying after an interval.