-
Notifications
You must be signed in to change notification settings - Fork 1.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Azure o1 models: 'max_tokens' is not supported with this model #3309
Comments
I found a workaround by not supplying This doesn't quite feel right for intended behaviour though - perhaps maxTokens should map to I'm going to leave this issue open for now in case the team wants to reference it for future work here. Feel free to close if there is already an issue for this! Before a fix in the SDK, specifying that you cannot use |
Description
The o1 models do not appear to be supported for Azure, which launched API access for them this month. As with OpenAI, they changed
max_tokens
tomax_completion_tokens
for the o1 models, which breaks the AI SDK.Reproduction steps:
o1-preview
oro1-mini
with generateText() with maxTokens parameterError:
Code example
No response
Additional context
Latest SDK versions installed.
The text was updated successfully, but these errors were encountered: