-
Notifications
You must be signed in to change notification settings - Fork 3.9k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
aws-eks: Support AL2_ARM_64_GPU NodeGroupAmiType #26354
Comments
According to the doc
I guess it's not supported yet. But I am interested to know your use case. Why you'd like to use g5g to run Amazon EKS nodegroup? What kind of the workload are you running in k8s? |
I am running an image Inferencing model in EKS and I'm looking to have the most cost effective instance type with a GPU. The g5g is about 20% cheaper than the g4dn which I'm currently using. I tried using the inferentia instance class but unfortunately only inf1 is available in us-west-2 currently, and I was not able to get the same performance per dollar with our workload. |
Probably this is blocked by awslabs/amazon-eks-ami#853 ? See also https://docs.aws.amazon.com/eks/latest/APIReference/API_Nodegroup.html |
Describe the feature
Using the aws-eks library it would be great if I was able to create a nodeGroup with a Graviton GPU instance like the g5g class. However, the NodegroupAmiType does not support AL2_ARM_64_GPU only AL2_ARM_64 which gets denied when trying to synth cdk. If I don't specify the amiType it defaults to AL2_x86_64_GPU and errors out that the g5g.xlarge is not a valid instance type for the requested amiType.
Use Case
To create a nodeGroup with a g5g instance type
Proposed Solution
add support for AL2_ARM_64_GPU to the NodegroupAmiType enum.
Other Information
No response
Acknowledgements
CDK version used
2.87.0
Environment details (OS name and version, etc.)
Mac os 12.4
The text was updated successfully, but these errors were encountered: