"NonOverridableArguments" missing from aws_glue_job resource

[twnbay78]

Problem

The AWS Glue "create_job" and "update_job" API's provide a parameter of type map called "NonOverridableArguments." We have recently encountered an error in PROD where important job arguments that were meant to be non-overridable were overridden by the developers writing the Glue jobs, which resulted in a failure of an ETL workflow after several hours of a job running. The reason developers were able to override the parameters is because the aws_glue_job resource (defined here: https://www.terraform.io/docs/providers/aws/r/glue_job.html) does not provide an option to give non-overridable arguments (as shown here: https://docs.aws.amazon.com/glue/latest/dg/aws-glue-api-jobs-job.html)

Our temporary solution

As a (hopefully) very temporary solution, we have modified our glue-job module to include an optional local-exec provisioner which executes a boto3 script updating the Glue job with the "NonOverridableArguments" map after the glue job has been created.

Please support this parameter!!

[ghost]

This has been released in version 3.8.0 of the Terraform AWS provider. Please see the Terraform documentation on provider versioning or reach out if you need any assistance upgrading.

For further feature requests or bug reports with this functionality, please create a new GitHub issue following the template for triage. Thanks!

[ghost]

I'm going to lock this issue because it has been closed for 30 days ⏳. This helps our maintainers find and focus on the active issues.

If you feel this issue should be reopened, we encourage creating a new issue linking back to this one for added context. Thanks!