HADOOP-13341: Deprecate HADOOP_SERVERNAME_OPTS; replace with (command)_(subcommand)_OPTS #126
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| MAPRED_DISTCP_OPTS="-Xmx2g" | ||
| ``` | ||
|
|
||
| These options will appear *after* `HADOOP_CLIENT_OPTS` during execution and will generally take precedence. |
There was a problem hiding this comment.
might be good to add an example here. e.g what the final options of distcp are going to be. Will there be two -Xmx commands? if so, which wins? Because I suspect that's a JVM decision
There was a problem hiding this comment.
If there is an Xmx in HADOOP_CLIENT_OPTS and an Xmx in MAPRED_DISTCP_OPTS, then the mapred distcp final HADOOP_OPTS will definitely have two Xmx flags. After HADOOP-13365, we'll be in a position to potentially de-dupe user provided settings like we do for other things. But until de-dupe, you're correct that it's a JVM decision. In the past, that decision has been last one wins and I doubt Oracle could change it if they wanted to at this point without major ramifications.
Signed-off-by: Allen Wittenauer <[email protected]>
Signed-off-by: Allen Wittenauer <[email protected]>
Signed-off-by: Allen Wittenauer <[email protected]>
…subcommand_opts (ie more granularity) Signed-off-by: Allen Wittenauer <[email protected]>
Signed-off-by: Allen Wittenauer <[email protected]>
…tent during debug Signed-off-by: Allen Wittenauer <[email protected]>
Signed-off-by: Allen Wittenauer <[email protected]>
shanthoosh
added a commit
to shanthoosh/hadoop
that referenced
this pull request
Oct 15, 2019
Author: Shanthoosh Venkataraman <[email protected]> Reviewers: Navina Ramesh <[email protected]> Closes apache#126 from shanthoosh/disable_all_async_run_loop_tests
This was referenced Jul 30, 2024
Merged
4 tasks
This was referenced Sep 10, 2024
This was referenced Sep 23, 2024
HADOOP-19284: [ABFS] Allow "fs.azure.account.hns.enabled" to be set as Account Specific Config
#7062
Merged
4 tasks
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.