Skip to content

a configuration option helper for hadoop. fuzzy find what you are looking for.

Notifications You must be signed in to change notification settings

pandalanax/hdfshelper

Repository files navigation

hdfshelper

Go

Do you find yourself constantly searching for config options in Apache Hadoop? Then this is for you. Fuzzy find your way to the configuration option you're searching for. By default it pulls the options for the latest version aka current.

It prints out the xml ready to be pasted into the configuration file.

Usage

search all options from hdfs-site.xml on version r3.3.4:

hdfshelper -m hdfs -v r3.3.4

copy the output to clipboard (macOS):

hdfshelper -m core | pbcopy

search the description instead of the name (switch):

hdfshelper -s true

You can select more than one option to print with <TAB>. screenshot of fuzzyfind

Usage of hdfshelper:
  -m string
    	mode. decide which part of hdfs you want to configure and fuzzy find. Supported modes are:
    	        - core [core-site.xml]
    	        - yarn [yarn-site.xml]
    	        - hdfs [hdfs-site.xml](shorthand) (default "hdfs")
  -mode string
    	mode. decide which part of hdfs you want to configure and fuzzy find. Supported modes are:
    	        - core [core-site.xml]
    	        - yarn [yarn-site.xml]
    	        - hdfs [hdfs-site.xml] (default "hdfs")
  -s	Wether to search in configuration names or descriptions(shorthand)
  -switch
    	Wether to search in configuration names or descriptions
  -v string
    	The version of hadoop in format: rx.y.z (e.g. r3.3.6)(shorthand) (default "current")
  -version string
    	The version of hadoop in format: rx.y.z (e.g. r3.3.6) (default "current")

Building

go build 

or

nix build

Disclaimer

I use this little program for learning go. Bugs, crashes and everything that sucks are to be expected.

About

a configuration option helper for hadoop. fuzzy find what you are looking for.

Topics

Resources

Stars

Watchers

Forks

Packages

No packages published