-
Notifications
You must be signed in to change notification settings - Fork 1.6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Partial parsing updates #1835
Labels
Milestone
Comments
beckjake
added a commit
that referenced
this issue
Oct 16, 2019
…e-upgrades Partial parse updates (#1835)
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Describe the feature
dbt currently accepts a command line flag,
--partial-parse
, which enables partial parsing of a dbt project. Two changes are required to make this flag ready for primetime:config:
block in theprofiles.yml
filepartial_parse.pickle
file across versions of dbt.Moving --partial-parse to the profile
The big idea here is that
--partial-parse
is cumbersome to apply in repeated invocations ofdbt run
. By supporting this flag in theconfig:
block of theprofiles.yml
file, users can opt-in to partial parsing without needing to specify the flag in every invocation of dbt. Partial parsing should remain an opt-in functionality.dbt may preserve the
--partial-parse
flag (and optionally support a--no-partial-parse
flag) which overrides the behavior defined in theprofiles.yml
config. This flag is not strictly necessary to support, but may be useful especially in debugging contexts.Recording dbt versions in the
partial_parse.pickle
fileThe
partial_parse.pickle
file should be written with adbt_version:
key which provides the dbt version that the pickle file was written with. If the version recorded in the.pickle
file does not match the version of dbt that is running, then dbt should not attempt to partial-parse the project.The text was updated successfully, but these errors were encountered: