Skip to content
This repository has been archived by the owner on Dec 16, 2022. It is now read-only.

validate pretrained configs in CI #112

Merged
merged 22 commits into from
Aug 17, 2020
Merged

validate pretrained configs in CI #112

merged 22 commits into from
Aug 17, 2020

Conversation

epwalsh
Copy link
Member

@epwalsh epwalsh commented Aug 12, 2020

closes allenai/allennlp#3649 by making sure every part of each training config can be instantiated. This CI job (called "Training Configs") will only run on master pushes and nightly builds to keep our CI snappy on pull requests.

@epwalsh
Copy link
Member Author

epwalsh commented Aug 12, 2020

Most of the CI test failures are due to training configs relying on environment variables or local paths for the data paths, which don't exist.

@epwalsh epwalsh marked this pull request as ready for review August 14, 2020 18:30
Copy link
Contributor

@matt-gardner matt-gardner left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Awesome!

patch_glove(value)


DATASET_PATCHES: Dict[Path, Tuple[str, ...]] = {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Wow, black did something pretty bad with this one...

"validation_data_path": "https://allennlp.s3.amazonaws.com/datasets/squad/squad-dev-v1.1.json",
"train_data_path": std.extVar("SQUAD_TRAIN"),
"validation_data_path": std.extVar("SQUAD_DEV"),
// You can replace the above two lines with these to get the actual squad datasets.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Adding this same comment in other config files would be nice. Hmm, looks like you have it in most, but not BART or SWAG.

@epwalsh epwalsh merged commit 87570ec into master Aug 17, 2020
@epwalsh epwalsh deleted the config-validation branch August 17, 2020 16:28
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Regression tests for training_config.
2 participants