Learning Prefect
make prepare-dev
We need to open 4 terminal that are still in this directory, and make sure docker daemon is running:
- Run this in terminal 1 (prefect server + UI)
prefect backend server
prefect server start
- Run this in terminal 2 (supervisor)
prefect agent install local
Copy all the text that occur to supervisord.conf
, then run
supervisord
- Run this in terminal 3 (agent)
prefect agent start
- Run this in terminal 4
prefect create project new-project-id
pipenv run python etl-01.py