Split-dependencies-into-groups (#129)

* split dependencies into groups

* add make commands

* update lint workflow

* rename to lint.yaml instead of ruff.yaml

* update contributing for installation of project and running tests

---------

Co-authored-by: Pavle Tabandzelic <[email protected]>

.github/workflows/lint.yaml

@@ -0,0 +1,14 @@
+name: Lint
+
+on: push 
+
+jobs:
+ ruff:
+ runs-on: ubuntu-latest
+ steps:
+ - uses: actions/checkout@v3
+ - uses: actions/setup-python@v4
+ with:
+ python-version: 3.9
+ - name: Run Ruff
+ uses: chartboost/ruff-action@v1

CONTRIBUTING.md

@@ -42,7 +42,7 @@ poetry env use python3.9
 
 After that you should install all the dependencies including development:
 ```shell
-poetry install
+make install_deps
 ```
 
 #### Setup Java
@@ -53,7 +53,10 @@ To run spark tests you need to have properly configured Java. Apache Spark curre
 ### Rinning Tests
 
 This project uses `pytest` and `chispa` for running spark tests. Please run all the tests before creating a pull request. In the case when you are working on new functionality you should also add new tests.
-
+You can run test as following:
+```shell
+make test
+```
 ### Code style
 
 This project follows the [PySpark style guide](https:/MrPowers/spark-style-guide/blob/main/PYSPARK_STYLE_GUIDE.md). All public functions and methods should be documented in `README.md` and also should have docstrings in `sphinx format`:

Makefile

@@ -0,0 +1,17 @@
+# COMMON CLI COMMANDS FOR DEVELOPMENT 
+
+.PHONY: install_deps
+install_deps:
+ @poetry install --with=development,linting,testing,docs
+
+.PHONY: update_deps
+update_deps:
+ @poetry update --with=development,linting,testing,docs
+
+.PHONY: test
+test:
+ @poetry run pytest tests
+
+.PHONY: lint 
+lint:
+ @poetry run ruff check --fix quinn