Skip to content

Commit

Permalink
Update runtime packages (#10)
Browse files Browse the repository at this point in the history
* add ctransformers

* update package list

* lockfile with vllm

* pixi.toml with vllm

* recommend starting with unpinned version

* add new packages

* update tests

* remove gensim

* remove vllm dependency

* bitsandbytes gpu-specific build

* test bitsandbytes available

* alphabetize bitsandbytes
  • Loading branch information
klwetstone authored Aug 30, 2024
1 parent 6dd22b8 commit 02eec2d
Show file tree
Hide file tree
Showing 4 changed files with 2,613 additions and 2,684 deletions.
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -161,7 +161,7 @@ The runtime manages dependencies using [Pixi](https://pixi.sh/latest/). Here is
2. Install pixi. See [here](https://pixi.sh/latest/) for installation options.
3. Edit the `runtime/pixi.toml` file to add your new packages in the [`dependencies`](https://pixi.sh/latest/reference/project_configuration/#the-dependencies-tables) section. You'll need to determine which environment(s) your new package is required for, and whether the package will be installed with conda (preferred) or pip.
3. Edit the `runtime/pixi.toml` file to add your new packages in the [`dependencies`](https://pixi.sh/latest/reference/project_configuration/#the-dependencies-tables) section. You'll need to determine which environment(s) your new package is required for, and whether the package will be installed with conda (preferred) or pip. We recommend starting without a specific pinned version, and then pinning to the version in the resolved `pixi.lock` file that is generated.
- **CPU, GPU, or base:** The `pixi.toml` file includes different sections for dependencies that apply to both the CPU and GPU environments (`feature.base`), the CPU environment only (`feature.cpu`), and the GPU environment only (`feature.gpu`).
Expand Down
Loading

0 comments on commit 02eec2d

Please sign in to comment.