fix: #3703 - Deepseek-Coder-33B-Instruct is incompatible #3732
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Describe Your Changes
This PR updates the DeepSeek Coder 33B Instruct download URL to a working quantized version. Stop tokens have also been added, allowing the model to outputs properly.
Steps to Reproduce
Fixes Issues
Deepseek Coder 33B Instruct
- Check out what's wrong with VM 114 #3703Changes made
package.json
Updates:1.0.17
to1.0.18
.model.json
Updates fordeepseek-coder-1.3b
:1.3
to1.4
.stop
is now explicitly set to["<|EOT|>"]
, which defines the end-of-text token."Foundational Model"
, leaving only"Tiny"
.model.json
Updates fordeepseek-coder-34b
:deepseek-coder-33b-instruct.Q4_K_M.gguf
has been changed fromhttps://huggingface.co/TheBloke/deepseek-coder-33B-instruct-GGUF/resolve/main/deepseek-coder-33b-instruct.Q4_K_M.gguf
tohttps://huggingface.co/mradermacher/deepseek-coder-33b-instruct-GGUF/resolve/main/deepseek-coder-33b-instruct.Q4_K_M.gguf
.1.3
to1.4
.stop
is now explicitly set to["<|EOT|>"]
."Foundational Model"
and Updated"34B"
to"33B"
.