Skip to content

Releases: deepjavalibrary/djl

DJL v0.30.0 Release

13 Sep 19:52
@xyang16 xyang16
v0.30.0
faaf4be
Compare
Choose a tag to compare
DJL v0.30.0 Release Latest
Latest

Key Changes

  • Engine Updates:
    • OnnxRuntime 1.19.0 #3446
    • Huggingface Tokenizers 0.20.0 #3452
  • Added mask generation task for SAM2 model #3450
  • Text Embedding Inference:
    • Added Mistral, Qwen2, GTE, Camembert embedding model support
    • Added reranker model support

Enhancement

Bug Fixes

Documentation

CI/CD

Full Changelog: v0.29.0...v0.30.0

Contributors

siddvenk, frankfliu, and 4 other contributors
Assets 2
Loading

DJL v0.28.0 Release

16 May 03:46
@tosterberg tosterberg
v0.28.0
b55df0a
Compare
Choose a tag to compare
DJL v0.28.0 Release

Key Changes

  • Upgrades for engines
  • Enhancements for engines and API
    • Adds experimental Rust engine #3078

Enhancement

Bug Fixes

Documentation

CI/CD

New Contributors

Full Changelog: v0.27.0...v0.28.0

Contributors

zachgk, david-sitsky, and 5 other contributors
Assets 2
Loading

DJL v0.29.0 Release

19 Jul 01:45
@ydm-amazon ydm-amazon
v0.29.0
d7c8a74
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
DJL v0.29.0 Release

Key Changes

  • Upgrades for engines

    • Upgrades PyTorch engine to 2.3.1
    • Upgrades TensorFlow engine to 2.16.1
    • Introduces Rust engine CUDA support
    • Upgrades OnnxRuntime version to 1.18.0 and added CUDA 12.4 support
    • Upgrades javacpp version to 1.5.10
    • Upgrades HuggingFace tokenizer to 0.19.1
    • Fixes several issues for LightGBM engine
    • Deprecated llamacpp engine

  • Enhancements for engines and API

    • Adds Yolov8 segmentation and pose detection support
    • Adds metric type to Metic class
    • Improves drawJoints and drawMask behavior for CV model
    • Improves HuggingFace model importing and conversion tool
    • Improves HuggingFace NLP model batch inference performance
    • Adds built-in ONNX extension support
    • Adds several NDArray operators in PyTorch engine
    • Adds fp16 and bf16 support for OnnxRuntime engine
    • Adds CrossEncoder support for NLP models

Enhancements

Bug Fixes

Documentation

Read more

Contributors

tadayosi, bradh, and 15 other contributors
Assets 2
Loading

DJL v0.24.0 Release

16 Oct 20:40
@zachgk zachgk
v0.24.0
d7c8a74
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
DJL v0.24.0 Release

Key Features

Enhancement

Bug fixes

Documentation and Examples

CI

New Contributors

Full Changelog: v0.23.0...v0.24.0

Contributors

juliangamble, zachgk, and 8 other contributors
Assets 2
Loading

DJL v0.9.0 release note

18 Dec 22:06
@stu1130 stu1130
v0.9.0
d7c8a74
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
DJL v0.9.0 release note

DJL 0.9.0 brings MXNet inference optimization, abundant PyTorch new feature support, TensorFlow windows GPU support and experimental DLR engine that support TVM models.

Key Features

  • Add experimental DLR engine support. Now you can run TVM model with DJL

MXNet

  • Improve MXNet JNA layer by reusing String, String[] and PointerArray with object pool which reduce the GC time significantly

PyTorch

  • you can easily create COO Sparse Tensor with following code snippet
long[][] indices = {{0, 1, 1}, {2, 0, 2}};
float[] values = {3, 4, 5};
FloatBuffer buf = FloatBuffer.wrap(values);
manager.createCoo(FloatBuffer.wrap(values), indices, new Shape(2, 4));
  • If the input of your TorchScript model need List or Dict type, we now add simple one dimension support for you.
// assum your torchscript model takes model({'input': input_tensor})
// you tell us this kind of information by setting the name
NDArray array = manager.ones(new Shape(2, 2));
array.setName("input1.input");
  • we support loading ExtraFilesMap
// saving ExtraFilesMap
Criteria<Image, Classifications> criteria = Criteria.builder()
  ...
  .optOption("extraFiles.dataOpts", "your value")  // <- pass in here 
  ...

TensorFlow

  • Windows GPU is now supported

Several Engines upgrade

Engine version
PyTorch 1.7.0
TensorFlow 2.3.1
fastText 0.9.2

Enhancement

  • Add docker file for serving
  • Add Deconvolution support for MXNet engine
  • Support PyTorch COO Sparse tensor
  • Add CSVDataset, you can find a sample usage here
  • Upgrade TensorFlow to 2.3.1
  • Upgrade PyTorch to 1.7.0
  • Add randomInteger operator support for MXNet and PyTorch engine
  • Add PyTorch Profiler
  • Add TensorFlow Windows GPU support
  • Support loading the model from jar file
  • Support 1-D list and dict input for TorchScript
  • Remove the Pointer class being used for JNI to relieve Garbage Collector pressure
  • Combine several BertVocabulary into one Vocabulary
  • Add loading the model from Path class
  • Support ExtraFilesMap for PyTorch model inference
  • Allow both int32 & int64 for prediction & labels in TopKAccuracy
  • Refactor MXNet JNA binding to reduce GC time
  • Improve PtNDArray set method to use ByteBuffer directly and avoid copy during tensor creation
  • Support experimental MXNet optimizeFor method for accelerator plugin.

Documentation and examples

  • Add Amazon Review Ranking Classification
  • Add Scala Spark example code on Jupyter Notebook
  • Add Amazon SageMaker Notebook and EMR 6.2.0 examples
  • Add DJL benchmark instruction

Bug Fixes

  • Fix PyTorch Android NDIndex issue
  • Fix Apache NiFi issue when loading multiple native in the same Java process
  • Fix TrainTicTacToe not training issue
  • Fix Sentiment Analysis training example and FixedBucketSampler
  • Fix NDArray from DataIterable not being attaching to NDManager properly
  • Fix WordPieceTokenizer infinite loop
  • Fix randomSplit dataset bug
  • Fix convolution and deconvolution output shape calculations

Contributors

Thank you to the following community members for contributing to this release:

Frank Liu(@frankfliu)
Lanking(@lanking520)
Kimi MA(@kimim)
Lai Wei(@roywei)
Jake Lee(@stu1130)
Zach Kimberg(@zachgk)
0xflotus(@0xflotus)
Joshua(@euromutt)
mpskowron(@mpskowron)
Thomas(@thhart)
DocRozza(@docrozza)
Wai Wang(@waicool20)
Trijeet Modak(@uniquetrij)

Contributors

zachgk, thhart, and 11 other contributors
Assets 2
Loading

DJL v0.7.0 release notes

04 Sep 01:14
@stu1130 stu1130
v0.7.0
d7c8a74
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
DJL v0.7.0 release notes Pre-release
Pre-release

DJL 0.7.0 brings SetencePiece for tokenization, GravalVM support for PyTorch engine, a new set of Nerual Network operators, BOM module, Reinforcement Learning interface and experimental DJL Serving module.

Key Features

  • Now you can leverage powerful SentencePiece to do text processing including tokenization, de-tokenization, encoding and decoding. You can find more details on extension/sentencepiece.
  • Engine upgrade:
    • MXNet engine: 1.7.0-backport
    • PyTorch engine: 1.6.0
    • TensorFlow: 2.3.0
  • MXNet multi-gpu training now is boosted by MXNet KVStore by default, which saves lots of overhead by GPU memory copy.
  • GraalVM are fully supported on both of regular execution and native image for PyTorch engine. You can find more details on GraalVM example.
  • Add a new set of Neural Network operators that offers capability of full controlling over parameters for CV domain, which is similar to PyTorch nn.functional module. You can find the operator method in its Block class.
Conv2d.conv2d(NDArray input, NDArray weight, NDArray bias, Shape stride, Shape padding, Shape dilation, int groups);
  • Bill of Materials (BOM) is introduced to manage the version of dependencies for you. In DJL, the engine you are using usually is tied to a specific version of native package. By easily adding BOM dependencies like this, you won’t worry about version anymore.
<dependency>
    <groupId>ai.djl</groupId>
    <artifactId>bom</artifactId>
    <version>0.7.0</version>
    <type>pom</type>
    <scope>import</scope>
</dependency>
implementation platform("ai.djl:bom:0.7.0")
  • JDK 14 now get supported
  • New Reinforcement Learning interface including RIAgent, RlEnv, etc, you can see a comprehensive TicTacToe example.
  • Support DJL Serving module. With only a single command, now you can enjoy deploying your model without bothering writing the server code or config like server proxy.
cd serving && ./gradlew run --args="-m https://djl-ai.s3.amazonaws.com/resources/test-models/mlp.tar.gz"

Documentation and examples

  • We wrote the D2L book from chapter 1 to chapter 7 with DJL. You can learn basic deep learning concept and classic CV model architecture with DJL. Repo
  • We launched a new doc website that hosts abundant documents and tutorials for quick search and copy-paste.
  • New Online Sentiment Analysis with Apache Flink.
  • New CTR prediction using Apache Beam and Deep Java Library(DJL).
  • New DJL logging configuration document which includes how to enable slf4j, switch to other logging libraries and adjust log level to debug the DJL.
  • New Dependency Management document that lists DJL internal and external dependencies along with their versions.
  • New CV Utilities document as a tutorial for Image API.
  • New Cache Management document is updated with more detail on different categories.dependency management.
  • Update Model Loading document to describe loading model from various sources like s3, hdfs.

Enhancement

  • Add archive file support to SimpleRepository
  • ImageFolder supports nested folder
  • Add singleton method for LambdaBlock to avoid redundant function reference
  • Add Constant Initializer
  • Add RMSProp, Adagrad, Adadelta Optimizer for MXNet engine
  • Add new tabular dataset: Airfoil Dataset
  • Add new basic dataset: CookingExchange, BananaDetection
  • Add new NumPy like operators: full, sign
  • Make prepare() method in Dataset optional
  • Add new Image augmentation APIs where you can add to Pipeline to enrich your image dataset
  • Add new handy fromNDArray to Image API for converting NDArray to Image object quickly
  • Add interpolation option for Image Resize operator
  • Support archive file for s3 repository
  • Import new SSD model from TensorFlow Hub into DJL model zoo
  • Import new Sentiment Analysis model from HuggingFace into DJL model zoo

Breaking changes

  • Drop CUDA 9.2 support for all the platforms including linux, windows
  • The arguments of several blocks are changed to align with the signature of other widely used Deep Learning frameworks, please refer to our Java doc site
  • FastText is no longer a full Engine, it becomes a part of NLP utilities in favor of FastTextWorkEmbedding
  • Move the WarmUp out from existing Tracking and introduce new WarmUpTracker
  • MxPredictor now doesn’t copy parameters by default, please make sure to use NaiveEngine when you run inference in multi-threading environment

Bug Fixes

  • Fixing Validation Epoch Result bug
  • Fix multiple process downloading the same model bug
  • Fix potential concurrent write bug while downloading metadata.json
  • Fix URI parsing error on Windows
  • Fix multi-gpu training crash when the number of the batch size is smaller than number of devices
  • Fix not setting number of inter-op threads for PyTorch engine

Contributors

Thank you to the following community members for contributing to this release:

Christoph Henkelmann, Frank Liu, Jake Cheng-Che Lee, Jake Lee, Keerthan Vasist, Lai Wei, Qing Lan, Victor Zhu, Zach Kimberg, aksrajvanshi, gstu1130, 蔡舒起

Assets 2
Loading

DJL v0.27.0 Release

28 Mar 21:19
@xyang16 xyang16
v0.27.0
32859b7
Compare
Choose a tag to compare
DJL v0.27.0 Release

Key Changes

  • Upgrades for engines
    • OnnxRuntime 1.17.1 #3019
  • Enhancements for engines and API
    • Supports PyTorch stream imperative model load #2981
    • Support encode/decode String tensor #3034

Enhancement

Bug Fixes

Documentation

CI/CD

New Contributors

Full Changelog: v0.26.0...v0.27.0

Contributors

morokosi, zachgk, and 11 other contributors
Assets 2
Loading

DJL v0.26.0 Release

16 Jan 19:09
@siddvenk siddvenk
v0.26.0
306e0c7
Compare
Choose a tag to compare
DJL v0.26.0 Release

Key Changes

  • LlamaCPP Support. You can use DJL to run supported LLMs using the LlamaCPP engine. See the Chatbot example here to learn more.
  • Manual Engine Initialization. You can configure DJL to not load any engines at startup, and query/register engines programmatically at runtime
  • Engine Updates:
    • PyTorch 2.1.1
    • Huggingface Tokenizers 0.15.0
    • OnnxRuntime 1.16.3
    • XGBoost 2.0.3

Enhancement

Bug Fixes

Documentation

CI/CD

New Contributors

Full Changelog: v0.25.0...v0.26.0

Contributors

maaquib, zachgk, and 9 other contributors
Assets 2
Loading

DJL v0.25.0 Release

09 Dec 00:13
@siddvenk siddvenk
v0.25.0
986a8a9
Compare
Choose a tag to compare
DJL v0.25.0 Release

Key Changes

  • Engine Upgrades
    • [XGB] support for .xgb file extension #2810
    • [Tokenizers] Upgrade tokenizers to 1.14.1 #2818
    • [XGB] Updates XGBoost to 2.0.1 #2833
  • Early Stopping support for Training by @jagodevreede #2806

Enhancement

Bug fixes

Documentation and Examples

CI

New Contributors

Full Changelog: v0.24.0...v0.25.0

Contributors

zachgk, jagodevreede, and 2 other contributors
Assets 2
Loading

DJL v0.23.0 release

13 Jul 00:34
@sindhuvahinis sindhuvahinis
v0.23.0
bae9212
Compare
Choose a tag to compare
DJL v0.23.0 release

Key Features

  • Upgrades for engines

    • Upgrades PyTorch engine to 2.0.1
    • Upgrades javacpp version to 1.5.9 (#2636)
    • Upgrades HuggingFace tokenizer to 0.13.3 (#2697)
    • Upgrades OnnxRuntime version to 1.15.0 and other dependencies version (#2658)

  • Enhancements for engines and API

    • Adds XGBoost aarch64 support (#2659)
    • Adds fastText macOS M1 supports (#2639)
    • Creates asynchronous predictStreaming (#2615)

  • Introduces text-generation search algorithm

    • Implements text-generation search algorithm (#2637)
    • Enhancement features for LMSearch (#2642)

Enhancement

  • DJL API improvements:

    • Adds uint16, uint32, uint64, int16, bf16 data type (#2570)
    • Adds NDArray topK operator for PyTorch (#2634)
    • Adds support for unsigned datatype (#2574)
    • Allows subclass access member variable of Predictor (#2582)
    • Makes PredictorContext constructor public (#2586)
    • Refactor ChunkedBytesSupplier to avoid unnecessary conversion (#2587)
    • Move compileJava() into ClassLoaderUtils (#2600)
    • Enable boolean input on ort (#2644)
    • Adds more logs for platform detection (#2646)
    • Improves DJL URL error message (#2678)
    • Avoid exception if SecurityManager is applied (#2665)
    • Masks sensitive env vars in debug print out (#2657)
    • open isImage() method to package children for reuse-enabling custom datasets (#2662)
    • Migrate google analytics (#2654)

  • PyTorch engine improvements

    • Load dependencies with specific order (#2599)
    • Improves IValue tuple of tuple support (#2651)
    • Add basic median support (#2701)

  • Spark extension enhancements

    • Support requirements.txt in model tar file (#2528)
    • Upgrade dependency version in Dockerfile (#2569)
    • Use batch predict in spark (#2545)
    • Change implicit conversions to explicit (#2595)

  • Huggingface tokenizer enhancements

    • Allow creating BPE huggingface tokenizers (2550)

  • Tensorflow engine enhancements

    • Reload javacpp properties (2668)

Breaking change

Bug fixes

  • Avoids exception for cuda version lower than 10.x (#2583)
  • Reverts "[bom] Simplify BOM build script (#2438)" 2598
  • CI fails looking for v3 reverting to v2 (#2604)
  • Fixes the dependencies issue (#2609)
  • Fixes the usage of the repeat function for embedding (#2590)
  • Adds missing djl-zero to bom (#2625)
  • Fixes tabnet predictor (#2643)
  • Fixes error message in X.dot(w) (#2688)
  • Fixes liquid parsing issues in pytorch ndarray cheatsheet (#2690)
  • Fixes getIOU bug (#2674)
  • Fixes setup formatting (#2653)
  • Fixes broken link (#2622)
  • Fixes LocalRepository detection (#2593)
  • Fix jupyter notebook links (#2704)

Documentation and Examples

  • Adds docs on JNI compilation (#2510)
  • Updates import tensorflow model README (#2614)
  • Updates pytorch native JNI development document (#2613)
  • Setup - Running on M1 Macs (#2652)
  • Adds pytorch vs djl ndarray cheatsheet (#2661)
  • Updates timeseries README (#2667)
  • Adds PT NDArray cheat sheet to docs (#2670)
  • Cleans stable_diffusion and add missing .md language blocks (#2635)
  • Updates README (#2596)
  • Fixes typos (#2603)
  • Fixes markdown format (#2608)

CI improvements

  • Upgrades github action gradle plugin to v3 (#2576)
  • Avoids upload djl-serving.tar to S3 if already exist (#2578)
  • Upgrades spotbugs to 5.0.14 (#2594)
  • Upgrades gradle to 8.1.1 (#2611)
  • Publishes PyTorch 2.0.1 jni package (#2699)
  • Removes cu102 test (#2689)
  • Fixes nightly publish ci bug (#2691)
  • Fixes djl-serving release publish workflow script (#2568)
  • Minor fix to the instance spinning (#2606)
  • Adds Triton and FasterTransformers source build instruction (#2605)
  • Publishes triton executable (#2617)
  • Adds http endpoint in the build (#2618)

Contributors

Thank you to the following community members for contributing to this release:
@frankfliu
@KexinFeng
@lanking520
@xyang16
@zachgk
@takanori-ugai
@tosterberg
@siddvenk

New Contributors

Full Changelog: v0.22.1...v0.23.0

Contributors

juliangamble, larochef, and 10 other contributors
Assets 2
Loading