Skip to content

DJL v0.19.0 release
Compare
Choose a tag to compare
@xyang16 xyang16 released this 14 Sep 19:17
· 890 commits to master since this release
v0.19.0
37ef02d

Key Features

  • Creates new LightGBM engine (#1895)
  • Upgrades and enhancements for Engines
    • Upgrades PyTorch to 1.12.1 (#1894)
    • Upgrades ONNXRuntime to 1.12.1 (#1879)
    • Upgrades Apache MXNet to 1.9.1 (#1898)
    • Publishes new xgboost-gpu package to maven (#1918)
    • Adds ARM support for ONNXRuntime (#1856)
    • Disable autograd by default when PyTorch engine start (#1872)
  • Introduces several enhancement for HuggingFace tokenizer
    • Introduces HuggingFace model zoo (#1984)
    • Adds a few built-in Translators for HuggingFace NLP models
    • Adds macOS M1 support for HuggingFace tokenizer
    • Adds ARM support for HuggingFace tokenizer
    • Adds centos 7 support for HuggingFace tokenizer (#1874)
    • Adds decode API for HuggingFace tokenizer (#1843)
    • Adds padding and truncation support for HuggingFace tokenizer (#1870)
    • Support stride in tokenizers (#2006)
  • Introduces time series extension (#1903)
  • Adds new Audio API and improves audio extension (#1974)
  • Adds Android support for ONNXRuntime (#1844)
  • JDK18 support (#1892)
  • Adds python script to import HuggingFace model into DJL model zoo (#1835)
  • DJLServing
    • Adds management console plugin, which allows user manage models with web UI (#205)
    • Adds KServe plugin (#177)
    • Publishes DeepSpeed docker image to dockerhub (#223)

Enhancement

  • Adds a few more built-in Translators:
    • Adds HuggingFace QuestionAnsweringTranslator (#1828)
    • Adds HuggingFace FillMaskTranslator (#1876)
    • Adds HuggingFace TokenClassificationTranslator (#1906)
    • Adds HuggingFace TextClassificationTranslator (#1983)
    • Adds HuggingFace TextEmbeddingTranslator (#1953)
    • Adds speech recognition translator (#1899)
  • Adds new models to DJL model zoo:
    • Adds PyTorch deeplabvs model into DJL model zoo (#1818)
    • Adds MobileNetV1 into model zoo (#1817)
  • Image handling enhancement:
    • Improves ImageFactory to allow convert float32 NDArray to Image. (#1814)
    • Handle both HWC and CHW image (#1833)
  • DJL API improvements:
    • Adds NDArray normalize() operator (#1924)
    • Adds DeferredTranslatorFactory to let serving.properties take effect (#1868)
    • Makes PtBertQATranslator compatible with huggingface model (#1827)
    • Improves debug log for model loading options. (#1825)
    • Allows to load block only model for PyTorch (#1831)
    • Adds IdentityBlockFactory for demo/test purpose (#1854)
    • Support queryString for JarRepository (#1842)
    • Set arguments in serving.properties as model properties (#1853)
    • Allow overriding special token flags in encode and decode methods (#1855)
    • Adds support for intermediate sequential block results (#1943)
    • Adds load SentencePiece model from InputStream (#1949)
    • Allows use cached PyTorch native libraries in offline mode by caching "files.txt". (#1982)
    • Makes Encoding class constructor protected. (#1945)
    • Adds string tensor support for PyTorch (#1968)
    • Adds Loss function: Coverage.java (#1653)
    • Adds Loss function: QuantileLoss.java (#1652)
    • Validate data type for NDArray.set(Buffer) API (#1975)
    • Adds offline mode to to ensure not download engine files from network (#1987)
    • Adds encodeDual support for HuggingFace tokenizer (#1826)
    • Bulk batch creation and array indexing on mxnet engine (#1869)
    • Adds NDArray gammaln and sample distribution function support. (#1990)
    • Padding when the size of input is 2 in LSTM (#2000)
    • Creates a SystemNDManager interface (#1888)
  • Adds python script to import huggingface model into DJL model zoo
    • Added fill-mask support for converting huggingface model to model zoo (#1849)
    • Adds support for converting huggingface token-classification models (#1902)
    • Adds support for converting huggingface sentence-similarity models (#1913)
    • Adds support for converting huggingface text-classification models (#1972)

Documentation and Examples

  • Adds Neural machine translation example (#1851)
  • Adds New Bert example using Goemotions (#1682)
  • Adds Semantic Segmentation example (#1808)
  • Adds tokenizer readme for usage (#1981)
  • Updates troubleshooting.md to remove -native-auto package (#1793)
  • Document PYTORCH_PRECXX11 usage in README (#1807)
  • Immutable array output from InferenceMode PyTorch (#1822)
  • Fixes NDIndex javadoc issue (#1841)
  • Updates pose estimation example to detect joints for all people (#2002)
  • Adds Semantic segmentation and Speech recognition to README (#2003)
  • Updates links in README (#2005)
  • Adds an example of time series model inference (#1971)

Breaking change

  • NDManager.vaildateBufferSize() has been renamed to NDManager.validateBuffer()
  • Remove unnecessary DeviceType interface (#1978)

Bug Fixes

  • Adds missing text_embedding application in Application.of() (#1917)
  • Fixes capped manager bug for TensorFlow (#1952)
  • Fixes NDArray.set() bug (#1789)
  • Fixes breaking behavior for NDIndex in 0.18.0 (#1801)
  • Backward compatible with Apache MXNet indexing. (#1802)
  • Fixes OrtNDArray double close issue (#1809)
  • Fixes ImageFactory.fromNDArray() bug (#1824)
  • Fixes NDArrayAdapter toDevice() and toType() behavior (#1839)
  • Fixes the parsing issue (#1857)
  • Fixes OrtNDArray double free issue (#1861)
  • Fixes memory leak when using NDManager.newBaseManager() (#1887)
  • Fixes PyTorch download library fallback to CPU bug (#1951)
  • Fixes bug in Criteria (#1964)
  • Fixes issue in TrainMnistWithLSTM (#1965)
  • Fixes closing error in Apache MXNet when indexing results in an empty array (#1966)
  • Fixes path parsing bug on Windows (#1985)
  • Fixes memory leak in Apache MXNet layerNorm() (#1993)
  • Fix DynamicBuffer position error when expand for the first time (#2007)
  • Fix some bugs in pytorch based examples (#2009)

Contributors

New Contributors

Full Changelog: v0.18.0...v0.19.0

Contributors

zachgk, pdradx, and 17 other contributors
Assets 2
Loading