Releases · teamclairvoyant/restonomer

31 Jan 15:36

What's Changed

Implemented Restonomer Persistence: Redshift
Implemented Restonomer Transformation - ReplaceNullsWithDefaultValue
Implemented Restonomer Transformation - FilterByRegex
Added support for handling Gunzipped text response from API and parse it to dataframe
Added provision to supply spark configs at a checkpoint level

Assets 2

30 Oct 20:18

Added support to use token value from the Token Request to headers in the Data Request
Added support to parse HTML Table response format from API response
Added Restonomer Transformation: Concat Columns
Added Restonomer Transformation: Coalesce Columns
Added Restonomer Transformation: Replace String In Column Name
Added provision to pass schema to the Convert JSON String To Struct transformation
Added Restonomer Pagination: Next Page URL Based Pagination
Added Restonomer Persistence: BigQuery

Assets 2

31 Aug 19:48

Integrated data-scalaxy-reader
Integrated data-scalaxy-transformer
Integrated data-scalaxy-writer
Integrated data-scalaxy-test-util
Integrated scala-steward
Integrated scalafix
Integrated wartremover
Added replaceExisting flag to transformations: AddColumn and AddColumnWithExpression
Added Restonomer Transformation: ConvertArrayOfStructToArrayOfJSONString
Added Restonomer Transformation: ConvertJSONStringToStruct
Added Restonomer Transformation: SelectColumnsWithExpressions
Created brand new restonomer website using Docusaurus

Assets 2

31 Jul 19:51

Added support for providing JSON body type to the request
Improved CastColumns transformation to cast columns to Date type with the custom date format
Improved CastColumns transformation to cast columns to Timestamp type with the custom timestamp format
Added Restonomer Transformation - CastFromToDataTypes
Added Restonomer Transformation - ReplaceEmptyStringsWithNulls
Added Restonomer Transformation - ChangeColumnCase
Added Restonomer Persistence - GCSBucket
Added main class to the framework so that restonomer can be used as a standalone application using fat jar
Added support for loading the restonomer context directory from the GCS Bucket

Assets 2

01 Jun 21:01

Added support to provide form data to the request object
Added 'scope' parameter in ClientCredentials grant type under OAuth2Authentication
Implemented Restonomer Transformation - AddColumn
Implemented Restonomer Pagination - PageNumberWithTotalPagesBasedPagination
Implemented Restonomer Pagination - CursorBasedPagination
Implemented Restonomer Pagination - OffsetBasedPagination