Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add FlatObject FieldMapper #6507

Merged
merged 29 commits into from
Apr 7, 2023
Merged

Add FlatObject FieldMapper #6507

merged 29 commits into from
Apr 7, 2023

Commits on Mar 22, 2023

  1. Add FlatObject FieldMapper 

    Signed-off-by: Mingshi Liu <[email protected]>
    @mingshl
    mingshl committed Mar 22, 2023
    Configuration menu
    Copy the full SHA
    6218161 View commit details
    Browse the repository at this point in the history

  2. resolve import package for HttpHost 

    Signed-off-by: Mingshi Liu <[email protected]>
    @mingshl
    mingshl committed Mar 22, 2023
    Configuration menu
    Copy the full SHA
    42f730a View commit details
    Browse the repository at this point in the history

  3. Dynamic Create FlatObjectFieldType for dotpath field 

    Signed-off-by: Mingshi Liu <[email protected]>
    @mingshl
    mingshl committed Mar 22, 2023
    Configuration menu
    Copy the full SHA
    5932bc7 View commit details
    Browse the repository at this point in the history

  4. Rename flat-object to flat_object and fix CI tests 

    Signed-off-by: Mingshi Liu <[email protected]>
    @mingshl
    mingshl committed Mar 22, 2023
    Configuration menu
    Copy the full SHA
    86b22d9 View commit details
    Browse the repository at this point in the history

  5. Organized package 

    Signed-off-by: Mingshi Liu <[email protected]>
    @mingshl
    mingshl committed Mar 22, 2023
    Configuration menu
    Copy the full SHA
    70b680f View commit details
    Browse the repository at this point in the history

  6. resolved compile error 

    Signed-off-by: Mingshi Liu <[email protected]>
    @mingshl
    mingshl committed Mar 22, 2023
    Configuration menu
    Copy the full SHA
    da425e4 View commit details
    Browse the repository at this point in the history

  7. organize package 

    Signed-off-by: Mingshi Liu <[email protected]>
    @mingshl
    mingshl committed Mar 22, 2023
    Configuration menu
    Copy the full SHA
    4a7b503 View commit details
    Browse the repository at this point in the history

  8. Merge branch 'main' into flat-object-api

    @mingshl
    mingshl committed Mar 22, 2023
    Configuration menu
    Copy the full SHA
    cba30f5 View commit details
    Browse the repository at this point in the history

Commits on Mar 23, 2023

  1. Add integration tests and remove benchmark 

    Signed-off-by: Mingshi Liu <[email protected]>
    @mingshl
    mingshl committed Mar 23, 2023
    Configuration menu
    Copy the full SHA
    e98f06b View commit details
    Browse the repository at this point in the history

Commits on Mar 24, 2023

  1. fix IT tests 

    Signed-off-by: Mingshi Liu <[email protected]>
    @mingshl
    mingshl committed Mar 24, 2023
    Configuration menu
    Copy the full SHA
    bdd5e29 View commit details
    Browse the repository at this point in the history

  2. Skip IT tests before 2.7.0 

    Signed-off-by: Mingshi Liu <[email protected]>
    @mingshl
    mingshl committed Mar 24, 2023
    Configuration menu
    Copy the full SHA
    1753062 View commit details
    Browse the repository at this point in the history

  3. Revert "Skip IT tests before 2.7.0" 

    Signed-off-by: Mingshi Liu <[email protected]>
    @mingshl
    mingshl committed Mar 24, 2023
    Configuration menu
    Copy the full SHA
    0a5d0b9 View commit details
    Browse the repository at this point in the history

Commits on Mar 28, 2023

  1. Add more IT tests for supported queries 

    Signed-off-by: Mingshi Liu <[email protected]>
    @mingshl
    mingshl committed Mar 28, 2023
    Configuration menu
    Copy the full SHA
    cdf6797 View commit details
    Browse the repository at this point in the history

Commits on Mar 29, 2023

  1. Removed license head and add tests for wildcard query 

    Signed-off-by: Mingshi Liu <[email protected]>
    @mingshl
    mingshl committed Mar 29, 2023
    Configuration menu
    Copy the full SHA
    83a6b09 View commit details
    Browse the repository at this point in the history

Commits on Mar 31, 2023

  1. Add tests for array, nested-arrary, number and float 

    Signed-off-by: Mingshi Liu <[email protected]>
    @mingshl
    mingshl committed Mar 31, 2023
    Configuration menu
    Copy the full SHA
    1670aa9 View commit details
    Browse the repository at this point in the history

Commits on Apr 3, 2023

  1. Upgrade FlatObjectFieldMapperTests to MapperTestCase 

    - Upgrading `FlatObjectFieldMapperTests` from `MapperServiceTestCase` to `MapperTestCase`. The `MapperTestCase` explicitly forces us to:
	- Test parameter updates (empty now)
	- Explicitly specify if the field supports Meta and Boost (if not, relevant tests are automatically skipped)
- Test also the substring fields
- Add new test `testMapperServiceHasParser` to verify the new `flat_object` field mapper is present in mapper service registry
- Remove duplicated test and assertions methods
- Removed `testExistsQueryDocValuesDisabledWithNorms` as this test was not adding much. We shall reintroduce similar test later if we decide that we want to support ExistsQuery and what to do if DocValue are disabled and Norms enabled.

Signed-off-by: Lukáš Vlček <[email protected]>
    @lukas-vlcek
    lukas-vlcek committed Apr 3, 2023
    Configuration menu
    Copy the full SHA
    3504c05 View commit details
    Browse the repository at this point in the history

  2. Add exist query in FlatObjectFieldMapperTests and FlatObjectFieldData… 

    …Tests

Signed-off-by: Mingshi Liu <[email protected]>
    @mingshl
    mingshl committed Apr 3, 2023
    Configuration menu
    Copy the full SHA
    37e646b View commit details
    Browse the repository at this point in the history

  3. Add IT tests for painless query in testDocValues 

    Signed-off-by: Mingshi Liu <[email protected]>
    @mingshl
    mingshl committed Apr 3, 2023
    Configuration menu
    Copy the full SHA
    b9e6223 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'opensearch-project:main' into flat-object-api

    @mingshl
    mingshl authored Apr 3, 2023
    Configuration menu
    Copy the full SHA
    7a28527 View commit details
    Browse the repository at this point in the history

Commits on Apr 4, 2023

  1. Add filter script (Painless) test for flat_object 

    While it is not possible to use flat_object field in scripting filter context to access doc values (like `doc[<flat_object>.<field_x>]`) it is possible to call `doc[<flat_object>].size()` to get number of fields inside the flat_object field.

- Reorganize flat_object yaml tests into sections:
  - Mappings
  - Supported
  - Unsupported
- Scripting (Painless) yamlRest tests need to go into lang-painless module

Signed-off-by: Lukáš Vlček <[email protected]>
    @lukas-vlcek
    lukas-vlcek committed Apr 4, 2023
    Configuration menu
    Copy the full SHA
    3302ac3 View commit details
    Browse the repository at this point in the history

Commits on Apr 5, 2023

  1. Removed Normalizer 

    Signed-off-by: Mingshi Liu <[email protected]>
    @mingshl
    mingshl committed Apr 5, 2023
    Configuration menu
    Copy the full SHA
    c8e51e9 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/flat-object-api' into flat-objec… 

    …t-api
    @mingshl
    mingshl committed Apr 5, 2023
    Configuration menu
    Copy the full SHA
    73f08d7 View commit details
    Browse the repository at this point in the history

  3. removed unused codes 

    Signed-off-by: Mingshi Liu <[email protected]>
    @mingshl
    mingshl committed Apr 5, 2023
    Configuration menu
    Copy the full SHA
    a02a398 View commit details
    Browse the repository at this point in the history

Commits on Apr 6, 2023

  1. Remove non-relevant Javadoc from DynamicKeyFieldMapper 

    Signed-off-by: Lukáš Vlček <[email protected]>
    @lukas-vlcek
    lukas-vlcek committed Apr 6, 2023
    Configuration menu
    Copy the full SHA
    e4546c7 View commit details
    Browse the repository at this point in the history

  2. Improve flat_object scripting test 

    Make it more obvious what the `doc[<flat_field>].size()` number represents.

Signed-off-by: Lukáš Vlček <[email protected]>
    @lukas-vlcek
    lukas-vlcek committed Apr 6, 2023
    Configuration menu
    Copy the full SHA
    e1c17f0 View commit details
    Browse the repository at this point in the history

  3. Add test for mapping parameters 

    Mapping parameters are not allowed in the initial version. This commit adds a test to demonstrate that trying to specify index/search analyzer for the flat_object field will fail.

Signed-off-by: Lukáš Vlček <[email protected]>
    @lukas-vlcek
    lukas-vlcek committed Apr 6, 2023
    Configuration menu
    Copy the full SHA
    de2f32b View commit details
    Browse the repository at this point in the history

  4. remove IndexAnalyzer from Builder 

    Signed-off-by: Mingshi Liu <[email protected]>
    @mingshl
    mingshl committed Apr 6, 2023
    Configuration menu
    Copy the full SHA
    27ee059 View commit details
    Browse the repository at this point in the history

  5. Merge remote-tracking branch 'origin/flat-object-api' into flat-objec… 

    …t-api
    @mingshl
    mingshl committed Apr 6, 2023
    Configuration menu
    Copy the full SHA
    1f2206a View commit details
    Browse the repository at this point in the history

  6. remove IndexAnalyzer from Builder 

    Signed-off-by: Mingshi Liu <[email protected]>
    @mingshl
    mingshl committed Apr 6, 2023
    Configuration menu
    Copy the full SHA
    543755f View commit details
    Browse the repository at this point in the history