Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Backport 2.x] [Remote Store] Backport remote segment store changes #4380

Merged
merged 9 commits into from
Sep 2, 2022
Merged

[Backport 2.x] [Remote Store] Backport remote segment store changes #4380

merged 9 commits into from
Sep 2, 2022

Commits on Sep 2, 2022

  1. [Remote Store] Upload segments to remote store post refresh (opensear… 

    …ch-project#3460)

* Add RemoteDirectory interface to copy segment files to/from remote store

Signed-off-by: Sachin Kale <[email protected]>

Co-authored-by: Sachin Kale <[email protected]>

* Add index level setting for remote store

Signed-off-by: Sachin Kale <[email protected]>

Co-authored-by: Sachin Kale <[email protected]>

* Add RemoteDirectoryFactory and use RemoteDirectory instance in RefreshListener

Co-authored-by: Sachin Kale <[email protected]>
Signed-off-by: Sachin Kale <[email protected]>

* Upload segment to remote store post refresh

Signed-off-by: Sachin Kale <[email protected]>

Co-authored-by: Sachin Kale <[email protected]>
Signed-off-by: Sachin Kale <[email protected]>
    @sachinpkale
    sachinpkale and Sachin Kale committed Sep 2, 2022
    Configuration menu
    Copy the full SHA
    efaf7c6 View commit details
    Browse the repository at this point in the history

  2. [Remote Store] Inject remote store in IndexShard instead of RemoteSto… 

    …reRefreshListener (opensearch-project#3703)

* Inject remote store in IndexShard instead of RemoteStoreRefreshListener

Signed-off-by: Sachin Kale <[email protected]>

* Pass supplier of RepositoriesService to RemoteDirectoryFactory

Signed-off-by: Sachin Kale <[email protected]>

* Create isRemoteStoreEnabled function for IndexShard

Signed-off-by: Sachin Kale <[email protected]>

* Explicitly close remoteStore on indexShard close

Signed-off-by: Sachin Kale <[email protected]>

* Change RemoteDirectory.close to a no-op

Signed-off-by: Sachin Kale <[email protected]>

Co-authored-by: Sachin Kale <[email protected]>
    @sachinpkale
    sachinpkale and Sachin Kale committed Sep 2, 2022
    Configuration menu
    Copy the full SHA
    a1c2a9d View commit details
    Browse the repository at this point in the history

  3. [Remote Store] Add remote store restore API implementation (opensearc… 

    …h-project#3642)

* Add remote restore API implementation

Signed-off-by: Sachin Kale <[email protected]>
    @sachinpkale
    sachinpkale authored and Sachin Kale committed Sep 2, 2022
    Configuration menu
    Copy the full SHA
    be4e15b View commit details
    Browse the repository at this point in the history

  4. [Remote Store] Add support to add nested settings for remote store (o… 

    …pensearch-project#4060)

* Add support to add nested settings for remote store

Signed-off-by: Sachin Kale <[email protected]>
    @sachinpkale
    sachinpkale authored and Sachin Kale committed Sep 2, 2022
    Configuration menu
    Copy the full SHA
    cbc63d5 View commit details
    Browse the repository at this point in the history

  5. [Remote Store] Add rest endpoint for remote store restore (opensearch… 

    …-project#3576)

* Add rest endpoint for remote store restore

Signed-off-by: Sachin Kale <[email protected]>
    @sachinpkale
    sachinpkale authored and Sachin Kale committed Sep 2, 2022
    Configuration menu
    Copy the full SHA
    3d50a74 View commit details
    Browse the repository at this point in the history

  6. [Remote Store] Add validator that forces segment replication type bef… 

    …ore enabling remote store (opensearch-project#4175)

* Add validator that forces segment replication type before enabling remote store

Signed-off-by: Sachin Kale <[email protected]>
    @sachinpkale
    sachinpkale authored and Sachin Kale committed Sep 2, 2022
    Configuration menu
    Copy the full SHA
    ce84f82 View commit details
    Browse the repository at this point in the history

  7. [Remote Store] Change remote_store setting validation message to make… 

    … it more clear (opensearch-project#4199)

* Change remote_store setting validation message to make it more clear

Signed-off-by: Sachin Kale <[email protected]>
    @sachinpkale
    sachinpkale authored and Sachin Kale committed Sep 2, 2022
    Configuration menu
    Copy the full SHA
    85bc986 View commit details
    Browse the repository at this point in the history

  8. [Remote Store] Add RemoteSegmentStoreDirectory to interact with remot… 

    …e segment store (opensearch-project#4020)

* Add RemoteSegmentStoreDirectory to interact with remote segment store

Signed-off-by: Sachin Kale <[email protected]>
    @sachinpkale
    sachinpkale authored and Sachin Kale committed Sep 2, 2022
    Configuration menu
    Copy the full SHA
    3c51fad View commit details
    Browse the repository at this point in the history

  9. Use RemoteSegmentStoreDirectory instead of RemoteDirectory (opensearc… 

    …h-project#4240)

* Use RemoteSegmentStoreDirectory instead of RemoteDirectory

Signed-off-by: Sachin Kale <[email protected]>
    @sachinpkale
    sachinpkale authored and Sachin Kale committed Sep 2, 2022
    Configuration menu
    Copy the full SHA
    e5cb89f View commit details
    Browse the repository at this point in the history