Skip to content

Commit

Permalink
Add score normalization and combination documentation (opensearch-pro…
Browse files Browse the repository at this point in the history
…ject#4985)

* Add search phase results processor

Signed-off-by: Fanit Kolchina <[email protected]>

* Add hybrid query

Signed-off-by: Fanit Kolchina <[email protected]>

* Normalization processor additions

Signed-off-by: Fanit Kolchina <[email protected]>

* Add more details

Signed-off-by: Fanit Kolchina <[email protected]>

* Continue writing

Signed-off-by: Fanit Kolchina <[email protected]>

* Add more query then fetch details and diagram

Signed-off-by: Fanit Kolchina <[email protected]>

* Small rewording

Signed-off-by: Fanit Kolchina <[email protected]>

* Leaner left nav headers

Signed-off-by: Fanit Kolchina <[email protected]>

* Tech review feedback

Signed-off-by: Fanit Kolchina <[email protected]>

* Add semantic search tutorial

Signed-off-by: Fanit Kolchina <[email protected]>

* Reworded prerequisites

Signed-off-by: Fanit Kolchina <[email protected]>

* Removed comma

Signed-off-by: Fanit Kolchina <[email protected]>

* Rewording advanced prerequisites

Signed-off-by: Fanit Kolchina <[email protected]>

* Changed searching for ML model to shorter request

Signed-off-by: Fanit Kolchina <[email protected]>

* Update task type in register model response

Signed-off-by: Fanit Kolchina <[email protected]>

* Changing example

Signed-off-by: Fanit Kolchina <[email protected]>

* Added huggingface prefix to model names

Signed-off-by: Fanit Kolchina <[email protected]>

* Change example responses

Signed-off-by: Fanit Kolchina <[email protected]>

* Added note about huggingface prefix

Signed-off-by: Fanit Kolchina <[email protected]>

* Update _ml-commons-plugin/semantic-search.md

Co-authored-by: Naarcha-AWS <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Implemented doc review comments

Signed-off-by: Fanit Kolchina <[email protected]>

* List weights under parameters

Signed-off-by: Fanit Kolchina <[email protected]>

* Remove one-shard warning for normalization processor

Signed-off-by: Fanit Kolchina <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Implemented editorial comments

Signed-off-by: Fanit Kolchina <[email protected]>

* Change links

Signed-off-by: Fanit Kolchina <[email protected]>

* More editorial feedback

Signed-off-by: Fanit Kolchina <[email protected]>

* Change model-serving framework to ML framework

Signed-off-by: Fanit Kolchina <[email protected]>

* Use get model API to check model status

Signed-off-by: Fanit Kolchina <[email protected]>

* Implemented tech review comments

Signed-off-by: Fanit Kolchina <[email protected]>

* Added neural search description and diagram

Signed-off-by: Fanit Kolchina <[email protected]>

* More editorial comments

Signed-off-by: Fanit Kolchina <[email protected]>

* Add link to profile API

Signed-off-by: Fanit Kolchina <[email protected]>

* Addressed more tech review comments

Signed-off-by: Fanit Kolchina <[email protected]>

* Implemented editorial comments on changes

Signed-off-by: Fanit Kolchina <[email protected]>

---------

Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Co-authored-by: Naarcha-AWS <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
  • Loading branch information
3 people authored and harshavamsi committed Oct 31, 2023
1 parent 79d3950 commit 0edd4ec
Show file tree
Hide file tree
Showing 21 changed files with 1,228 additions and 26 deletions.
18 changes: 17 additions & 1 deletion _ml-commons-plugin/api.md
Original file line number Diff line number Diff line change
Expand Up @@ -518,8 +518,24 @@ The API returns the following:

## Profile

The profile operation returns runtime information on ML tasks and models. The profile operation can help debug issues with models at runtime.
The profile operation returns runtime information about ML tasks and models. The profile operation can help debug model issues at runtime.

### The number of requests returned

By default, the Profile API monitors the last 100 requests. To change the number of monitoring requests, update the following cluster setting:

```json
PUT _cluster/settings
{
"persistent" : {
"plugins.ml_commons.monitoring_request_count" : 1000000
}
}
```

To clear all monitoring requests, set `plugins.ml_commons.monitoring_request_count` to `0`.

### Path and HTTP methods

```json
GET /_plugins/_ml/profile
Expand Down
2 changes: 1 addition & 1 deletion _ml-commons-plugin/cluster-settings.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
layout: default
title: ML Commons cluster settings
has_children: false
nav_order: 160
nav_order: 10
---

# ML Commons cluster settings
Expand Down
2 changes: 1 addition & 1 deletion _ml-commons-plugin/model-access-control.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
layout: default
title: Model access control
has_children: false
nav_order: 180
nav_order: 20
---

# Model access control
Expand Down
22 changes: 11 additions & 11 deletions _ml-commons-plugin/pretrained-models.md

Large diffs are not rendered by default.

Loading

0 comments on commit 0edd4ec

Please sign in to comment.