Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve image search UX #431

Open
ohltyler opened this issue Oct 17, 2024 · 0 comments
Open

Improve image search UX #431

ohltyler opened this issue Oct 17, 2024 · 0 comments
Labels
feature A new feature for the plugin v2.19.0

Comments

@ohltyler
Copy link
Member

Images must be in binary or base64-encoded formats to be understood by popular MM embedding models. As such, we should add helper UI around producing such formats, based on raw images users can drag into the UI. And/or, provide a URL to some image.

The rough flow can be:

  1. Users opens a portal for selecting an image from local filesystem, dragging directly, or providing a url
  2. User selects what format they want to convert it to (can be auto-populated based on the associated model, ideally)
  3. UI handles conversion and injecting into the sample document (if ingest) or query (if search)

Furthermore, URL support is targeted to be an optional input by 2.19 - see opensearch-project/ml-commons#3054. As such, we can add URL with no further conversion as an option once that is available.

@ohltyler ohltyler added feature A new feature for the plugin v2.19.0 labels Oct 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature A new feature for the plugin v2.19.0
Projects
None yet
Development

No branches or pull requests

1 participant