Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feature: local llm support #16

Merged
merged 20 commits into from
Oct 9, 2023
Merged

feature: local llm support #16

merged 20 commits into from
Oct 9, 2023

Commits on Oct 2, 2023

  1. refactor: creating an LLM module in libmemex and moving embedding mod… 

    …ule inside
    @a5huynh
    a5huynh committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    f75a11e View commit details
    Browse the repository at this point in the history

  2. adding a basic run prompt function for llm testing inside memex

    @a5huynh
    a5huynh committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    86b9a7c View commit details
    Browse the repository at this point in the history

  3. wip: sherpa - guiding llms using logit biasing, templates, etc.

    @a5huynh
    a5huynh committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    14baa52 View commit details
    Browse the repository at this point in the history

  4. wip: tweaking sampler to output only what we want

    @a5huynh
    a5huynh committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    ce15cd4 View commit details
    Browse the repository at this point in the history

Commits on Oct 3, 2023

  1. Merge branch 'main' into feature/embedded-llm-support

    @a5huynh
    a5huynh committed Oct 3, 2023
    Configuration menu
    Copy the full SHA
    dc05694 View commit details
    Browse the repository at this point in the history

Commits on Oct 4, 2023

  1. Merge branch 'main' into feature/embedded-llm-support

    @a5huynh
    a5huynh committed Oct 4, 2023
    Configuration menu
    Copy the full SHA
    0bfc014 View commit details
    Browse the repository at this point in the history

  2. updating .env.template file

    @a5huynh
    a5huynh committed Oct 4, 2023
    Configuration menu
    Copy the full SHA
    224538a View commit details
    Browse the repository at this point in the history

Commits on Oct 5, 2023

  1. removing sherpa stuff for now

    @a5huynh
    a5huynh committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    d6f6d65 View commit details
    Browse the repository at this point in the history

  2. Creating LLM trait and sharing structs between local LLM & OpenAI impls

    @a5huynh
    a5huynh committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    066baf3 View commit details
    Browse the repository at this point in the history

  3. Using LLM trait in API to switch between local/OpenAI when configured

    @a5huynh
    a5huynh committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    33fe800 View commit details
    Browse the repository at this point in the history

Commits on Oct 6, 2023

  1. load llm client based on whether OPENAI_API_KEY or LOCAL_LLM_CONFIG 

    is set
    @a5huynh
    a5huynh committed Oct 6, 2023
    Configuration menu
    Copy the full SHA
    ec244d9 View commit details
    Browse the repository at this point in the history

  2. update README to point that out

    @a5huynh
    a5huynh committed Oct 6, 2023
    Configuration menu
    Copy the full SHA
    3910cf1 View commit details
    Browse the repository at this point in the history

  3. Create samplers from config and pass into LocalLLM struct

    @a5huynh
    a5huynh committed Oct 6, 2023
    Configuration menu
    Copy the full SHA
    6819059 View commit details
    Browse the repository at this point in the history

  4. add basic support for other architectures, but focus on llama for now

    @a5huynh
    a5huynh committed Oct 6, 2023
    Configuration menu
    Copy the full SHA
    b1d4848 View commit details
    Browse the repository at this point in the history

  5. add LLM ask example to README

    @a5huynh
    a5huynh committed Oct 6, 2023
    Configuration menu
    Copy the full SHA
    96130d1 View commit details
    Browse the repository at this point in the history

Commits on Oct 9, 2023

  1. output debug messages for local llm responses

    @a5huynh
    a5huynh committed Oct 9, 2023
    Configuration menu
    Copy the full SHA
    a1e7c6c View commit details
    Browse the repository at this point in the history

  2. correctly capture server errors & send back the error messages

    @a5huynh
    a5huynh committed Oct 9, 2023
    Configuration menu
    Copy the full SHA
    e368e87 View commit details
    Browse the repository at this point in the history

  3. removing old dep

    @a5huynh
    a5huynh committed Oct 9, 2023
    Configuration menu
    Copy the full SHA
    3af2396 View commit details
    Browse the repository at this point in the history

  4. ignore model test

    @a5huynh
    a5huynh committed Oct 9, 2023
    Configuration menu
    Copy the full SHA
    d07b219 View commit details
    Browse the repository at this point in the history

  5. cargo fmt

    @a5huynh
    a5huynh committed Oct 9, 2023
    Configuration menu
    Copy the full SHA
    13e2bb0 View commit details
    Browse the repository at this point in the history