Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Together.AI provider #78

Closed
HavenDV opened this issue Nov 23, 2023 · 1 comment · Fixed by #194
Closed

Together.AI provider #78

HavenDV opened this issue Nov 23, 2023 · 1 comment · Fixed by #194
Assignees
Labels
enhancement New feature or request good first issue Good for newcomers

Comments

@HavenDV
Copy link
Contributor

HavenDV commented Nov 23, 2023

Project: LangChain.Providers.Together

  • Since Together supports the official OpenAI interface, implementation is very simple using the OpenAI provider. See link for Anyscale
  • You can use GPT-4 for initial implementation
  • Tests are encouraged but not required. It's better to do something minimal than nothing.

References:

Now usage looks like:

var provider = new OpenAiProvider(
      apiKey: Environment.GetEnvironmentVariable("TOGETHER_API_KEY") ??
      throw new InconclusiveException("TOGETHER_API_KEY is not set"),
      customEndpoint: "api.together.xyz");
var llm = new OpenAiChatModel(provider, id: "meta-llama/Llama-2-70b-chat-hf");
var embeddings = new OpenAiEmbeddingModel(provider, id: "togethercomputer/m2-bert-80M-2k-retrieval");
@HavenDV HavenDV added enhancement New feature or request good first issue Good for newcomers labels Nov 23, 2023
@HavenDV HavenDV pinned this issue Apr 5, 2024
@HavenDV
Copy link
Contributor Author

HavenDV commented Apr 6, 2024

Closed in #194

@HavenDV HavenDV closed this as completed Apr 6, 2024
@HavenDV HavenDV linked a pull request Apr 6, 2024 that will close this issue
@HavenDV HavenDV unpinned this issue Apr 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request good first issue Good for newcomers
Projects
Status: Done
Development

Successfully merging a pull request may close this issue.

2 participants