OpenCost Plugin for OpenAI usage data

[lmello]

Is your feature request related to a problem? Please describe.
no.

Describe the solution you'd like
Integrate the openai usage data and costs with opencost.

Describe alternatives you've considered
NA

Additional context

[dwbrown2]

Thanks for creating this FR, I've talked with 2-3 teams that have requested this recently. Any interest in working on this? Last I heard OpenAI has billing usage APIs but they are undocumented.

cc @kwombach12 who I believe is also interested in this!

[kwombach12]

We would love to collaborate with you on this @lmello! If you're interested, here is a blog post on how to get started.

PS: We are offering $1,000 for accepted plug-in contributions as we start to build out our library!

[lmello]

I am working to build an OpenAI usage dashboard in zendesk to track our usage, currently their usage api is undocumented and broken (v1/usage). I talked with the TAM assigned to us and they plan to fix it and release a working api but I didn’t got any dates yet.

The work around I did was using the export api from the usage dashboard , but those api’s only work with a session credential instead of an api key.

I don’t know if we would want to build this integration using a session credential provided this would require us to update the credential every two weeks.

[lmello]

The current usage api returns the usage models, metrics for the model and this can be used to calculate the cost, but it does not return the api key or user id which are essential to display usage and cost per user.

We might be able to use it to display cost and usage per model until they fix the v1/usage api.

[kwombach12]

@lmello interesting! I think it would be worth looking at the cost/usage per model until they fix that API. Is that something you'd be interested in working on with us?

[lmello]

@kwombach12 discussed it with @ameijer and we will have a meeting next week to start this work.
I already shared some details about the api with him in slack.

[kwombach12]

@lmello That's awesome! Please let me know if I can be of any help testing, identifying scope, or providing feedback. Super excited to work with you on this!

[lmello]

@kwombach12 I am working on it with @ameijer .

[ameijer]

basic implementation undergoing review here: #38