Settings

Theme

Ask HN: Any tools or frameworks to monitor the usage of OpenAI API keys?

4 points by terrortang 3 years ago · 4 comments · 1 min read


I am currently developing an application using OpenAI, and have created distinct API keys to accommodate varying scenarios. However, I've found that managing the usage of these individual API keys isn't as seamless as I would like. Do you know any tools or frameworks specifically for controlling or monitoring the usage of these different API keys?

hiimsteveee 3 years ago

Maybe try https://github.com/langfuse/langfuse

It was recently shared on HN

  • terrortangOP 3 years ago

    Thanks, will take a look.

    • marcklingen 3 years ago

      Langfuse founder here

      Do the API keys map to end users / customers? If yes reporting via Langfuse (UI & GET API) can solve this.

      If that's not why you use multiple API keys, you can add an api key id/hash (to not store the key in langfuse) as metadata and then group/filter by this metadata field.

      Dm me on Discord[1] if you have more detailed questions.

      [1] https://langfuse.com/discord

0xebo 3 years ago

Langfuse is great ! Also check https://www.nebuly.com/

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection