Ask HN: Any tools or frameworks to monitor the usage of OpenAI API keys?
I am currently developing an application using OpenAI, and have created distinct API keys to accommodate varying scenarios. However, I've found that managing the usage of these individual API keys isn't as seamless as I would like. Do you know any tools or frameworks specifically for controlling or monitoring the usage of these different API keys? Maybe try https://github.com/langfuse/langfuse It was recently shared on HN Thanks, will take a look. Langfuse founder here Do the API keys map to end users / customers? If yes reporting via Langfuse (UI & GET API) can solve this. If that's not why you use multiple API keys, you can add an api key id/hash (to not store the key in langfuse) as metadata and then group/filter by this metadata field. Dm me on Discord[1] if you have more detailed questions. Langfuse is great ! Also check https://www.nebuly.com/