You can use the Literal AI platform to instrument OpenAI API calls. This allows you to track and monitor the usage of the OpenAI API in your application and replay them in the Prompt Playground.

The OpenAI instrumentation supports completions, chat completions, and image generation. It handles both regular and streamed responses.

​
Instrumenting OpenAI API calls

​
With Threads and Runs

You can use Threads and Runs on top of the OpenAI API to create structured and organized logs.

​
Adding Tags and Metadata

You can add tags and metadata to the Generations created by the instrumentation.

​
OpenAI Assistants

You can sync your OpenAI Assistant threads with Literal AI in a few lines of code.

Was this page helpful?

Continuous ImprovementLangChain/LangGraph