Python Client

TypeScript Client

Cookbooks

Literal AI Documentation

Dashboard

Other LLM Providers (Anthropic, etc.)

Literal AI is the collaborative platform for building **production-grade LLM apps**.

Overview

Install the Literal AI client and get your API key

Quick Start

Logs are essential to monitor and improve your LLM app in production. Literal AI provides a flexible and composable SDK to log your LLM app at different levels of granularity.

Logs

The playground is an environment in which you can create, test, and debug prompts and multiple LLMs.

Playground

Prompt Management enables collaboration between engineering and product teams to create, version, A/B test, debug, and monitor prompts directly from Literal AI.

Prompt Management

Rules are used to automate actions on Literal AI based on specific conditions. Automated actions can range from evaluating an LLM generation to adding items in a dataset.

Evaluation

Datasets are a collection of input/expected output samples for conducting experiments and non regression tests.

Datasets

Experiments enable continous improvement of your prompt/agent and guarantee that newer versions perform better than previous ones.

Experiments

Annotation Queues help you organise and streamline the human evaluation process. You can easily set-up queues, add data for review and provide an accessible and efficient ui for domain experts to score, tag and add to datasets crucial insights.

Annotation Queues

Learn how to effectively monitor your AI application for performance and reliability

Monitoring

Improve your LLM applications over time with continuous improvement.

Get Started

Guides

Integrations

Self Hosting

More

Other LLM Providers (Anthropic, etc.)