Self-hosting the Literal AI platform is available as part of our enterprise offering. With this option, you will deploy the Docker image on your own infrastructure. The Docker image is available on a private registry, and you will need to contact us to discuss enterprise licensing and get access to the registry.

If you are looking to try out the platform, you can use the cloud hosted version for free!

Deploying the Image

You have several options for hosting the platform:

Update the SDKs

By default, the Literal AI SDKs point to the cloud hosted version of the platform. To point the SDKs to your self-hosted platform you will have to update the url parameter in the SDK instantiation:

from literalai.client import LiteralClient

MY_LITERAL_API_URL = "http://localhost:3000"

literalai_client = LiteralClient(api_key="YOUR_API_KEY", url=MY_LITERAL_API_URL)

Update Chainlit

If you are using Chainlit, you will need to update the LITERAL_API_URL environment variable to point to your self-hosted platform.