Self-hosting the Literal AI platform is available as part of our enterprise offering. With this option, you will deploy the Docker image on your own infrastructure. The Docker image is available on a private registry, and you will need to contact us to discuss enterprise licensing and get access to the registry.

If you are looking to try out the platform, you can use the cloud hosted version for free!

​
Deploying the Image

You have several options for hosting the platform:

Azure

Deploy the Literal AI platform on Azure in a few minutes with the Azure Developer CLI.

AWS

Deploy the Literal AI platform on AWS in a few minutes with the CDK.

Google Cloud

Coming soon.

Manual Deployment

Deploy the Literal AI platform anywhere. You will have to provision the infrastructure and deploy the Docker image.

​
Update the SDKs

By default, the Literal AI SDKs point to the cloud hosted version of the platform. To point the SDKs to your self-hosted platform you will have to update the url parameter in the SDK instantiation:

from literalai.client import LiteralClient

MY_LITERAL_API_URL = "http://localhost:3000"

literalai_client = LiteralClient(api_key="YOUR_API_KEY", url=MY_LITERAL_API_URL)

​
Update Chainlit

If you are using Chainlit, you will need to update the LITERAL_API_URL environment variable to point to your self-hosted platform.

Was this page helpful?

Suggest editsRaise issue