How to deploy hybrid

Before deploying, review the conceptual guide for the Hybrid deployment option.

Important The Hybrid deployment option requires an Enterprise plan.

Prerequisites

1. Use the LangGraph CLI to test your application locally.
2. Use the LangGraph CLI to build a Docker image (i.e. langgraph build) and push it to a registry your Kubernetes cluster or Amazon ECS cluster has access to.

Kubernetes

Prerequisites

1. KEDA is installed on your cluster.

  helm repo add kedacore https://kedacore.github.io/charts
  helm install keda kedacore/keda --namespace keda --create-namespace

2. A valid Ingress controller is installed on your cluster.
3. You have slack space in your cluster for multiple deployments. Cluster-Autoscaler is recommended to automatically provision new nodes.
4. You will need to enable egress to two control plane URLs. The listener polls these endpoints for deployments:
   • https://api.host.langchain.com
   • https://api.smith.langchain.com

Setup

1. You give us your LangSmith organization ID. We will enable the Self-Hosted Data Plane for your organization.
2. We provide you a Helm chart which you run to setup your Kubernetes cluster. This chart contains a few important components.
   1. langgraph-listener: This is a service that listens to LangChain’s control plane for changes to your deployments and creates/updates downstream CRDs.
   2. LangGraphPlatform CRD: A CRD for LangGraph Platform deployments. This contains the spec for managing an instance of a LangGraph Platform deployment.
   3. langgraph-platform-operator: This operator handles changes to your LangGraph Platform CRDs.
3. Configure your langgraph-dataplane-values.yaml file.

  config:
    langsmithApiKey: "" # API Key of your Workspace
    langsmithWorkspaceId: "" # Workspace ID
    hostBackendUrl: "https://api.host.langchain.com" # Only override this if on EU
    smithBackendUrl: "https://api.smith.langchain.com" # Only override this if on EU

4. Deploy langgraph-dataplane Helm chart.

  helm repo add langchain https://github.com/langchain-ai/helm
  helm repo update
  helm upgrade -i langgraph-dataplane langchain/langgraph-dataplane --values langgraph-dataplane-values.yaml --wait --debug

5. If successful, you will see three services start up in your namespace.

  NAME                                            READY   STATUS              RESTARTS   AGE
  langgraph-dataplane-listener-6dd4749445-zjmr4   0/1     ContainerCreating   0          26s
  langgraph-dataplane-operator-6b88879f9b-t76gk   1/1     Running             0          26s
  langgraph-dataplane-redis-0                     1/1     Running             0          25s

6. You create a deployment from the control plane UI.

Amazon ECS

Coming soon!