> ## Documentation Index
> Fetch the complete documentation index at: https://support.lilt.com/llms.txt
> Use this file to discover all available pages before exploring further.

# System Architecture

## Overview

This article details the LILT System Architecture, including LILT-managed components, integrations, and customer-managed services. LILT supports three deployment models: GCP-hosted (multi-region), self-managed on AWS, and self-managed on bare metal infrastructure.

## Architecture Overview

<Frame>
  <img src="https://mintcdn.com/lilt-db26f913/KxQB3_Ey1ahDkiRO/images/03060de6-Lilt20Architecture20Overview.jpg?fit=max&auto=format&n=KxQB3_Ey1ahDkiRO&q=85&s=ceada0b73ebf50d444389bc1f7dbe140" alt="Lilt Architecture Overview" width="2500" height="2000" data-path="images/03060de6-Lilt20Architecture20Overview.jpg" />
</Frame>

## Architecture Diagrams

### GCP Hosted Architecture

The GCP-hosted deployment runs across US, Asia, and Europe regions with Google-managed services for data storage and analytics.

<Frame>
  <img src="https://mintcdn.com/lilt-db26f913/jF5bULP2s4jo04qM/images/architecture/gcp-hosted-architecture.svg?fit=max&auto=format&n=jF5bULP2s4jo04qM&q=85&s=c7105c345e0dce1b5c2fec202c48126d" alt="LILT GCP Hosted Architecture" width="1310" height="630" data-path="images/architecture/gcp-hosted-architecture.svg" />
</Frame>

**Key characteristics:**

* **Multi-region:** Cloud Load Balancing, GKE, Front App, and Redis are deployed across US, Asia, and Europe
* **US-only services:** Core Services, Neural Services, Connectors, Elasticsearch, Cloud SQL, Cloud Storage, BigQuery, GPU Pool
* **GCP managed services:** Pub/Sub, Cloud SQL (MySQL), Cloud Storage, BigQuery, Salesforce (CRM integration)
* **Cluster services:** Redis (caching), ClickHouse (analytics), Dataflow
* **Analytics pipeline:** Dataflow connects Core Services to ClickHouse; Cloud SQL feeds BigQuery via Scheduler; Salesforce data flows into BigQuery

### Self-Managed AWS Architecture

For customers deploying on AWS infrastructure with AWS-managed data services.

<Frame>
  <img src="https://mintcdn.com/lilt-db26f913/jF5bULP2s4jo04qM/images/architecture/aws-self-managed-architecture.svg?fit=max&auto=format&n=jF5bULP2s4jo04qM&q=85&s=6771be3bbc85abcfb2f8172834ed56d8" alt="LILT Self-Managed AWS Architecture" width="1095" height="620" data-path="images/architecture/aws-self-managed-architecture.svg" />
</Frame>

**Key characteristics:**

* **AWS managed services:** RDS (MySQL), S3, SQS
* **Cluster services:** Redis, ClickHouse, MongoDB, Dataflow
* **Additional components:** Dataflow connects Core Services to ClickHouse; SQS provides message queuing
* **Neural services** include LLM inference workloads (VLLM-based: Emma, Gemma, LLaMA) alongside traditional translation services

### Self-Managed Bare Metal Architecture

For air-gapped or on-premises deployments where all services run within a single Kubernetes cluster.

<Frame>
  <img src="https://mintcdn.com/lilt-db26f913/jF5bULP2s4jo04qM/images/architecture/bare-metal-architecture.svg?fit=max&auto=format&n=jF5bULP2s4jo04qM&q=85&s=22d42e86f8a3f88945be265dcbb3af00" alt="LILT Self-Managed Bare Metal Architecture" width="1160" height="580" data-path="images/architecture/bare-metal-architecture.svg" />
</Frame>

**Key characteristics:**

* **All services self-hosted:** MySQL, MinIO (object storage), Redis, MongoDB, ClickHouse, Elasticsearch
* **Additional components:** Dataflow connects Core Services to ClickHouse
* **Single Kubernetes cluster** with client load balancer and ingress
* **No external cloud dependencies** — suitable for air-gapped environments

## LILT-Managed Components

This section details the components managed by LILT. The LILT-managed components include all Application services, the Neural services performing translations, and the Core services responsible for the backend functionalities such as file import/export, audit logs, search and more. All components are integrated with RabbitMQ to communicate via message sharing.

### Neural services

LILT's neural services include all of the components that perform language detection and machine translations. The neural services are responsible for detecting languages, performing interactive and batch translations, and memory management.

### Front services

LILT's front services include the user-facing applications. Information and actions performed in the front services are transferred to the core and neural via RabbitMQ.

### Core services

LILT's core services handle everything outside of translation and language detection. This includes audit file handling, logging, tagging, QA, assignments and more. The core services act as the central management hub for LILT, passing information to the front containers and submitting work for the neural containers.

## Self-Managed Components

### Data Storage and Microservices

All data storage and microservices are managed by the customer in the self-managed implementation.

### Infrastructure services

For self-managed installation of LILT, the applications below are also installed to enable LILT to function:

* [MinIO](https://min.io/): Object Storage Server

* [OpenEBS](https://openebs.io/): Local Persistent Volume Provisioner

* [MySQL](https://www.mysql.com/): Database

* [Redis](https://redis.io/): Data Structure Caching

* [RabbitMQ](https://www.rabbitmq.com/): Queue Management

* [Nginx-ingress](https://kubernetes.github.io/ingress-nginx/): Ingress controller

* [ElasticSearch](https://www.elastic.co/): Indexing

* [ClickHouse](https://clickhouse.com/): Analytics Database

* [MongoDB](https://www.mongodb.com/): Auditlogs database

* [Nvidia-device-plugin](https://github.com/NVIDIA/k8s-device-plugin): GPU management in Kubernetes