Self-Managed Hardware Requirements
Lilt can be installed on custom hardware, whether in a private data center or on a variety of cloud platforms. The tables below provide approximate monthly cost estimates for running the base Lilt system in a cloud environment.
Where applicable, long-term pricing discounts for cloud vendors is considered. However, resources (especially storage) may need to be increased to suit your needs. These costs are not a guarantee, rather a reflection of the cloud platform vendor's prices at the time of lookup.
Network, bandwidth, security group, permission management, and other platform costs are not considered in the attached estimate.
Are you interested in installing Lilt's self-managed solution? Contact Sales from the Lilt homepage!
Last Revised: 10 July 2023
AWS Commercial | ||||||||
|---|---|---|---|---|---|---|---|---|
Platform | Resource Identifier | Specifications | Quantity | Unit | Unit cost [1] | Cost [1] per month | Cost [2] per month | Notes |
AWS | m5.xlarge | 4vCPU / 16G RAM / 200GB | 1 | Hour | $0.272 | $156.16 | $104.33 | K8s Master |
AWS | r5.16xlarge | 64vCPU / 512G RAM / 500GB | 2 | Hour | $4.192 | $5966.72 | $3788.40 | K8s Nodes |
AWS | g4dn.2xlarge | 1 GPU / 8vCPU / 32G RAM / 100GB | 1 | Hour | $0.832 | $556.96 | $354.02 | K8s GPU with 1 GPU (Fast MT support) |
Total Cost | $5.296 | $6679.84 | $4246.75 | |||||
[1] Price calculated for plan: "On-Demand Instances"
[2] Price calculated for plan: "EC2 Instance Savings Plans" (1 year)
Source: https://calculator.aws/#/estimate?id=9f813c691401f6764d8ce1110359e52f08aaf827
For V2 model GPU requirements, visit v2 language models
Last Revised: 10 July 2023
Microsoft Azure | ||||||||
|---|---|---|---|---|---|---|---|---|
Platform | Resource Identifier | Specifications | Quantity | Unit | Unit cost [1] | Cost [1] per month | Cost [2] per month | Notes |
Azure | CentOS D3 v2 | 4vCPU / 14G RAM / 128GiB | 1 | Hour | $0.293 | $219.78 | $96.06 | K8s Master |
Azure | CentOS E64as v5 | 64vCPU / 512G RAM / 512GiB | 2 | Hour | $4.266 | $5322.88 | $3158.36 | K8s Nodes |
Azure | NC8as T4 | 1 GPU / 8vCPU / 56G RAM / 128GiB | 1 | Hour | $0.752 | $554.85 | $328.64 | K8s GPU with 1 GPU (Fast MT support) |
Total Cost | $5.31 | $6097.51 | $3583.06 | |||||
[1] Price calculated for plan: "Pay as you go"
[2] Price calculated for plan: "1 year reserved (~41% - ~58% discount)"
Source: https://azure.microsoft.com/en-us/pricing/calculator/#virtual-machines1
For V2 model GPU requirements, visit v2 language models