AI & LLM Training Cost Calculator
Enter a model size, a dataset size, and the GPU you want. Get the total compute, the wall-clock time, and the GPU training cost on Spheron, with live pricing benchmarked against AWS and GCP. Works for pretraining a model from scratch or fine-tuning an LLM with LoRA.
Inputs
Modeling assumptions
Details →Cost on Spheron
This run takes over a year. Consider more GPUs or a smaller model.
Cost breakdown
| Plan | Est. cost |
|---|---|
| Spheron on-demand | $743,769 |
| Spheron reserved (35% off) | $483,450 |
| AWS on-demand | $1.44M |
| Google Cloud on-demand | $1.11M |
| Azure on-demand | $2.59M |
You save $700,676 versus AWS (49%).
Estimates use 8× H100 at $2.01/hr on-demand. AWS and GCP figures are public list prices and exclude reserved discounts, egress, and storage. Math: how this is calculated.
Training cost examples: Llama 3 70B, 405B, and a 7B LoRA
Click any example to load it into the calculator. Numbers are based on published training runs and live Spheron pricing.
How much does it cost to train an LLM?
Training an LLM costs anywhere from under $100 to tens of millions of dollars. Three inputs set the number: the size of the model, the number of tokens you train on, and the per-hour rate of the GPU you run on. The calculator above turns those into a dollar figure for any model. To put the range in context, here is what four common jobs cost on live Spheron H100 pricing.
The jump from fine-tuning to pretraining is why almost no one trains from scratch. Fine-tuning an open model on on-demand H100 access gets you a custom model for a rounding error against a from-scratch run. For a full worked example, see how a small team trained a 70B model for $11,200 on spot GPUs, then price your own job in the calculator above.
How LLM training cost is calculated
Training a model takes a known amount of compute. The standard rule of thumb is 6 × parameters × tokens FLOPs for full training. LoRA fine-tunes use about two-thirds of that: the base weights are frozen, so you skip computing their gradients, but the full forward pass and the activation-gradient backward pass still run.
We take that FLOPs total and divide by your GPU's sustained throughput at the chosen precision. H100 delivers roughly 700 TFLOPs at FP16 and 1400 TFLOPs at FP8 in real training jobs. B200 roughly doubles those numbers.
Then we apply model FLOPs utilization (MFU), the fraction of peak throughput you actually get. Well-tuned dense transformer training on H100 lands around 0.45. The calculator defaults to that and lets you tune it in the advanced panel.
Cost is then wall-clock hours × GPU count × per-GPU rate. Spheron rates come live from the marketplace API. AWS, GCP, and Azure rates are public list prices for the same GPU and exclude reserved discounts, egress, and storage.
Not Sure Which GPU?
Browse the full GPU catalog with live per-hour pricing across H100, H200, B200, B300, A100, L40S, RTX PRO 6000, and more. Per-minute billing, no commitment.
Training cost calculator FAQ
Compute is estimated using the standard rule of 6 × parameters × tokens FLOPs for full training, or about two-thirds of that for LoRA fine-tunes (the frozen base weights skip their gradient step, while the forward and activation-gradient passes still run in full). We divide by your GPU's sustained TFLOPs at the chosen precision, scale by the GPU count, and apply a model FLOPs utilization factor (MFU) to reflect real-world throughput. Cost is then wall-clock hours × GPU count × per-GPU rate.
Within about 20% for most jobs. The math matches published training runs (Llama 3 70B at roughly 6.4M H100-hours, Llama 3 405B at roughly 30M H100-hours) when you use realistic MFU values of 0.4 to 0.55. Real costs vary with checkpoint frequency, data loading, eval passes, and the failure rate of your training stack.
We use each cloud's public on-demand list price for the GPU you picked. That ignores reserved discounts, savings plans, EDP credits, egress, and storage. It also assumes you can get capacity at list price, which is often not true for H100 and B200. The number is directional, not a quote.
On-demand bills per minute with no commitment and a 99.99% SLA. Spot is the same hardware at a discount and can be reclaimed when demand rises, which makes it a fit for fault-tolerant training with checkpointing. Reserved gives you a discount in exchange for a longer commitment and dedicated capacity for multi-week or multi-month runs.
No. The calculator covers GPU compute only. Storage, ingress, and egress are not modeled here. Spheron does not charge egress fees, which is the largest hidden line item on AWS, GCP, and Azure for training workloads.
Model FLOPs utilization is the fraction of a GPU's peak FLOPs you actually use. 0.45 is a reasonable default for dense transformer training on H100 with FlashAttention and FP8. Well-tuned Megatron-LM jobs hit 0.5 to 0.55. MoE models and unoptimized stacks land closer to 0.25 to 0.35.
Yes. Pick LoRA Fine-Tune as the training approach. The calculator scales compute to about two-thirds of a full fine-tune: LoRA freezes the base weights and skips their gradient, but it still runs the full forward and activation-gradient passes, so per-token throughput is close to full fine-tuning rather than 10x faster. LoRA's real wins are memory and the tiny number of trained parameters, not raw FLOPs. QLoRA is similar on the FLOPs side; the memory savings from 4-bit quantization do not change wall-clock time materially.
It depends on whether you pretrain or fine-tune. A full pretrain of a 70B model on 15 trillion tokens runs a few million H100-hours, which lands in the seven-figure range. A supervised fine-tune of the same model is far cheaper: one team completed a full 70B fine-tune for $11,200 using spot H100s. Set 70B as the model size above, then switch between Pretrain and Full Fine-Tune to see both numbers on live pricing.
Fine-tuning is cheaper by orders of magnitude, but mostly because it runs on far fewer tokens, not because each token is cheaper. Pretraining spends compute on every token in a multi-trillion-token corpus, while a fine-tune runs on a small fraction of that. Per token, a LoRA fine-tune still costs about two-thirds of a full fine-tune, since the forward pass and activation gradients run in full. Unless you need a new base model, start from an open-weight checkpoint and fine-tune.