LMCache Storage ROI Calculator

Fill the Data

RAM Space (Tier1) (GB)

Disk or Shared Storage Space (Tier2) (GB)

Model Type

GPU TCO Cost ($)

per hour:

or over 3 years:

TCO of 1 GB for tier 1 storage ($)

per hour

or over 3 years

TCO of 1 TB for tier 2 storage ($)

per hour

or over 3 years

% of Reuses/Hours to Break Even:

0.00%

Cost Savings ($/3y)

% Cache Hits

KV Cache Size

—

Tokens/sec/GPU

—

Prefill vs Cache Speed Ratio

—

Additional Storage Cost/Hour

—

Additional Storage Cost/3y

—

Number of Tokens cached

—

GPU Hours to Prefill

—

GPU Cost to Prefill

—

GPU Cost with Cache

—