Inferentia2 vs Vera Rubin

Inferentia2Vera Rubin
VendorAWSNVIDIA
ArchitectureCustomRubin
BF16 TFLOPS19035,000 ✓
Memory (GB)32288 ✓
Bandwidth (GB/s)82022,000 ✓
TDP (W)200 ✓1,400
Cloud $/hr$0.55—
TFLOPS / W0.925.0 ✓

FAQ

Inferentia2 vs Vera Rubin: which is faster?

Vera Rubin has higher BF16 throughput (190 vs 35,000 TFLOPS).

Which has more memory?

Vera Rubin carries more on-package memory (32 GB vs 288 GB).

Which is cheaper to rent?

Cloud rates aren't listed for both chips — see each chip's page.

Cost either chip in a fleet

Size a deployment or see the full priced rack BOM these accelerators sit in.

Specs + modeled rates maintained by Mintok's catalog watchers from public sources. Not investment advice. Methodology.