Prosumer rack
Prosumer Mini Rack
Two GPUs, ECC memory and real storage in a small 4U rack. For the advanced individual or indie hacker.
VRAM per dollarstoragequiet-ish rack
updated 16 Sept 2026Total price
$6,549
VRAM
48 GB
RAM
256 GB
Storage
4 TB
Est. power draw
1254 W
AI capability
Roughly ~20B params in fp16, ~40B in 8-bit, or ~73B in 4-bit quantization.
small-model inferencemid-size inferencelocal RAGlarge-model inferenceLoRA fine-tuning
Components
- GPU2× NVIDIA GeForce RTX 3090memory: 24 GB GDDR6X · bandwidth: 936 GB/s · interface: PCIe 4.0 x16$1,700Check price ↗
- CPUAMD Ryzen Threadripper 7960Xcores: 24 · threads: 48 · clock: 5.3 GHz boost$1,399Check price ↗
- MotherboardASUS Pro WS TRX50-SAGE WIFI (sTR5)chipset: TRX50 · memory: 4 x DDR5 RDIMM ECC, quad-channel · pcie: 4 x PCIe 5.0 x16$700Check price ↗
- RAMMicron 256 GB (8x32) DDR5-4800 ECC RDIMMcapacity: 256 GB (8 x 32) · type: DDR5-4800 RDIMM · ecc: ECC$1,050Check price ↗
- StorageWD Black SN850X 4 TB NVMecapacity: 4 TB · bus: PCIe 4.0 NVMe · read: 7300 MB/s$260Check price ↗
- PSUSuper Flower Leadex Titanium 1600 W 80+ Titaniumcapacity: 1600 W · rating: 80+ Titanium · standard: ATX 3.1$450Check price ↗
- CoolingArctic Liquid Freezer III 360 (AIO)type: liquid AIO 360 mm · dissipation: up to 350 W · noise: 22-33 dBA$110Check price ↗
- NetworkingIntel X710 10GbE SFP+ dual-port NICspeed: 10 GbE · ports: 2 (SFP+) · bus: PCIe 3.0 x8$180Check price ↗
- UPSAPC Back-UPS Pro 1500 (line-interactive)capacity: 1500 VA / 900 W · topology: line-interactive · runtime: ~8 min at 50 % load$300Check price ↗
- ChassisSilverStone RM44 4U rackmount (4 dual-slot GPU)form factor: 4U rack · gpu slots: 4 dual-slot · drive bays: 8 x 3.5 + 2 x 2.5$400Check price ↗
Component prices are hand-sourced and dated (checked 2026-09-16), not scraped. Confirm on the vendor's site before buying.
Why this build
- · Two used RTX 3090s give 48 GB of VRAM for under $1,800 - still the best VRAM-per-dollar for a home rack, and they NVLink in a pair.
- · Threadripper 7960X brings 92 PCIe 5.0 lanes: both cards run at full x16, with lanes to spare for NVMe and networking.
- · 256 GB of registered ECC memory is the point where CPU offload and light fine-tuning stop being a compromise.
- · A 4U rack chassis and 10 GbE make this the first build you can grow - add cards, add storage, put it on a shelf.
- · A 1500 VA UPS covers a brownout and a clean shutdown; it is optional if your power is stable.
Pros
- + 48 GB VRAM at the lowest possible cost
- + Full x16 to both GPUs, ECC memory
- + Grows into the small-business build without a rebuild
Limits
- − Used cards: shorter remaining warranty, higher idle power than Ada
- − Ampere generation - slower than a 4090/5090 per card
- − 4U rack fans are audible; not a bedroom build
Alternatives
Cheaper
AM5 + 128 GB non-ECC drops ~$1,500 if you do not need ECC or 4 full slots.
Balanced
Two RTX 4090s: same 48 GB, much faster, ~$2,000 more and +200 W.
Buy vs rent vs hybrid
Over 36 months, at this build's power draw and the live cloud rate for its GPU.
Own it
- Hardware
- $6,549
- Electricity
- $2,719
- Total cost of ownership
- $9,268
Rent it (cloud)
- Equivalent cloud, monthly
- $402/mo
- Equivalent cloud, total
- $14,454
- Break-even
- 20 months
- · Break-even is 20 months, comfortably inside the horizon at this utilization - buying wins.
- · Over 36 months, owning saves roughly $5186 versus the cloud equivalent.
"Buy on Amazon" links are affiliate links - as an Amazon Associate, Obolith earns from qualifying purchases.