How to Install Three RTX 3090s? A Local AI Enthusiast's Hardware Dilemma

When AI Enthusiasm Meets Hardware Reality

A local AI enthusiast on Reddit recently shared his "sweet trouble": he snagged two RTX 3090 Founders Edition cards on Facebook Marketplace for 1700 euros, and combined with the one he already owned, he now has three 3090 FEs totaling 72GB of GDDR6X VRAM. The problem is that his case barely fits even one card—he had to forcibly bend the internal metal bracket with pliers to get it in—and the motherboard is just a standard B760. Three triple-slot-thick GPUs clearly cannot be installed in this machine simultaneously.

The choice this enthusiast faces is quite representative: build an open-air mining rig with PCIe 4.0 risers and dual power supplies? Or switch to a massive full-tower case? Or simply sell the third card (listed at 1100 euros), keep 48GB of VRAM, and use the money to upgrade to a dual-GPU configuration? He is also seeking recommendations for cases or rigs that can handle over 1100W of power draw, as well as power supply suggestions.

The Allure and Challenges of Three 3090s

VRAM Is King, but Physical Limits Are Ruthless

For enthusiasts running large language models (LLMs) locally, VRAM capacity is often the decisive factor. The 72GB of GDDR6X VRAM provided by three RTX 3090s is enough to let users run larger-parameter models on consumer hardware, or load multiple models simultaneously for experimentation. This is why this enthusiast is reluctant to give up any card despite the installation challenges.

However, the RTX 3090 FE is a triple-slot behemoth with substantial power consumption. Running three cards in parallel means needing sufficient physical space, strong cooling capability, and abundant power supply. A standard B760 motherboard typically has only one PCIe x16 slot that provides full-speed bandwidth; the remaining slots are either x4 or share bandwidth, which also affects the efficiency of multi-GPU parallelism.

GDDR6X is a VRAM standard developed by Micron that uses PAM4 signal encoding on top of GDDR6, doubling the per-pin data transfer rate, which is why the RTX 3090 can achieve 936 GB/s of bandwidth at a 384-bit bus width. For local LLM inference, VRAM bandwidth is often more critical than raw compute—generating each token requires reading model weights from VRAM into the compute units, and insufficient bandwidth directly slows token generation speed. This is also why the 3090 remains popular among local AI enthusiasts on the secondhand market: its bandwidth far exceeds mid-range cards of the same generation, and the 24GB single-card capacity is enough to hold larger quantized models. However, GDDR6X has significantly higher power consumption and heat output than GDDR6, and when stacking three cards, the cooling pressure on the VRAM area also needs to be factored into case airflow design.

Community Experience: Mining Rigs and Dual Power Supply Solutions

In communities like r/LocalLLaMA, using an open-air mining rig with PCIe risers is a common choice for multi-GPU enthusiasts. This approach is relatively low-cost, offers ample cooling space, and is not constrained by case dimensions. However, extra attention must be paid to riser quality—PCIe 4.0 signals have high requirements for cabling, and poor-quality risers can cause stability issues.

Regarding power, the peak power consumption of three 3090s may exceed 1100W, which is difficult for an ordinary single PSU to support stably. Dual power supply solutions (via a dual PSU sync cable or manual shorting to start) have become the choice of many enthusiasts. But this also brings wiring and safety challenges.

PCIe risers are not simple copper wire adapters; they need to re-drive high-speed differential signals. PCIe 4.0 has a per-lane rate of 16 GT/s and is extremely sensitive to insertion loss, crosstalk, and impedance control. Cables longer than 30 cm or with poor shielding can easily cause link downgrades or even training interruptions. When purchasing, look for products explicitly labeled with PCIe 4.0 certification, with independent power and redriver/retimer chips; if the budget is limited, you can also force the motherboard slot to PCIe 3.0 in exchange for stability, at the cost of halved bandwidth. Additionally, riser routing should be kept away from power cables and fans to avoid electromagnetic interference, and when securing them on a mining rig, prevent connectors from being stressed loose.

A dual PSU sync cable works by connecting the PS_ON signal (green wire) and ground wire from the primary PSU in parallel to the corresponding pins of the second PSU, so both receive the power-on command simultaneously. A safer approach is to use a dedicated sync cable or Add2PSU module to avoid the risk of accidental contact from manual shorting. It is particularly important to note that the +12V outputs of the two PSUs should not be directly paralleled; instead, loads should be divided—for example, one PSU dedicated to the motherboard and one GPU, and the other to the remaining two GPUs, preventing circulating currents caused by slight output voltage differences. Furthermore, under a dual PSU setup, all devices must share a common ground point; otherwise, a ground loop may form through data cables, causing instability or even hardware damage.

Selling the Third Card: The Pragmatic Choice?

The third option mentioned by this enthusiast—selling the third 3090 for 1100 euros, keeping 48GB of VRAM, and using the money to invest in a more sensible dual-GPU platform—received considerable support in the community. A dual-3090 configuration is easier to handle in terms of power consumption, cooling, and motherboard compatibility, and 48GB of VRAM is already quite ample for most local LLM tasks. Moreover, selling one card recovers funds that can be used to upgrade supporting equipment such as the PSU, case, or risers, resulting in a more stable overall experience.

When running LLMs in parallel across multiple GPUs, the model does not automatically gain linear speedup. With tensor parallelism, intra-layer matrices are split across GPUs, and frequent synchronization of activations between cards occurs, making PCIe bandwidth and latency bottlenecks; with pipeline parallelism, there are pipeline bubbles, and utilization depends on the number of micro-batches. For consumer-grade motherboards like the B760, slots other than the primary one typically go through the chipset with limited bandwidth, so the actual throughput gain from three-GPU parallelism may be far lower than the proportional increase in VRAM capacity. In contrast, dual GPUs bridged via NVLink (supported by the 3090) can achieve higher interconnect bandwidth, often providing a more balanced setup than a three-GPU PCIe configuration for quantized inference of 70B-class models. Therefore, when evaluating multi-GPU benefits, don't just look at total VRAM—also consider how well the interconnect topology matches the parallelization strategy.

Practical Advice for Multi-GPU Enthusiasts

If you face a similar choice, consider the following angles:

• Clarify your needs: What scale of models do you mainly run? Is 48GB of VRAM already sufficient? If so, a dual-GPU configuration is less of a headache.
• Evaluate your existing platform: Motherboard PCIe lane count, case space, and PSU wattage are hard constraints. Forcing three cards in may require replacing most of the platform.
• Cooling and noise: Three 3090s on an open-air mining rig cool well, but noise and dust accumulation cannot be ignored; a full-tower case is quieter but requires strong airflow design.
• Electrical safety: Sustained loads over 1000W test both the circuit and the PSU; be sure to use reliable-quality power supplies and ensure your home wiring can handle it.

Conclusion

Hardware tinkering for local AI is itself part of the fun, but rationally assessing needs and costs is equally important. The allure of three 3090s is strong, but a dual-GPU setup may get this enthusiast back to the joy of model debugging faster, rather than sinking into installation quagmire. Whichever path is chosen, community experience sharing is a valuable reference—after all, every multi-GPU enthusiast was once that beginner bending a case with pliers.