Where does a 70B model actually fit? Dual RTX 3090 vs DGX Spark 64GB vs 128GB
70B dense models are the point where a single consumer GPU stops being enough. Here is what the memory math says for the three setups people usually compare. The baseline: Llama 3.3 70B at Q4_K_M Abou