Gptshop.ai, a computer company, has announced the sale of home PCs powered by the NVIDIA GH200 chip, a graphics chip commonly used in server systems. The company’s founder found that the NVIDIA RTX 4090 chip, which is typically used by regular users, was insufficient for running new AI models.
The GH200 chip comes with LPDDR5X RAM, with a starting capacity of 480GB, and the H100 graphics chip with 96GB of HBM3 RAM. This brings the total RAM for the base model to 576GB. The starting price for this model is set at 47,500 euros or 1.85 million baht. This is sufficient for running Meta’s Llama 2 70B model in a quantized format (FP8). If you choose the graphics RAM option of 144GB, it can also run in FP16 format. Alternatively, configuring the system to use CPU RAM will allow for running larger models, though at a slower pace.
One of the challenges in building PCs with the GH200 chip is the heat dissipation, as server systems typically prioritize rapid heat dissipation in the order of watts, disregarding noise. However, gptstore.ai has designed a new system that operates quietly enough for home use.
The GH200 chip is not available for individual sale from NVIDIA. The PCs available for purchase are the result of gptstore.ai modifying full-fledged server systems from QCT into home-use machines. Nevertheless, NVIDIA has previously sold the DGX Station, a desktop workstation, with A100 chips. However, it has not yet provided an update to support H100 or GH200 chips.
TLDR: Gptshop.ai is selling home PCs powered by the NVIDIA GH200 chip, which is commonly used in server systems. The base model includes 576GB of RAM and starts at 47,500 euros. The GH200 chip poses challenges in heat dissipation, but gptstore.ai has designed a system suitable for home use. However, the GH200 chip is not available for individual sale from NVIDIA, and the company is yet to update its DGX Station to support H100 or GH200 chips.
Leave a Comment