You’d have to start soldering the HBM and the GPU chips off the boards they’re on. Those aren’t PCI-E boards much of the time. Also, they don’t have display outputs.
I’d absolutely buy one of those servers to run open-weight models locally, but let’s not kid ourselves here: We’re talking about an ungodly amount of power for a single machine, think it was a few megawatts for a rack, or at least hundreds of kilowatts. A single server luckily should still be in two digit kilowatts. Could realistically only use it in the winter though.
No it isn’t. 0h come on. Yeah thy couldn’t possibly take the same or similar hardware components and make them work in PCs.
They are already putting NPUs in PCs.
You’d have to start soldering the HBM and the GPU chips off the boards they’re on. Those aren’t PCI-E boards much of the time. Also, they don’t have display outputs.
I’d absolutely buy one of those servers to run open-weight models locally, but let’s not kid ourselves here: We’re talking about an ungodly amount of power for a single machine, think it was a few megawatts for a rack, or at least hundreds of kilowatts. A single server luckily should still be in two digit kilowatts. Could realistically only use it in the winter though.