minus-squaregens@programming.devtoTechnology@lemmy.world•DeepSeek ditches Nvidia for Huawei chips in V4 launchlinkfedilinkEnglisharrow-up1·2 days agoLLMs are limited by memory bandwidth much more then calculating power. You need HBM. Dedicated accelerators only lower power usage. linkfedilink
LLMs are limited by memory bandwidth much more then calculating power. You need HBM. Dedicated accelerators only lower power usage.