minus-squareblarg_dunsen@sh.itjust.workstoSelfhosted@lemmy.world•How my AI Agent views and maintains "our" homelablinkfedilinkEnglisharrow-up4·2 months agoHow are you running a 34B model without a GPU? You must be getting one token an hour! How much RAM do you have in the LLM box? linkfedilink
How are you running a 34B model without a GPU? You must be getting one token an hour! How much RAM do you have in the LLM box?