You must log in or # to comment.
I’ve preferred Chinese alternatives since they became available. Fuck clammy Sam Altman and Wario, and I don’t really give a shit otf the Chinese know I can’t write my own yaml
The tech is legitimately cool, but American AI CEOs are unbearable cunts that only make hype
It’s also actually feasible for an individual person to get hardware to run it, like if you can one day get your hands on a Mac Studio with 512GB of RAM.
From the article.
Apple announced the M5 Ultra Mac Studio on August 26, 2026, with pre-orders open today and shipping on September 22. The headline number for local AI is 512GB of unified memory at 1.2 TB/s of memory bandwidth, starting at $5,499.
https://modelfit.io/blog/mac-studio-m5-ultra-512gb-local-llm/
Can’t find any for sale, because it seems completely unavailable at the moment. That aside, I wouldn’t call a price point of $5500 USD ‘feasible’.
Ehhh if it’s a hobby you’re really into it’s not a crazy amount, I spent way more than that on motorcycles just for shits and giggles, 5k of photography equipment is a pretty small and sad pile, same with hi-fi, fishing, watches, bicycles etc.
I’m also impressed with GLM-5.3-Flash. This is similar to Claude Opus 4.8. It’s much smaller and cheaper than GLM-5.3, and still incredibly capable. It’s also actually feasible for an individual person to get hardware to run it, like if you can one day get your hands on a Mac Studio with 512GB of RAM.
512 GB of RAM?!
My brother in christ I don’t even have 12 GB of ram! I don’t even have 512GB of SSD storage!
It looks like one can’t get a 512GB Mac Studio until the end of the month, so right now, nobody does.
I say no to all of it.
Who do you say yes to?
The article contains the answer
DeepSeek r1 or small local models
And how do I run it without paying billionaires for hardware?
Find used 16gb GPUs off your local marketplace, Jensen (and by extension, Jenson’s leather jacket) don’t make shit on the used market
me :3
I do like it loud.
Removed by mod