Basically Apple will be building the perfect computers to run local LLMs.
One can only hope that it totally breaks the AI/LLM at industrial scale, so businesses can run their own AI systems with their own data sets.
No more of this fucking datacanter horseshit.
It’s pretty obvious at this point that the data centers are for storing massive amounts of video.
Local LLMs are cool but also pretty slow compared to cloud. If you have to wait half an hour for your Feature while coding you might still opt for the cloud agent.
Have you tried running a local model on a M series Mac?
Yes ofc I ran Gemma 4 for example, but compare that to the speed of Gemini in the cloud the difference is massive.
How much RAM do you have and which version of the model did you run?
Local LLMs can be just as fast as long your device clears the requirements. If you noticed a huge difference, there’s a really good chance that you tried to use a model that requires more RAM than you have
Actually they can be much faster given sufficient VRAM and not a lot of concurrent users.
Yes, they are slower. However, I think that the pricing we’re going to see from the cloud providers might be enough to deter quite a lot of people. At least I hope so:
The fact that we’re already used to blazing speed generation kinda sucks. Local models are a much more sustainable way of unlocking the benefits of LLMs than giant ecosystem- and community-destroying data centers.
A Mac with 1.5TB RAM would be expensive at the best of times. In 2027/2028 it might approach $50k, or even get into 6 figures.
It shouldn’t be, if Apple gets that import exemption from the Chinese memory manufacturer (ChangXin Memory Technologies) they are asking for. Apparently they’re already testing the CXMT chips to put in the phones sold in China, freeing up the orders/stock they’ve sourced already from “safe” sources, to go into their products sold in the rest of the world.
Smart move if they can finagle it.
Hopefully they can get it through before the fuckwits in the administration understand how effectively it can threaten the big AI players that Trump seems to be sniffing around.
You absolutely BET that he will scuttle any trade deal if it interferes with his own personal agenda WRT his investments in AI.
He’s that much a greedy cunt.
Or the more likely option that they get the cheaper ram from China and then double dip and use the ram scarcity excuse for higher prices
Big household name gaming companies have devs who burn 20k in tokens A MONTH.
A 50k machine that can run a model locally with 0 monthly costs will pay for itself in 3 months.
Can I load all of GTA 6 into RAM?
Yeah, but can it run Crysis?
Nope, still running single core. Probably runs worse than on older CPUs which were optimized for single core clock speed.
Remortgage your house now.
