While I generally agree that local models will gain popularity and Apple is generally well situated to capitalize on this, articles like this are not the way to convince anyone.
Plots with no axis labels or units displayed? In fact if you're literally just comparing two things, why not just write down the two numbers? Or better yet strengthen your argument by comparing more than just literally two options?
And the pictures. You seriously couldn't be bothered to just go find a picture of four Mac minis stacked on top of each other, and had to genai a picture of four vaguely-mac-mini-shaped blocks?
So the argument of this _very_ Claude written piece is that.. On apple devices you have GPUs with fast-enough unified memory and can link them together?
Okay, fair, but why would I get an Apple device when I can get a Linux device with some monster motherboard that has a dozen memory slots?
AMD's Strix Halo has a 256-bit memory bus. Apple's Max class chips have a 512-bit memory bus, Ultra class chips have a 1024-bit memory bus. Unless you want to go for datacenter hardware, AMD's offerings simply aren't in the same league in terms of memory bandwidth.
Looks like Mac Minis had a 64 GB model (hard to get now) for roughly $1,600. You could get a 3 of these (192GB) & thanks to the Thunderbolt 5 connection, they out performed any single board AMD for a similar price that had more memory. If you tried to do so something similar with Nvidia GPU you're looking at a lot of watts, cooling & a much faster experience but only 48 GB of memory.
if the author wasn't too lazy - this article could've been way shorter.
but of course author chose to use a.i to write this.
& bury very important points which are 1. Chinese Memory Manufacturers 2. Apple Unified Memory + their own chips which are a result of their 'car' effort.
This article goes to show that you use AI to produce reasonable sound argument but under the hood the assumptions are still not very defensible.
The way I see it, is that they missed the boat on how powerful those models will become meanwhile other players are integrating deeply into their ecosystem. It might go down as the fall of the empire similar to Nokia, Kodak etc. It is still too early to tell.
> Every historical technology wave ends the same way: the mainframe becomes the PC, the timeshare becomes the laptop, the cloud becomes the edge. The only people who ever argue otherwise are the people selling mainframes.
Perhaps AI serves also as an attempt to reverse course on this: raise prices on general-purpose computing hardware (excluding phones, which are increasingly locked down) so that it becomes again inaccessible to consumers.
If this article was true then Cerebras would be worth at least 2.5T and Nvidia half of what’s worth now. The market seems to be paying a premium for training chips rather than inference. Oh, and there’s also a bubble as you can see in Shiller’s PE ratio here https://www.multpl.com/shiller-pe
My comment won’t add anything to the discussion. As far as I know I have heard same idea * several times from George Hotz blog posts. I guess that’s what tiny corp wants to do.
The author seems unaware that products such as nVidia’s DGX Spark and AMD’s Strix Halo exist at a similar price point per gig of unified RAM, and I don’t see either company offering less unified memory as time goes on. I think he’s right about Apple doing a good job right now, but wrong about its competitors.
I like Apple and think there is an AI bubble, but this article is kind of dumb.
Apple is not doing anything magical with hardware that other companies, including Nvidia, cannot do for roughly the same price/performance. The M series is amazing, but there are comparable products out there now. If you want to say eventually demand for Nvidia will fade because demand for training frontier models will decrease with time, fair, but that doesn’t suddenly make Apple the king of AI.
Also, for new better AI models to happen someone will need to train those new better models and that isn’t going to happen on 5000 Mac minis duct taped together.
This is actually a stronger argument for Apple than the article makes.
The king of AI isn’t the shop with the biggest/bestest model, or whose machine has the bandwidth and unified memory.
It’s the company who has the trust of a massive number of users.
Apple was smart enough to give OpenAI the finger on deep integration, and focus on building out the part that everyone really wants.
Whoever provides the llm inference, do it with the privacy protection, and with access to the personal data you want AI to have access to, but without sacrificing the former. They’re literally the only company on earth in a position to do this.
We’ll see if they’re going to pull it off, very soon. If they have, they’ll have managed to negotiate and capitalize on this crazy hype cycle better than anyone, by far.
They could become the trusted gatekeeper of AI services, doing the one thing that none of the rest can ever do… and have done it without lighting trillions of dollars on fire fighting an unwinnable war.
Any interaction with the iOS 27 beta siri compared with ChatGPT Live quickly disproves this drivel. Also OP seems unaware of their bandwidth contstraints
On the deep partnership with Google for Gemini, it will be interesting to see how Google and Apple respond to GPT Live.
This does really feel like the first milestone for voice assistants that are equivalent to talking to a human. Not suggesting it's perfect - but the tech is only going to improve from here.
I wonder if the author will leave a comment justifying the tediously vanilla LLM-generated prose by stating English isn’t their native tongue and that the original truly was the fruits of their own rigorous thinking and writing efforts.
It would be nonsense of course, but it’s a tale that seems to work for a significant number of readers here.
Plots with no axis labels or units displayed? In fact if you're literally just comparing two things, why not just write down the two numbers? Or better yet strengthen your argument by comparing more than just literally two options?
And the pictures. You seriously couldn't be bothered to just go find a picture of four Mac minis stacked on top of each other, and had to genai a picture of four vaguely-mac-mini-shaped blocks?
Okay, fair, but why would I get an Apple device when I can get a Linux device with some monster motherboard that has a dozen memory slots?
Looks like Mac Minis had a 64 GB model (hard to get now) for roughly $1,600. You could get a 3 of these (192GB) & thanks to the Thunderbolt 5 connection, they out performed any single board AMD for a similar price that had more memory. If you tried to do so something similar with Nvidia GPU you're looking at a lot of watts, cooling & a much faster experience but only 48 GB of memory.
but of course author chose to use a.i to write this.
& bury very important points which are 1. Chinese Memory Manufacturers 2. Apple Unified Memory + their own chips which are a result of their 'car' effort.
The way I see it, is that they missed the boat on how powerful those models will become meanwhile other players are integrating deeply into their ecosystem. It might go down as the fall of the empire similar to Nokia, Kodak etc. It is still too early to tell.
Perhaps AI serves also as an attempt to reverse course on this: raise prices on general-purpose computing hardware (excluding phones, which are increasingly locked down) so that it becomes again inaccessible to consumers.
My comment won’t add anything to the discussion. As far as I know I have heard same idea * several times from George Hotz blog posts. I guess that’s what tiny corp wants to do.
Apple is not doing anything magical with hardware that other companies, including Nvidia, cannot do for roughly the same price/performance. The M series is amazing, but there are comparable products out there now. If you want to say eventually demand for Nvidia will fade because demand for training frontier models will decrease with time, fair, but that doesn’t suddenly make Apple the king of AI.
Also, for new better AI models to happen someone will need to train those new better models and that isn’t going to happen on 5000 Mac minis duct taped together.
The king of AI isn’t the shop with the biggest/bestest model, or whose machine has the bandwidth and unified memory.
It’s the company who has the trust of a massive number of users.
Apple was smart enough to give OpenAI the finger on deep integration, and focus on building out the part that everyone really wants.
Whoever provides the llm inference, do it with the privacy protection, and with access to the personal data you want AI to have access to, but without sacrificing the former. They’re literally the only company on earth in a position to do this.
We’ll see if they’re going to pull it off, very soon. If they have, they’ll have managed to negotiate and capitalize on this crazy hype cycle better than anyone, by far.
They could become the trusted gatekeeper of AI services, doing the one thing that none of the rest can ever do… and have done it without lighting trillions of dollars on fire fighting an unwinnable war.
This does really feel like the first milestone for voice assistants that are equivalent to talking to a human. Not suggesting it's perfect - but the tech is only going to improve from here.
It would be nonsense of course, but it’s a tale that seems to work for a significant number of readers here.