I’m talking about running them in GPU, which favours the GPU even when the comparison is between an AMD Epyc and a mediocre GPU.

If you want to run a large version of deepseek R1 locally, with many quantized models being over 50GB, I think the cheapest Nvidia GPU that fits the bill is an A100 which you might find used for 6K.

For well under that price you can get a whole Mac Studio with those 192 GB the first poster in this thread mentioned.

I’m not saying this is for everyone, it’s certainly not for me, but I don’t think we can dismiss that there is a real niche where Apple has a genuine value proposition.

My old flatmate has a PhD in NLP and used to work in research, and he’d have gotten soooo much use out of >100 GB of RAM accessible to the GPU.

If it’s for AI, loading huge models is something you can do with Macs but not easily in any other way.

I’m not saying many people have a use case at all for them, but if you have a use case where you want to run 60 GB models locally, a whole 192GB Mac Studio is cheaper than the GPU alone you need to run that if you were getting it from Nvidia.

So the lack of apple-branded AI Slop is slowing down the sales for iPhones but not for Macs?

Edit for clarity: I’m aware sequoia “has” apple intelligence but in a borderline featureless state, so it’s as good (or as bad) as not having anything.