AI Summary:
Apple’s first-quarter earnings report revealed a mixed performance. While overall sales increased by 4%, iPhone sales showed weakness, particularly in China, where they declined by over 11%. CEO Tim Cook attributed this partly to the lack of Apple Intelligence in China and inventory changes. However, the Mac, iPad, and Services categories saw significant growth, with Services up 14% and both the Mac and iPad up 15%. The company reported $36.33 billion in net revenue, a 7.1% increase from the previous year.
I’m talking about running them in GPU, which favours the GPU even when the comparison is between an AMD Epyc and a mediocre GPU.
If you want to run a large version of deepseek R1 locally, with many quantized models being over 50GB, I think the cheapest Nvidia GPU that fits the bill is an A100 which you might find used for 6K.
For well under that price you can get a whole Mac Studio with those 192 GB the first poster in this thread mentioned.
I’m not saying this is for everyone, it’s certainly not for me, but I don’t think we can dismiss that there is a real niche where Apple has a genuine value proposition.
My old flatmate has a PhD in NLP and used to work in research, and he’d have gotten soooo much use out of >100 GB of RAM accessible to the GPU.
I had found one for about 400 recently, a bit far away tho. I ended up going with a gpu closer by. I don’t need that many gb’s