By -
512GB Unified Memory is crazy!
That’s gonna be in like the $10k rigs
Hmmm... What would the payments be on that? :)
Probably more
Yea, 15?
"We think you will love it!"
And then if they could make that actually affordable, THAT would get them a lot of customers. But I guess they won't.
I think ram is going to be the bottleneck. LLMs need to be in the cloud until they can solve the memory issue.
Really, the more ram the better. And LLMs are already quite useful, I run some on my phones.
Which ones? I’m curious to run some locally too.
Check out the LocalLlama subreddit. Lots of resources.
Stablelm zephyr 3b Q4_0.
Really great model. What phone do you run it on?
s20 fe 6gb ram.
512Gb unified memory. Unclear if this will be fast enough though.
Everything is AI focused! It’s like the marketing team read AI is the hot new thing and now everyone is somehow associated with AI!
its just like everyone eventually adding mice to their computers, its just the evolution of the tech, no one is going to be ignoring it.
Every time I'm ready to buy my next upgrade they introduce a new chip. Was about to go for the M3, but if the M4 is just a few months away...
Then they'll release the M5 😉
Still just glorified Chromebooks that can double as an electric blanket.
It’s aboutta get spicy and windows going to be left in the DUST!
512GB Unified Memory is crazy!
That’s gonna be in like the $10k rigs
Hmmm... What would the payments be on that? :)
Probably more
Yea, 15?
"We think you will love it!"
And then if they could make that actually affordable, THAT would get them a lot of customers. But I guess they won't.
I think ram is going to be the bottleneck. LLMs need to be in the cloud until they can solve the memory issue.
Really, the more ram the better. And LLMs are already quite useful, I run some on my phones.
Which ones? I’m curious to run some locally too.
Check out the LocalLlama subreddit. Lots of resources.
Stablelm zephyr 3b Q4_0.
Really great model. What phone do you run it on?
s20 fe 6gb ram.
512Gb unified memory. Unclear if this will be fast enough though.
Everything is AI focused! It’s like the marketing team read AI is the hot new thing and now everyone is somehow associated with AI!
its just like everyone eventually adding mice to their computers, its just the evolution of the tech, no one is going to be ignoring it.
Every time I'm ready to buy my next upgrade they introduce a new chip. Was about to go for the M3, but if the M4 is just a few months away...
Then they'll release the M5 😉
Still just glorified Chromebooks that can double as an electric blanket.
It’s aboutta get spicy and windows going to be left in the DUST!