Thread

🛡️
How do you even compete with Apple? They have a vertically integrated stack from privacy preserving silicon to ai tech. I thought apple was going downhill, but now with private-cloud and ondevice intelligence, it makes my linux box + typing into chatgpt look like a joke.

Replies (74)

🛡️
I guess I could use on-device models, but linux is not even close to having system-wide integration of local models that can access many different systems and integrate them. We need whole new kinds of apis and system interfaces for this. I suspect it’s at least 20+ years away. Apple is way ahead of the curve here.
🛡️
↩ replying to jb55
This makes me sad, it feels like open source tech is way behind now. AI is going to change computing and people are going to forget about the days when we didn’t have it. It will look like old and obscure tech, even more than it already is. The opensource ai crowd needs to pick up the pace or open source computing is fucked and it will become less relevant than ever.
↩ replying to jb55
Only if you ignore the unsolved and persistent MAJOR, high risk,problem: It doesn't actually work. No AI model is accurate enough to avoid disaster: there will be countless stories of AI telling your boss something you didn't want said, or making purchases you didn't want, telling you to add glue to pasta sauce. These problems aren't going away, and the only way to stop such risks is to make AI a less useful assistant, which is what a standard computer is.
↩ replying to npub10wsu...3hd3
AI assistant will be a short lived gimmick, in the sense that if you don't mind it being completely inaccurate for all the integrated tasks you give it, then it will SORT OF work. But when it makes mistakes, it will move beyond just annoying (like when alexa doesn't understand your words) to destructive and catastrophic. Apple doesn't want to use its own AI because it doesn't want that responisibility. It informs you that you are using OpenAI. Because its an unreliable toy.
They basically just put Microsoft owned tech on their phones. I don't think siri having more functionality will really change much, most normies don't really use chatgpt other than for school or work. Seems almost boring compared to their previous work. Like the Vision pro was hyped for 2 days before people realized the user base wasn't there. I know it was more for enterprise but Idk seems like another half assed product/enviroment.
🛡️
↩ replying to npub104gv...w0vj
You can read about their entire stack, its not just belief, they are opening it to researchers:
Private Cloud Compute: A new frontier for AI privacy in the cloud - Apple Security Research
Private Cloud Compute: A new frontier for AI privacy in the cloud - Apple Security Research
Secure and private AI processing in the cloud poses a formidable new challenge. To support advanced features of Apple Intelligence with larger foun...
 Its extremely impressive
How long before they actually provide data to governments? Via backdoors or otherwise. At least in EU where there is no place for e2ee. no thanks. theirs business model is something I wouldn't touch with 5m stick.
jb55's avatar jb55
How do you even compete with Apple? They have a vertically integrated stack from privacy preserving silicon to ai tech. I thought apple was going downhill, but now with private-cloud and ondevice intelligence, it makes my linux box + typing into chatgpt look like a joke.
View quoted note →
From now on, I identify as an AI skeptic/luddite.
jb55's avatar jb55
How do you even compete with Apple? They have a vertically integrated stack from privacy preserving silicon to ai tech. I thought apple was going downhill, but now with private-cloud and ondevice intelligence, it makes my linux box + typing into chatgpt look like a joke.
View quoted note →
🛡️
Having followed Apple for close to three decades, I knew this would happen as soon as the first llama dropped. They tend to have a longer horizon and miss out on a lot of practical opportunities while lining up for something most people aren't thinking about yet. Given their surprising advance in unified memory and decision to make over-powered but under-featured mobile devices, preparing to run something heavy in the near future is a reasonable conclusion. But, their advantage is going to be limited by their ecosystem. iOS is a lot more constrained than an open source OS, and while it can be a hot mess, it's also possible to lock those down too. It just takes time and code. Perhaps code written by LLMs.
How do you compete against them? Provide a similar platform that is open source and amenable to third party developers, forking, modifying, allowing markets to bloom. Provide the substrate for a complex adaptive system and it will devour the railroaded completion like complex adaptive systems always do.
jb55's avatar jb55
How do you even compete with Apple? They have a vertically integrated stack from privacy preserving silicon to ai tech. I thought apple was going downhill, but now with private-cloud and ondevice intelligence, it makes my linux box + typing into chatgpt look like a joke.
View quoted note →
Can't tell if this is serious or sarcasm. Also suspicious of sudden epiphanies like this. ChatGPT is a privacy headache but that doesn't drag Linux into the same label, nor does it make Apple the only alternative when there's a ton of local server options available... it takes a few seconds to download LM Studio or Ollama... there's no need for drama ,🦙. View quoted note →
They’re just really good at taking the time to ship great stuff, that’s often in service of some greater vision that’s visible only to a small number of the leadership. Jobs set up the factory and it’s still churning out unmatched products. Every engineer there gets the last ounce of effort squeezed out them by WWDC by the system he set up. It would be even better if Jobs was still around of course, albeit with a tad more burnout.