• The Dark Lord ☑️@lemmy.ca
    link
    fedilink
    English
    arrow-up
    0
    ·
    5 months ago

    Yes. Android already does all these things. But I think the things I’m excited most about are not on this list at all.

    1. A private local LLM. With the on-device context of my notes, messages, calendar, etc, I’m rather excited to have a more personal LLM than ChatGPT.

    2. Personal messaging via satellite. I love that I can stay in touch with people outside of a cell network.

    • doodle967@lemdro.id
      link
      fedilink
      English
      arrow-up
      0
      ·
      5 months ago

      Satellite messaging is already available in Android 15 beta, and the LLM in the device will only be for iPhone 15 Pro and above, so most iPhone users will not be able to use it.

    • Ace! _SL/S@ani.social
      link
      fedilink
      English
      arrow-up
      0
      ·
      5 months ago

      A private local LLM

      Running on a phone? No way, not without being absolutely horrible, slow or making your phone churn through your battery anyway.

      Good LLMs are olready slow on a GTX 1080, which is already miles faster than any phone out there

      • felixwhynot@lemmy.world
        link
        fedilink
        English
        arrow-up
        0
        ·
        5 months ago

        I think It’s running on their “Private cloud compute” platform, not locally (I’m not sure though)

      • subtext@lemmy.world
        link
        fedilink
        English
        arrow-up
        0
        ·
        5 months ago

        I hear you, but also I would be shocked if Apple were to roll this out and it be an absolutely terrible experience. Like their MO is “luxury” products with “premium” experiences, it would not be fitting of the brand to have a piece of crap experience on their flagship announcement.

        I’m willing to give them the benefit of the doubt on this one.

          • The Dark Lord ☑️@lemmy.ca
            link
            fedilink
            English
            arrow-up
            0
            ·
            5 months ago

            Apple Maps was bad, yes. But they had their hand forced. Google started charging for their API (enough to cripple their app), and they had very little time to create one of their own.

            That’s not happening here. No one is forcing their hand. If they didn’t release an updated Siri this year, nothing would happen.

        • Eldritch@lemmy.world
          link
          fedilink
          English
          arrow-up
          0
          ·
          5 months ago

          You might wanna check with siri on that. Apple regularly failed at that even under the leadership of Jobs. And Tim Cook is no Steve Jobs. It’s already looking like it’s going to be just standard remote chat GPT. Hallucinations and all.

      • kill_dash_nine@lemm.ee
        link
        fedilink
        English
        arrow-up
        0
        ·
        5 months ago

        You would be surprised. If you haven’t tried to run a LLM on Apple silicon, it’s pretty snappy but like all others, RAM can be a significantly limiting factor unless the model is trimmed down to do very specific things to reduce the size.

        • Womble@lemmy.world
          link
          fedilink
          English
          arrow-up
          0
          ·
          5 months ago

          Microsoft’s penchant for making up names for thing that already have names is neither here nore there. It is an LLM, in fact its already twice as large as chatGTP2 (1.5B params).

          • habanhero@lemmy.ca
            link
            fedilink
            English
            arrow-up
            0
            ·
            5 months ago

            I do think it’s a useful distinction considering open models can be more than 100B+ nowdays and GPT4 is rumored to be 1.7T params. Plus this class of models are far more likely to be on-device.

    • doleo@lemmy.one
      link
      fedilink
      English
      arrow-up
      0
      ·
      5 months ago

      Did I understand correctly that this is only going to be in the iPhone 15 pro? Because that’s a lot more expensive than a pixel, more than I’d ever spend on a phone tbh.

    • MacN'Cheezus@lemmy.today
      link
      fedilink
      English
      arrow-up
      0
      ·
      edit-2
      5 months ago

      A private local LLM. With the on-device context of my notes, messages, calendar, etc, I’m rather excited to have a more personal LLM than ChatGPT.

      No need to wait for iOS 18 to have that: https://llmfarm.site/

      • The Dark Lord ☑️@lemmy.ca
        link
        fedilink
        English
        arrow-up
        0
        ·
        5 months ago

        That’s great, but the fact it’s local and private means it can consume my personal data and be a more personal LLM. This just doesn’t hit that mark.

    • Joelk111@lemmy.world
      link
      fedilink
      English
      arrow-up
      0
      ·
      5 months ago

      I’d add to that list. If Siri is 3/4 as capable as shown in the presentation, that’s sick. Android does not have that.