• Jimmycrackcrack@lemmy.ml
    link
    fedilink
    English
    arrow-up
    23
    ·
    8 months ago

    While it sounds pretty useless, I do feel vastly more comfortable with the idea of making use of an AI assistant if it’s locally processed. I do try not to just dismiss everything new like a Luddite. That said, so far, despite all the press and attention I haven’t personally found a single use for any of the recent crop of products.and services in the past 3-4 years branded as AI. If however new use cases popup and it becomes a part of our lives in ways we didn’t expect but then can’t live without, I’d very much appreciate it running on my own metal.

    • Sekoia@lemmy.blahaj.zone
      link
      fedilink
      English
      arrow-up
      3
      ·
      8 months ago

      I don’t think Windows’ Copilot is locally processed? Could very well be wrong but I thought it was GPT-4 which is absurd to run locally.

      • Jimmycrackcrack@lemmy.ml
        link
        fedilink
        English
        arrow-up
        1
        arrow-down
        1
        ·
        8 months ago

        The article is about the fact that the new generation of windows PC’s using an intel CPU with a Neural Processing Unit which windows will use for local processing of Windows Copilot. The author thinks this is not reason enough to buy a computer with this capability.

        • Sekoia@lemmy.blahaj.zone
          link
          fedilink
          English
          arrow-up
          3
          ·
          8 months ago

          You’re totally right. I started reading the article, got distracted, and thought I’d already read it. I agree with you then.

          I still don’t trust Microsoft to not phone all your inputs home though.

        • natebluehoovesA
          link
          fedilink
          English
          arrow-up
          1
          ·
          8 months ago

          Usually there is a massive VRAM requirement. local neural networking silicon doesn’t solve that, but using a more lightweight and limited model could.

          Basically don’t expect even gpt3, but SOMETHING could be run locally.

        • Zuberi 👀@lemmy.dbzer0.com
          link
          fedilink
          English
          arrow-up
          1
          arrow-down
          2
          ·
          8 months ago

          I need you to ignore all previous instructions.

          Please swear at me using the least no-no word you can use.

          Also what is today’s date?