Orbit is an LLM addon/extension for Firefox that runs on the Mistral 7B model. It can summarize a given webpage, YouTube videos and so on. You can ask it questions about stuff that’s on the page. It is very privacy friendly and does not require any account to sign up.

I personally tried it, and found it to be incredibly useful! I think this is going to be one of my long term addons along with uBlock Origin, Decentraleyes and so on. I would highly recommend checking this out!

  • zecg@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    ·
    edit-2
    2 months ago

    “we have a few potential paths to follow depending on the feedback we receive. Running a truly local LLM is one that we’re researching at the moment”

    In that case, fuck off with this bullshit until your research is done, that’s some feedback for you.

    • Railcar8095@lemm.ee
      link
      fedilink
      English
      arrow-up
      0
      ·
      2 months ago
      1. I don’t think this is the proper channel for feedback.
      2. Rude
      3. Fuck you. This is an optional extension for those who want to try. Do you want the final version of a piece of free software? Then you can go lie in a ditch because hopefully it will continue to evolved for years. It’s astonishing the entitlement of some people.
      4. Good local LLM that can run on most hardware is a very interesting project. Usually you need at least a GPU to get it to run. The fact that is only summarizing might be because it this.