Introducing Instella: New State-of-the-art Fully Open 3B Language Models — ROCm Blogs
rocm.blogs.amd.com
AMD is excited to announce Instella, a family of fully open state-of-the-art 3-billion-parameter language models (LMs). , In this blog we explain how the Instella models were trained, and how to access them.

This is again a big win on the red team at least for me. They developed a “fully open” 3B parameters model family trained from scratch on AMD Instinct™ MI300X GPUs.

AMD is excited to announce Instella, a family of fully open state-of-the-art 3-billion-parameter language models (LMs) […]. Instella models outperform existing fully open models of similar sizes and achieve competitive performance compared to state-of-the-art open-weight models such as Llama-3.2-3B, Gemma-2-2B, and Qwen-2.5-3B […].

As shown in this image (https://rocm.blogs.amd.com/_images/scaling_perf_instruct.png) this model outperforms current other “fully open” models, coming next to open weight only models.

A step further, thank you AMD.

PS : not doing AMD propaganda but thanks them to help and contribute to the Open Source World.

  • frezik@midwest.socialEnglish
    0·
    2 days ago

    Was there anything in the posts above mine that suggest this was a technical issue, or did you read that in as an assumption?

    Every time a significant change in technology comes about, there is a significant impact to jobs. The printing press destroyed the livelihood of scribes, but it made books dramatically cheaper, which created new jobs for typesetters, booksellers, etc.

    Take a look at the history of the first people called “Luddites”. They were early socialists focusing on the dismal working conditions that new automation would bring to the workers. And they were correct.

    Not every technological change is good. Our society has defaulted to saying yes to every change, and it’s caused a whole lot of problems.

    • sugar_in_your_tea@sh.itjust.worksEnglish
      0·
      2 days ago

      Was there anything in the posts above mine that suggest this was a technical issue, or did you read that in as an assumption?

      I was responding both to you and to the parent to your comment and making it clear that it’s not a technical issue. I’m agreeing with you.

      And they were correct.

      I disagree.

      Yes, not every technological change is good, we can look at Social Media as a shining example of that. However, technological change is usually inevitable, especially if you value freedom in your society, so it’s a lot better to solve the issues that surround it than ban it.

      • frezik@midwest.socialEnglish
        0·
        2 days ago

        There is absolutely nothing inevitable about technological change. We think that way because of the specific place we are in history. A specific place that is an aberration in how fast those changes have come. For the most part, humans throughout history have used much the same techniques and tools that their parents did.

        You also can’t separate AI technology from the social change. They’re not dumping billions into data centers and talking about using entire nuclear reactors to power them just because they think AI is a fun toy.