Hey everyone, I’m interested in using a local LLM (Language Model) on a Linux system to create a long story, but I’m not sure where to start. Does anyone have experience with this or know of any resources that could help me get started? I’d love to hear your tips and suggestions. Thanks!

  • sweng@programming.dev
    link
    fedilink
    arrow-up
    0
    ·
    9 months ago

    Why host it locally in that case, and why host it on a Pi? Seems rather restrictive for that usecase.

    • Strit@lemmy.linuxuserspace.show
      link
      fedilink
      arrow-up
      0
      ·
      9 months ago

      They didn’t mention what the story is for, so I am free to speculate. Maybe a raspberry pi is all they have available for such tasks. It could also be for articles or blog posts.