Hey everyone, I’m interested in using a local LLM (Language Model) on a Linux system to create a long story, but I’m not sure where to start. Does anyone have experience with this or know of any resources that could help me get started? I’d love to hear your tips and suggestions. Thanks!

  • RandoCalrandian@kbin.social
    link
    fedilink
    arrow-up
    0
    ·
    7 months ago
    1. you need a gpu or gpu resources to run a GPT level model

    2. stop thinking of it as “make me a story” and start thinking of it as “let’s make a story together”

    First talk back and forth over the basic idea.
    Then get a short outline.
    Then work on each chapter of the outline.
    Then repeat and refine.

    Try to keep overall queries under a certain character limit. Google what some good ranges are.

    Make sure to save each conversation, and use the outline and previous chapter as the start of your conversation for making the next chapter.

    The AI won’t write it for you, but it can be an amazing accelerator if you’re willing to put in the work.