• Levsgetso@lemmy.zip
    link
    fedilink
    English
    arrow-up
    0
    ·
    11 months ago

    Lemmy has been feeling pretty empty the past couple of days. That just really goes to show how important federation really is.

    • RBG@discuss.tchncs.de
      link
      fedilink
      English
      arrow-up
      0
      ·
      11 months ago

      Yes and no, if you have enough users you do not need federation for a server to not feel empty. But overall many servers do not have that many users, so federation with larger ones is essential.

    • ProdigalFrog@slrpnk.net
      link
      fedilink
      English
      arrow-up
      0
      ·
      edit-2
      11 months ago

      I noticed that as well, thought maybe things were just slowing down, but it’s good to know it was the software and not a sudden drop in community involvement. Since admins became aware of the bug and began restarting their servers as an ad-hoc fix, I’ve been seeing way more engagement on my instance.

  • thegiddystitcher@lemm.ee
    link
    fedilink
    English
    arrow-up
    0
    ·
    11 months ago

    Yup, absolutely nothing I posted from lemm.ee yesterday made it out into the wider world. In fact I’ll probably have to manually federate this comment too.

    Hopefully they can get to the bottom of it. Maybe next year we need a rule about releasing anything in December when everyone’s too busy to bugfix 😅

    • 1984@lemmy.today
      link
      fedilink
      English
      arrow-up
      0
      ·
      11 months ago

      A restart of Lemmy seems to fix it temporarily according to admin of Lemmy.today.

      But it’s inconsistent and stops working after a while it seems.

      • thegiddystitcher@lemm.ee
        link
        fedilink
        English
        arrow-up
        0
        ·
        edit-2
        11 months ago

        My other account is on .world so I can use search to forcibly pull things onto at least that server (search for the original URL of the unfederated post or comment and then wait a few seconds). Sometimes doing that will also encourage whatever it was to federate more widely to more servers, but that doesn’t seem to be happening as reliably either since the upgrade 🤷‍♀️

  • walden@sub.wetshaving.social
    link
    fedilink
    English
    arrow-up
    0
    ·
    11 months ago

    I’m going to set up a cronjob to restart the Lemmy docker container every 6 hours. That seems to be around when stuff stops working usually.

  • maegul (he/they)@lemmy.ml
    link
    fedilink
    English
    arrow-up
    0
    ·
    11 months ago

    I’d say the big seems to be slightly different from my observations, in that things are meant rather than broken. Could be wrong though.

  • RandomVideos@programming.dev
    link
    fedilink
    English
    arrow-up
    0
    ·
    11 months ago

    A while ago, programming.dev had a problem where nothing from the instance federated for a week. Lemmy felt so empty

  • 1984@lemmy.today
    link
    fedilink
    English
    arrow-up
    0
    ·
    11 months ago

    I would comment on this but since federation is broken…this won’t be seen until the instance admin restarts Lemmy and federation works once again.

    • BlueÆther@no.lastname.nz
      link
      fedilink
      English
      arrow-up
      0
      ·
      edit-2
      11 months ago

      Federation seems to be working fine from where I stand?

      Edit:

      Edit 2:

      Even the edit federated out to your instance fine…

      • Skull giver@popplesburger.hilciferous.nl
        link
        fedilink
        English
        arrow-up
        0
        ·
        edit-2
        11 months ago

        I have mh suspicions that this is some kind of deadlock issue. After fucking up my config during am upgrade (too many database connections, too many workers) the new multithreaded federation thingy seemed to become quite unstable. From what I could tell, the threads that are supposed to deal with federation all broke/shut down, but didn’t get automatically restarted again, leaving some messages and instances in limbo until the entire server got restarted.

        After fixing my database connection issue and reducing the amount of workers, I don’t think I’ve encountered many issues since. I occasionally click the little icon above a post to check if my response had reached the community server, and usually it does, pretty quickly.

        This issue sounds awful to have to debug, best of luck to the Lemmy devs in finding a fix!

      • 1984@lemmy.today
        link
        fedilink
        English
        arrow-up
        0
        ·
        11 months ago

        I think it works for a while after restart of the server, and then stops working. Yesterday I was making comments that didn’t federate until 12 hours later when I assume the instance admin restarted the server.

          • 1984@lemmy.today
            link
            fedilink
            English
            arrow-up
            0
            ·
            11 months ago

            Yeah it seems to work for some instances with 0.19.1 but Lemmy.today has issues and feddit.de as well, just from what I’ve heard. Probably plenty more.