A Hugging Face employee made a huge dataset of Bluesky posts, and it’s already very popular.

A machine learning librarian at Hugging Face just released a dataset composed of one million Bluesky posts, complete with when they were posted and who posted them, intended for machine learning research.

Daniel van Strien posted about the dataset on Bluesky on Tuesday:

“This dataset contains 1 million public posts collected from Bluesky Social’s firehose API, intended for machine learning research and experimentation with social media data,” the dataset description says. “Each post contains text content, metadata, and information about media attachments and reply relationships.”

The data isn’t anonymous. In the dataset, each post is listed alongside the users’ decentralized identifier, or DID; van Strien also made a search tool for finding users based on their DID and published it on Hugging Face. A quick skim through the first few hundred of the million posts shows people doing normal types of Bluesky posting—arguing about politics, talking about concerts, saying stuff like “The cat is gay” and “When’s the last time yall had Boston baked beans?”—but the dataset has also swept up a lot of adult content, too.

  • EngineerGaming@feddit.nlEnglish
    0·
    28 days ago

    IDK if this is accurate, but it’s absolutely my headcanon as to why Glados decided to murder everyone almost immediately after she was turned on. She just vacuumed up the collective stupidity of the Internet.

    • Infomatics90@lemmy.caEnglish
      0·
      28 days ago

      Its good headcanon, but it omits the fact that GLADOS isn’t aware of the combine, and for some reason the combine haven’t even found Aperture labs.

      • EngineerGaming@feddit.nlEnglish
        0·
        27 days ago

        I was under the impression that she knew and was deliberately laying low… Also, wasn’t she built before these events?

        • Infomatics90@lemmy.caEnglish
          0·
          27 days ago

          I could be wrong. I just don’t remember her mentioning anything about them or seeing anything about them in the game.

          • EngineerGaming@feddit.nlEnglish
            0·
            27 days ago

            There have been suggestions that this line references them: “Are you trying to escape? Things have changed since the last time you left the building. What’s going on out there will make you wish you were back in here. I have an infinite capacity for knowledge, and even I’m not sure what’s going on outside. All I know is I’m the only thing standing between us and them. Well, I was”.

            She might just be lying like she usually does, but it still wouldn’t be surprising if it indeed was that time period.