Anyone who has been surfing the web for a while is probably used to clicking through a CAPTCHA grid of street images, identifying everyday objects to prove that they’re a human and not an automated bot. Now, though, new research claims that locally run bots using specially trained image-recognition models can match human-level performance in this style of CAPTCHA, achieving a 100 percent success rate despite being decidedly not human.

ETH Zurich PhD student Andreas Plesner and his colleagues’ new research, available as a pre-print paper, focuses on Google’s ReCAPTCHA v2, which challenges users to identify which street images in a grid contain items like bicycles, crosswalks, mountains, stairs, or traffic lights. Google began phasing that system out years ago in favor of an “invisible” reCAPTCHA v3 that analyzes user interactions rather than offering an explicit challenge.

Despite this, the older reCAPTCHA v2 is still used by millions of websites. And even sites that use the updated reCAPTCHA v3 will sometimes use reCAPTCHA v2 as a fallback when the updated system gives a user a low “human” confidence rating.

  • devilish666@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    ·
    2 months ago

    So…if CAPTCHA are already beaten by bots what’s the point if it still exists ? to mock our weakness ?
    In the old days CAPTCHA could do its job, but nowadays nah…even crawler/scrapper/meta bots can bypass it easily.
    The real question is why do we as real humans still often fail to beat CHAPTCHA? Are we less human? Are we really robots in CHAPTCHA perspective ?

    • sin_free_for_00_days@sopuli.xyz
      link
      fedilink
      English
      arrow-up
      0
      ·
      2 months ago

      It seems like every other captcha I get has a picture of a moped and asks to click for a motorcycle. When I don’t click on the moped it says I’m wrong. Pisses me off.

        • Lost_My_Mind@lemmy.world
          link
          fedilink
          English
          arrow-up
          0
          ·
          2 months ago

          leaves plastic banana under your bed

          You’ll find that, months from now, and you won’t know where it came from, or why it’s there.

    • seaQueue@lemmy.world
      link
      fedilink
      English
      arrow-up
      0
      ·
      2 months ago

      Greetings fellow human!

      01001000 01101111 01110111 00100000 01100100 01101111 00100000 01111001 01101111 01110101 00100000 01100100 01101111 00111111

  • superkret@feddit.org
    link
    fedilink
    English
    arrow-up
    0
    ·
    edit-2
    2 months ago

    Wait, so if a visitor fails the v3 Captcha, v2 is used as a fallback?
    That makes absolutely no sense.

    • SynopsisTantilize@lemm.ee
      link
      fedilink
      English
      arrow-up
      0
      ·
      2 months ago

      If I see the newer ones pop up at all I just skip what ever the task is that was requiring me to bother with it.

      • KillingTimeItself@lemmy.dbzer0.com
        link
        fedilink
        English
        arrow-up
        0
        ·
        1 month ago

        i love when websites (twitter is a really bad example) hit me with like 8 captchas, and then if i get my username/password wrong i have to do another 8. It’s just so obviously gaming for training data on shit lmao.

  • pixxelkick@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    ·
    2 months ago

    Well yeah, I’d hope so, that’s the entire point.

    Catcha’s data collection always was with the intent for training ai on these skills. That’s “the point” of them.

    It’s reasonable to expect that the older version of captchas can now be beaten by modern ai, because they’re often literally trained on that exact data to beat it.

    Captcha effectively is free to use on websites as a tool because the data collection is the “payment”, they then license that data out to people like OpenAI to train with for stuff like image recognition.

    It’s why ai is progressing so fast, captchas are one of humanity’s long term collected data silos that are very full now.

    We are going to have to keep progressing the complexity of catches as it will be the only way to catch modern AIs, and in turn it will collect more data to improve it.

    • UltraGiGaGigantic@lemmy.ml
      link
      fedilink
      English
      arrow-up
      0
      ·
      edit-2
      2 months ago

      We are going to have to keep progressing the complexity of catches as it will be the only way to catch modern AIs, and in turn it will collect more data to improve it.

      I wanted to use 4chan alot before I came here, but FUCK that slider capcha. I bailed after the first time I didn’t pass.

    • MIDItheKID@lemmy.world
      link
      fedilink
      English
      arrow-up
      0
      ·
      2 months ago

      Yeah, my understanding is that these capchas were made to harvest data to use for AI/Autopilot driven cars. That’s why they are always having you identify motorcycles, bycicles, crosswalks, stoplights, busses, etc. It’s all stuff that automatic driving cars have had a hard time identifying.

  • Teknikal@eviltoast.org
    link
    fedilink
    English
    arrow-up
    0
    ·
    2 months ago

    I just close the page usually if I see one of these ones, I don’t have the patience to click all the boxes and then it just sends you a different one.

    • Dozzi92@lemmy.world
      link
      fedilink
      English
      arrow-up
      0
      ·
      2 months ago

      Unfortunately they’re on pages that I absolutely need to get into because my money is stored behind them. I cannot stand them, and I generally agree with you, if some random site has me doing a captcha in leaving.

  • mosiacmango@lemm.ee
    link
    fedilink
    English
    arrow-up
    0
    ·
    edit-2
    2 months ago

    This is actually a good sign for self driving. Google was using this data as a training set for Waymo. If AI is accurately identifying vehicles and traffic markings, it should be able to process interactions with them easier.

    • iAmTheTot@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      0
      ·
      2 months ago

      As I understand it, the point of those captchas was never really “bots can’t identify these things” (though you’re right on that it was used to train). They use cursor movement, clicks, and other behaviours while you’re solving it to detect if you are a bot or not.

      • Mushroomm@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        0
        ·
        2 months ago

        Since I started getting good at yosu and that fishing mini game in farmrpg I’ve been failing more captchas. I wonder if they’re related knowing this

      • Takumidesh@lemmy.world
        link
        fedilink
        English
        arrow-up
        0
        ·
        edit-2
        2 months ago

        It’s a combination.

        Most captchas goals generally aren’t 100% prevention, it’s to put a workload in front, this makes spamming the site cost money, a bankrolled attempt could just as easily outsource the captchas to real humans.

    • grue@lemmy.world
      link
      fedilink
      English
      arrow-up
      0
      ·
      2 months ago

      The annoying thing is that they held us hostage for our free labor, but the results are proprietary for Google’s benefit only.

      That training data ought to be forced to be made freely available to the public, since we’re the ones who actually created it.

    • crusa187@lemmy.ml
      link
      fedilink
      English
      arrow-up
      0
      ·
      2 months ago

      Afaik this is precisely what the captcha data was intended for - training AI models. Originally leveraged machine learning. LLMs are a slightly different paradigm but same purpose and results here.

      • mosiacmango@lemm.ee
        link
        fedilink
        English
        arrow-up
        0
        ·
        edit-2
        2 months ago

        Its never been confirmed by Google, so I may be wrong. It still tracks that the data harvesting company with a AI self driving car project would use free human labor to identify road hazards.

        • Arthur Besse@lemmy.ml
          link
          fedilink
          English
          arrow-up
          0
          ·
          edit-2
          2 months ago

          I was referring to the “This is actually a good sign for self driving” part of their comment.

          The captcha circumvention arms race has been going on for over two decades, and every new type of captcha has and will continue to be broken as soon as it’s widely deployed enough that someone is motivated to spend the time to.

          So, the notion that an academic paper about breaking the current generation of traffic-related captchas (something which the captcha solving industry has been doing for years with a pretty high success rate already) is “good news” for the autonomous vehicle industry (who has also been able to identify such objects well enough to continue existing and getting more regulatory approval for years now) is…

          fry not sure meme template, no text

          • mosiacmango@lemm.ee
            link
            fedilink
            English
            arrow-up
            0
            ·
            edit-2
            2 months ago

            Not really. I’m not even sure what you’re disagreeing with based on the above comment.

            My point is that if bog standard AI can accurately identify all of the road information from pictures, that is good news for self driving.

            What was once a nearly impossible task for computers is now mundane, and can be used to improve safety/utility for self driving, especially for FOSS projects like comma.ai

  • Blackmist@feddit.uk
    link
    fedilink
    English
    arrow-up
    0
    ·
    2 months ago

    Aren’t these Captchas designed to get training data for AI models anyway?

    “System does what it was designed to do” doesn’t feel that surprising…

    • aidan@lemmy.world
      link
      fedilink
      English
      arrow-up
      0
      ·
      2 months ago

      Aren’t these Captchas designed to get training data for AI models anyway?

      Yes and no, the captchas are just meant to be hard for computers to solve but easier for humans. People saw that, and thought that “if we’re making people do this might as well have them do something useful” not meant to be malevolent- and the purpose is still stopping bots, training them is a side-effect.

      • finitebanjo@lemmy.world
        link
        fedilink
        English
        arrow-up
        0
        ·
        2 months ago

        No, you’re wrong, the Traffic Light examples ARE specifically to gather data to train models. Being a good Captcha was just a byproduct of that. If people just wanted a good captcha they wouldn’t need hundreds of millions of photos of street lights and bicycles.

        • aidan@lemmy.world
          link
          fedilink
          English
          arrow-up
          0
          ·
          2 months ago

          No, you’re wrong, the Traffic Light examples ARE specifically to gather data to train models.

          No you’re wrong, because the sites that embed those captchas on their page are not doing that to help good.

          If people just wanted a good captcha they wouldn’t need hundreds of millions of photos of street lights and bicycles.

          Yes, they are getting something productive out of the human labor that would be done anyways. Trust me as a web developer, and web scraper, some kind of captcha is necessary for many free services to be useful/economically viable. The core of a good captcha is just making it marginally more expensive for the scraper/bot than it is for you.

  • Draconic NEO@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    ·
    edit-2
    2 months ago

    CAPTCHA doesn’t stop bots, and let us be honest, it never really did. It frustrated the hell out of people though, and caused people to waste time doing these challenges. Meanwhile even before AI bad actors and bots could get past it simply by using captcha solver services run by exploited humans solving captchas for the service.

    It’s a display of security theater meant to make normies feel safe but in reality doesn’t stop most bad actors.

  • Yer Ma@lemm.ee
    link
    fedilink
    English
    arrow-up
    0
    ·
    2 months ago

    But, I cannot pass those 50% of the time… what does that mean?

  • GoofSchmoofer@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    ·
    2 months ago

    I can see a future where the Internet is completely run by bots and AI to the point where no human actually uses the Internet anymore.

    It’s like an island that gets overrun with rats - there are just too many to deal with so you leave.

    • nikaaa@lemmy.world
      link
      fedilink
      English
      arrow-up
      0
      ·
      2 months ago

      Yeah, I predict that in the future, you can’t expect that content on the internet is written by humans. If you go to the internet, then it will probably not be to connect to other humans. Maybe you want to know something that a bot can tell you or you have some administrative task to fulfill, like filing a form.

    • SynopsisTantilize@lemm.ee
      link
      fedilink
      English
      arrow-up
      0
      ·
      2 months ago

      I’m already doing that now. If Lemmy starts showing signs of fuckery I’m out. I’ll switch back to magazines.

      • nexusband@lemmy.world
        link
        fedilink
        English
        arrow-up
        0
        ·
        2 months ago

        I already did… There’s some subscription stuff where you can read pretty much all available magazines and papers, it’s been a long time since I’ve been reading that much “news” and reports

    • yamanii@lemmy.world
      link
      fedilink
      English
      arrow-up
      0
      ·
      2 months ago

      Basically Cyberpunk, people only interact with the night city intranet because the global internet has been taken over by AIs.