I love how search engines display inaccessible links.

  • Marthirial@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    ·
    4 months ago

    This, primarily, is the reason I am paying for Kagi. It allows you to hide shit sites, AKA reddit from search results.

  • jet@hackertalks.com
    link
    fedilink
    English
    arrow-up
    0
    ·
    4 months ago

    When google started to index paywalled things… I thought that was pretty evil. Showing google content but not normal internet users. Giving sites the ability to have their cake and eat it too.

    When reddit decided to force logging in to see some subreddits on mobile, I decided they were evil.

    This is why I’m on Lemmy posting content, we have to use open platforms if we want them to succeed. This is the first time I’ve used social media. I’m doing it as a civic duty

    • CrayonRosary@lemmy.world
      link
      fedilink
      English
      arrow-up
      0
      ·
      4 months ago

      When google started to index paywalled things…

      Google has (had?) a rule. If a site lets them index their paywalled content, then the site must deliver the full content if the referrer is google.com or else they will de-index the site. So when clicking a link on google, the full article should appear. It was an old trick to just google the article title to find a link and click through to read a paywalled article.

      Is that policy gone now?

      • jet@hackertalks.com
        link
        fedilink
        English
        arrow-up
        0
        ·
        4 months ago

        as far as i can tell that policy never existed. The first instance of this was for academic articles being indexed behind a paywall, and they NEVER worked with the referrer being google.

    • apfelwoiSchoppen@lemmy.world
      link
      fedilink
      English
      arrow-up
      0
      ·
      edit-2
      4 months ago

      "shouldn’t happen all the time on VPNs

      Safety and privacy for companies, but not for users. Just because it is, doesn’t mean it has to, or even should be.

      • dan@upvote.au
        link
        fedilink
        English
        arrow-up
        0
        ·
        4 months ago

        The issue with a VPN is that it’s likely that other people using the same exit node are doing something malicious. A site like reddit or a bank or whatever sees a lot of attacks coming from one IP (or a range of IPs) and mark it as malicious.

        You’d likely do the same thing with your own site - something like Denyhosts or Crowdsec that blocks people trying to brute force a password will end up blocking anyone else using that same VPN exit IP.

        • socialmedia@lemmy.world
          link
          fedilink
          English
          arrow-up
          0
          ·
          4 months ago

          Nobody is doing anything malicious. This didn’t start happening until reddit went public and decided to block their API.

          What’s probably happening is they’re worried too many requests are coming from one ip address and you might be scraping their precious data to train your LLM.

          If there was any justice their stock would be sliding further into the toilet because the first time anyone saw that notice they just quit going to the site entirely.

          • dan@upvote.au
            link
            fedilink
            English
            arrow-up
            0
            ·
            4 months ago

            Nobody is doing anything malicious.

            How do you know that though? VPNs are very commonly used to send spam, perform ransomware attacks, DDoS attacks, etc.

            What’s probably happening is they’re worried too many requests are coming from one ip address and you might be scraping their precious data to train your LLM.

            This is definitely also a possibility.

  • OpenStars@piefed.social
    link
    fedilink
    English
    arrow-up
    0
    ·
    4 months ago

    It did not used to be this way. Every website result used to be “cached”, but not anymore…

    Enshittification 😔

  • tyrant@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    ·
    4 months ago

    I just found a Firefox extension that let’s you open these blocked pages in archive. Pretty excited to bypass the bs of VPN blocks

  • Opinionhaver@feddit.uk
    link
    fedilink
    English
    arrow-up
    0
    ·
    4 months ago

    I get this too from time to time and usually refreshing my VPN fixes it. This is a bug of somekind.

    • southsamurai@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      0
      ·
      4 months ago

      they’re showing the links, but you can’t access them.

      It is the fault of the site being dicks, but the search engines make the problem more annoying

        • southsamurai@sh.itjust.works
          link
          fedilink
          English
          arrow-up
          0
          ·
          4 months ago

          Look, dick, you asked a question, I explained it.

          I’m not the guy that made the post, but that’s the reason it was mildly infuriating. You don’t have to like the reason, you don’t have to think it’s a good reason, but there’s no good reason for you to be a dick to someone answering your question.

          So, you know, fuck off

    • Jessica@discuss.tchncs.de
      link
      fedilink
      English
      arrow-up
      0
      ·
      4 months ago

      This is not a Reddit problem. A lot of websites throw a fucking hissy fit if you have a VPN turned on, and I’m also over it.

      • Aux@feddit.uk
        link
        fedilink
        English
        arrow-up
        0
        ·
        4 months ago

        There’s a good reason for that, VPNs are extensively used by bot networks for all kinds of activity. But VPN use by bots is actually coming down slowly as bot networks start to switch to residential mobile networks - it’s impossible to block them and you can cycle connections automatically like you do with VPN when using specialised residential mobile IP providers. So maybe web sites will stop blocking VPNs in a few years.

      • perishthethought@lemm.ee
        link
        fedilink
        English
        arrow-up
        0
        ·
        4 months ago

        Does anyone else remember back in the early days of the internet when experts used to say, “The internet routes around problems”.

        I miss those early days.

        To @daggermoon@lemmy.world , I see that a lot with searches now too but I just keep searching or find some other way around the problem. There’s no way I click in to Reddit any more. You do you, but I’m saying there’s always another option.

        • snooggums@lemmy.world
          link
          fedilink
          English
          arrow-up
          0
          ·
          4 months ago

          Honestly the internet will route around the loss of reddit just like it did with the loss of forums and other crowdsourced platforms that have died off over time. Yeah, we will lose a treasure trove of knowledge, but a lot of it was also outdated and the same questions will be asked again so the knowledge can be rebuilt.

          • Steven McTowelie@lemm.ee
            link
            fedilink
            English
            arrow-up
            0
            ·
            edit-2
            4 months ago

            Reddit is definitely not the final evolution of the internet board. It goes without saying that we can do better. And when a better iteration comes along nobody will even need to ask the Reddit users to switch as theyll naturally migrate as we always have. And then eventually that thing will be decrowned for something better too

      • CompactFlax@discuss.tchncs.de
        link
        fedilink
        English
        arrow-up
        0
        ·
        4 months ago

        That’s the problem isn’t it? We used to have forums where people discus things and blogs where people share what they’ve learned, now it is all Reddit and discord and absolute trash in between.

        • UnderpantsWeevil@lemmy.world
          link
          fedilink
          English
          arrow-up
          0
          ·
          4 months ago

          We still have forums and blogs. Search engines just don’t both including them in search results.

          You need to know about these niche communities, which are increasingly in micro-spaces like Discord or Mastodon channels or unmonitored communities like Lemmy.

          Which is more in line with Bad Old Web 1.0 than Good Old Web 1.5

          • CompactFlax@discuss.tchncs.de
            link
            fedilink
            English
            arrow-up
            0
            ·
            4 months ago

            They’re there, but harder to find. And some are closing. I’ve had two or three in the last couple years that closed, in the reasonably popular world of cars.

          • snooggums@lemmy.world
            link
            fedilink
            English
            arrow-up
            0
            ·
            4 months ago

            Discord is like gated communities on the internet. Not open to the public and not something that is publically indexed.

            It isn’t even comparable to mastadon or lemmy when it comes to being a source of information.

      • tal@lemmy.today
        link
        fedilink
        English
        arrow-up
        0
        ·
        edit-2
        4 months ago

        It was the only search result relevant to my query.

        Paste it into archive.org’s Wayback Machine. Good odds that they’ve stored a copy. I’d do it for you and just link to the page, but you don’t list the URL…

        https://web.archive.org/

        • Tyoda@lemm.ee
          link
          fedilink
          English
          arrow-up
          0
          ·
          4 months ago

          IME the wayback machine might give you the post body. I tend to need the comments as well, and archive.today can save all that properly. It usually isn’t saved already, so you’ll have to wait a minute or two. I just use this time to look for other sources.

      • LostXOR@fedia.io
        link
        fedilink
        arrow-up
        0
        ·
        4 months ago

        Careful! That almost sounds like promoting violence, and that won’t fly with our advertisers! You have to say, uh, Spez deserves to be unalived.

    • CarrotsHaveEars@lemmy.ml
      link
      fedilink
      English
      arrow-up
      0
      ·
      4 months ago

      Sometimes part of the content can be seen in the search result page, as the crawler got the content. But when you click inside, you’re blocked by the membership wall. Irony?