lemmy.mlaga97.space
  • Communities
  • Create Post
  • Create Community
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
Andy Reid@lemmy.world to Technology@lemmy.worldEnglish · 1 year ago

AI companies are violating a basic social contract of the web and and ignoring robots.txt

www.theverge.com

external-link
message-square
196
fedilink
  • cross-posted to:
  • technology@beehaw.org
0
external-link

AI companies are violating a basic social contract of the web and and ignoring robots.txt

www.theverge.com

Andy Reid@lemmy.world to Technology@lemmy.worldEnglish · 1 year ago
message-square
196
fedilink
  • cross-posted to:
  • technology@beehaw.org
The rise and fall of robots.txt
www.theverge.com
external-link
As unscrupulous AI companies crawl for more and more data, the basic social contract of the web is falling apart.
  • circuitfarmer@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    ·
    1 year ago

    Most every other social contract has been violated already. If they don’t ignore robots.txt, what is left to violate?? Hmm??

    • olympicyes@lemmy.world
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 year ago

    • BlanketsWithSmallpox@lemmy.world
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 year ago

      It’s almost as if leaving things to social contracts vs regulating them is bad for the layperson… 🤔

      Nah fuck it. The market will regulate itself! Tax is theft and I don’t want that raise or I’ll get in a higher tax bracket and make less!

      • KairuByte@lemmy.dbzer0.com
        link
        fedilink
        English
        arrow-up
        0
        ·
        1 year ago

        God the number of people I’ve heard say this over the years is nuts.

      • Ogmios@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        0
        ·
        1 year ago

        Yea, because authoritarianism is well known to be sooooo good for the layperson.

        • Jimmyeatsausage@lemmy.world
          link
          fedilink
          English
          arrow-up
          0
          ·
          1 year ago

          Ah yes, equal protection under the law… the true hallmark of an authoritarian regime.

          • Ogmios@sh.itjust.works
            link
            fedilink
            English
            arrow-up
            0
            ·
            edit-2
            1 year ago

            Harrison Bergeron

            • Jimmyeatsausage@lemmy.world
              link
              fedilink
              English
              arrow-up
              0
              ·
              1 year ago

              Fiction can be fun!

      • JackGreenEarth@lemm.ee
        link
        fedilink
        English
        arrow-up
        0
        ·
        1 year ago

        I got it was sarcasm, but it’s always good to add a /s just in case

      • SlopppyEngineer@lemmy.world
        link
        fedilink
        English
        arrow-up
        0
        ·
        1 year ago

        And then the companies hit the “trust thermocline”, customers leave them in droves and companies wonder how this could’ve happened.

      • Jimmyeatsausage@lemmy.world
        link
        fedilink
        English
        arrow-up
        0
        ·
        edit-2
        1 year ago

        This can actually be an issue for poor people, not because of tax brackets but because of income-based assistance cutoffs. If $1/hr raise throws you above those cutoffs, that extra $160 could cost you $500 in food assistance, $5-$10/day for school lunch, or get you kicked out of government subsidied housing.

        Yet another form of persecution that the poor actually suffer and the rich pretend to.

Technology@lemmy.world

technology@lemmy.world

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !technology@lemmy.world

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


  • @L4s@lemmy.world
  • @autotldr@lemmings.world
  • @PipedLinkBot@feddit.rocks
  • @wikibot@lemmy.world
Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 812 users / day
  • 1.92K users / week
  • 5.34K users / month
  • 14K users / 6 months
  • 0 local subscribers
  • 72.5K subscribers
  • 13.9K Posts
  • 438K Comments
  • Modlog
  • mods:
  • L3s@lemmy.world
  • enu@lemmy.world
  • Technopagan@lemmy.world
  • L4sBot@lemmy.world
  • L3s@hackingne.ws
  • L4s@hackingne.ws
  • BE: 0.19.5
  • Modlog
  • Instances
  • Docs
  • Code
  • join-lemmy.org