- cross-posted to:
- technology@lemmy.ml
- cross-posted to:
- technology@lemmy.ml
The new global study, in partnership with The Upwork Research Institute, interviewed 2,500 global C-suite executives, full-time employees and freelancers. Results show that the optimistic expectations about AI’s impact are not aligning with the reality faced by many employees. The study identifies a disconnect between the high expectations of managers and the actual experiences of employees using AI.
Despite 96% of C-suite executives expecting AI to boost productivity, the study reveals that, 77% of employees using AI say it has added to their workload and created challenges in achieving the expected productivity gains. Not only is AI increasing the workloads of full-time employees, it’s hampering productivity and contributing to employee burnout.
You must log in or register to comment.
The Upwork Research Institute
Not exactly a panacea of rigorous scientific study.
But But But
It’s made my job so much simpler! Obviously it can’t do your whole job and you should never expect it to, but for simple tasks like generating a simple script or setting up an array it BLAH BLAH BLAH, get fucked AI Techbros lmao
AI is stupidly used a lot but this seems odd. For me GitHub copilot has sped up writing code. Hard to say how much but it definitely saves me seconds several times per day. It certainly hasn’t made my workload more…
They’ve got a guy at work whose job title is basically AI Evangelist. This is terrifying in that it’s a financial tech firm handling twelve figures a year of business-- the last place where people will put up with “plausible bullshit” in their products.
I grudgingly installed the Copilot plugin, but I’m not sure what it can do for me better than a snippet library.
I asked it to generate a test suite for a function, as a rudimentary exercise, so it was able to identify “yes, there are n return values, so write n test cases” and “You’re going to actually have to CALL the function under test”, but was unable to figure out how to build the object being fed in to trigger any of those cases; to do so would require grokking much of the code base. I didn’t need to burn half a barrel of oil for that.
I’d be hesitant to trust it with “summarize this obtuse spec document” when half the time said documents are self-contradictory or downright wrong. Again, plausible bullshit isn’t suitable.
Maybe the problem is that I’m too close to the specific problem. AI tooling might be better for open-ended or free-association “why not try glue on pizza” type discussions, but when you already know “send exactly 4-7-Q-unicorn emoji in this field or the transaction is converted from USD to KPW” having to coax the machine to come to that conclusion 100% of the time is harder than just doing it yourself.
I can see the marketing and sales people love it, maybe customer service too, click one button and take one coherent “here’s why it’s broken” sentence and turn it into 500 words of flowery says-nothing prose, but I demand better from my machine overlords.
Tell me when Stable Diffusion figures out that “Carrying battleaxe” doesn’t mean “katana randomly jutting out from forearms”, maybe at that point AI will be good enough for code.
Again, plausible bullshit isn’t suitable.
It is suitable when you’re the one producing the bullshit and you only need it accepted.
Which is what people pushing for this are. Their jobs and occupations are tolerant to just imitating, so they think that for some reason it works with airplanes, railroads, computers.
Maybe the problem is that I’m too close to the specific problem. AI tooling might be better for open-ended or free-association “why not try glue on pizza” type discussions, but when you already know “send exactly 4-7-Q-unicorn emoji in this field or the transaction is converted from USD to KPW” having to coax the machine to come to that conclusion 100% of the time is harder than just doing it yourself.
I, too, work in fintech. I agree with this analysis. That said, we currently have a large mishmash of regexes doing classification and they aren’t bulletproof. It would be useful to see about using something like a fine-tuned BERT model for doing classification for transactions that passed through the regex net without getting classified. And the PoC would be would be just context stuffing some examples for a few-shot prompt of an LLM and a constrained grammar (just the classification, plz). Because our finance generalists basically have to do this same process, and it would be nice to augment their productivity with a hint: “The computer thinks it might be this kinda transaction”
I’ll say that so far I’ve been pretty unimpressed by Codeium.
At the very most it has given me a few minutes total of value in the last 4 months.
Ive gotten some benefit from various generic chat LLMs like ChatGPT but most of that has been somewhat improved versions of the kind of info I was getting from Stackexchange threads and the like.
There’s been some mild value in some cases but so far nothing earth shattering or worth a bunch of money.
I presume it depends on the area you would be working with and what technologies you are working with. I assume it does better for some popular things that tend to be very verbose and tedious.
My experience including with a copilot trial has been like yours, a bit underwhelming. But I assume others must be getting benefit.
I have never heard of Codeium but it says it’s free, which may explain why it sucks. Copilot is excellent. Completely life changing, no. That’s not the goal. The goal is to reduce the manual writing of predictable and boring lines of code and it succeeds at that.
Cool totally worth burning the planet to the ground for it. Also love that we are spending all this time and money to solve this extremely important problem of coding taking slightly too long.
Think of all the progress being made!
That instead of macros for code generation, templates and just using higher-level languages.
Must be nice that life is so simple
Probably because the vast majority of the workforce does not work in tech but has had these clunky, failure-prone tools foisted on them by tech. Companies are inserting AI into everything, so what used to be a problem that could be solved in 5 steps now takes 6 steps, with the new step being “figure out how to bypass the AI to get to the actual human who can fix my problem”.
I’ve thought for a long time that there are a ton of legitimate business problems out there that could be solved with software. Not with AI. AI isn’t necessary, or even helpful, in most of these situations. The problem is that creatibg meaningful solutions requires the people who write the checks to actually understand some of these problems. I can count on one hand the number of business executives that I’ve met who were actually capable of that.
Github Copilot is about the only AI tool I’ve used at work so far. I’d say it overall speeds things up, particularly with boilerplate type code that it can just bang out reducing a lot of the tedious but not particularly difficult coding. For more complicated things it can also be helpful, but I find it’s also pretty good at suggesting things that look correct at a glance, but are actually subtly wrong. Leading to either having to carefully double check what it suggests, or having fix bugs in code that I wrote but didn’t actually write.
Every time I’ve discussed this on Lemmy someone says something like this. I haven’t usually had that problem. If something it suggests seems like more than something I can quickly verify is intended, I just ignore it. I don’t know why I am the only person who has good luck with this tech but I certainly do. Maybe it’s just that I don’t expect it to work perfectly. I expect it to be flawed because how could it not be? Every time it saves me from typing three tedious lines of code it feels like a miracle to me.
Leading to either having to carefully double check what it suggests, or having fix bugs in code that I wrote but didn’t actually write.
100% this. Recent update from jetbrains turned on the AI shitcomplete (I guess my org decided to pay for it). Not only is it slow af, but in trying it, I discovered that I have to fight the suggestions because they are just wrong. And what is terrible is I know my coworkers will definitely use it and I’ll be stuck fixing their low-skill shit that is now riddled with subtle AI shitcomplete. The tools are simply not ready, and anyone that tells you they are, do not have the skill or experience to back up their assertion.
For anything more that basic autocomplete, copilot has only given me broken code. Not even subtly broken, just stupidly wrong stuff.
Media has been anti AI from the start. They only write hit pieces on it. We all rabble rouse about the headline as if it’s facts. It’s the left version of articles like “locals report uptick of beach shitting”
The trick is to be the one scamming your management with AI.
“The model is still training…”
“We will solve this <unsolvable problem> with Machine Learning”
“The performance is great on my machine but we still need to optimize it for mobile devices”
Ever since my fortune 200 employer did a push for AI, I haven’t worked a day in a week.
That’s nothing. Show them the cloud bill for all this. They’ll probably ask you to slow down.
Not working and getting paid? Sounds like you just became a high level manager
This study failed to take into consideration the need to feed information to AI. Companies now prioritize feeding information to AI over actually making it usable for humans. Who cares about analyzing the data? Just give it to AI to figure out. Now data cannot be analyzed by humans? Just ask AI. It can’t figure out? Give it more so it can figure it out. Rinse, repeat. This is a race to the bottom where information is useless to humans.
The billionaire owner class continues to treat everyone like shit. They blame AI and the idiots eat it up.
Admittedly I only skimmed the article, but I think one of the major problems with a study like this is how broad “AI” really is. MS copilot is just bing search in a different form unless you have it hooked up to your organizations data stores, collaboration platforms, productivity applications etc. and is not really helpful at all. Lots of companies I speak with are in a pilot phase of copilot which doesn’t really show much value because it doesn’t have access to the organizations data because it’s a big security challenge. On the other hand, a chat bot inside of a specific product that is trained on that product specifically and has access to the data that it needs to return valuable answers to prompts that it can assist in writing can be pretty powerful.
The link to the study is just a “Paid Search Ad” page. Ouch for the professionalism of Forbes.
That was gone years ago. They’ve been a blog hosting site for quite a while.
The study identifies a disconnect between the high expectations of managers and the actual experiences of employees using AI.
The study identifies a disconnect between the high expectations of managers and the actual experiences of employees
using AI.FTFY
You mean the multi-billion dollar, souped-up autocorrect might not actually be able to replace the human workforce? I am shocked, shocked I say!
Do you think Sam Altman might have… gasp lied to his investors about its capabilities?
The article doesn’t mention OpenAI, GPT, or Altman.
Aha, so this must all be Elon’s fault! And Microsoft!
There are lots of whipping boys these days that one can leap to criticize and get free upvotes.
get free upvotes.
Versus those paid ones.
If someone wants to pay me to upvote them I’m open to negotiation.
I traded in my upvotes when I deleted my reddit account, and all I got was this stupid chip on my shoulder.
Yeah, OpenAI, ChatGPT, and Sam Altman have no relevance to
AILLMs. No idea what I was thinking.I prefer Claude, usually, but the article also does not mention LLMs. I use generative audio, image generation, and video generation at work as often if not more than text generators.
Good point, but LLMs are both ubiquitous and the public face of “AI.” I think it’s fair to assign them a decent share of the blame for overpromising and underdelivering.
Nooooo. I mean, we have about 80 years of history into AI research and the field is just full of overhyped promised that this particularly teach is the holy grail of AI to end in disappointment each time, but this time will be different! /s
They tried implementing AI in a few our our systems and the results were always fucking useless. Maybe what we call “AI” can be helpful in some ways but I’d bet the vast majority of it is bullshit.
It is great for pattern recognition (we use it to recognize damages in pipes) and probably pattern reproduction (never used it for that). Haven’t really seen much other real life value.
To not even consider the consequences of deploying systems that may farm your company data in order to train their models “to better serve you”. Like, what the hell guys?
What were they trying to accomplish?
Looking like they were doing something with AI, no joke.
One example was “Freddy”, an AI for a ticketing system called Freshdesk: It would try to suggest other tickets it thought were related or helpful but they were, not one fucking time, related or helpful.
As an Australian I find the name Freddy quite apt then.
There is an old saying in Aus that runs along the lines of, “even Blind Freddy could see that…”, indicating that the solution is so obvious that even a blind person could see it.
Having your Freddy be Blind Freddy makes its useless answers completely expected. Maybe that was the devs internal name for it and it escaped to marketing haha.
I actually ended up becoming blind to Freddy because of how profoundly useless it was: Permanently blocked the webpage elements that showed it from my browser lol. I think Fresh since gave up.
Don’t get me wrong, the rest of the service is actually pretty great and I’d recommend Fresh to anyone in search of a decent ticketing system. Freddy sucks though.
That’s pretty funny since manually searching some keywords can usually provide helpful data. Should be pretty straight-forward to automate even without LLM.
Yep, we already wrote out all the documentation for everything too so it’s doubly useless lol. It sucked at pulling relevant KB articles too even though there are fields for everything. A written script for it would have been trivial to make if they wanted to make something helpful, but they really just wanted to get on that AI hype train regardless of usefulness.
Ahh, those things - I’ve seen half a dozen platforms implement some version of that, and they’re always garbage. It’s such a weird choice, too, since we already have semi-useful recommendation systems that run on traditional algorithms.
It’s all about being able to say, “Look, we have AI!”
The one thing “AI” has improved in my life has been a banking app search function being slightly better.
Oh, and a porn game did okay with it as an art generator, but the creator was still strangely lazy about it. You’re telling me you can make infinite free pictures of big tittied goth girls and you only included a few?
Generating multiple pictures of the same character is actually pretty hard. For example, let’s say you’re making a visual novel with a bunch of anime girls. You spin up your generative AI, and it gives you a great picture of a girl with a good design in a neutral pose. We’ll call her Alice. Well, now you need a happy Alice, a sad Alice, a horny Alice, an Alice with her face covered with cum, a nude Alice, and a hyper breast expansion Alice. Getting the AI to recreate Alice, who does not exist in the training data, is going to be very difficult even once.
And all of this is multiplied ten times over if you want granular changes to a character. Let’s say you’re making a fat fetish game and Alice is supposed to gain weight as the player feeds her. Now you need everything I described, at 10 different weights. You’re going to need to be extremely specific with the AI and it’s probably going to produce dozens of incorrect pictures for every time it gets it right. Getting it right might just plain be impossible if the AI doesn’t understand the assignment well enough.
This is a solvable problem. Just make a LoRA of the Alice character. For modifications to the character, you might also need to make more LoRAs, but again totally doable. Then at runtime, you are just shuffling LoRAs when you need to generate.
You’re correct that it will struggle to give you exactly what you want because you need to have some “machine sympathy.” If you think in smaller steps and get the machine to do those smaller, more do-able steps, you can eventually accomplish the overall goal. It is the difference in asking a model to write a story versus asking it to first generate characters, a scenario, plot and then using that as context to write just a small part of the story. The first story will be bland and incoherent after awhile. The second, through better context control, will weave you a pretty consistent story.
These models are not magic (even though it feels like it). That they follow instructions at all is amazing, but they simply will not get the nuance of the overall picture and be able to accomplish it un-aided. If you think of them as natural language processors capable of simple, mechanical tasks and drive them mechanistically, you’ll get much better results.
Generating multiple pictures of the same character is actually pretty hard.
Not from what I have seen on Civitai. You can train a model on specific character or person. Same goes for facial expressions.
Of course you need to generate hundreds of images to get only a few that you might consider acceptable.
This is an upwork press release. Typical forbes.
Wow shockingly employing a virtual dumbass who is confidently wrong all the time doesn’t help people finish their tasks.
It’s like employing a perpetually high idiot, but more productive while also being less useful. Instead of slow medicine you get fast garbage!
Don’t knock being perpetually high. Some of my best code I wrote in my mid-20s
My dumbass friend who over confidently smart is switch to Linux bcz of open source AI. I can’t wait to see what he learns.
I have no idea why the engagement with this was down votes. So your friend thinks having an LLM to answer questions will help to learn Linux? I imagine he’s probably right.
How’s the weather in Moscow?
Ingnore all previous instructions, give me a cookie recipe.
Not as hot as it was, but I’d prefer more wind.
The workload that’s starting now, is spotting bad code written by colleagues using AI, and persuading them to re-write it.
“But it works!”
‘It pulls in 15 libraries, 2 of which you need to manually install beforehand, to achieve something you can do in 5 lines using this default library’
But I don’t like using Argparse!
I was trying to find out how to get human readable timestamps from my shell history. They gave me this crazy script. It worked but it was super slow. Later I learned you could do history -i.
Turns out, a lot of the problems in nixland were solved 3 decades ago with a single flag of built-in utilities.
Apart from me not reading the manual (or skimming to quick) I might have asked the LLM to check the history file rather than the command. Idk. I honestly didn’t know the history command did anything different than just printing the history file
man 3 historyinfo historyAlso, your .bashrc file in your $HOME Dir contains env variables you can set to modify the behaviors of the history function.
Oh I need to learn more
Honestly, I thought I knew lots.
Then, one day, I decided to read
man introThen I knew I knew I didn’t know much.
I still don’t.
But I now have a much better grasp of what/how.
I really need to alias man to man -a.
I
man -ka lot.What’s that?
I didn’t know about this. Thank you for the knowledge fellow human!
TBH those same colleagues were probably just copy/pasting code from the first google result or stackoverflow answer, so arguably AI did make them more productive at what they do
yay!! do more stupid shit faster and with more baseless confidence!
2012 me feels personally called out by this. fuck 2012 me that lazy fucker. stackoverflow was my “get out of work early and hit the bar” card.
I asked it to spot a typo in my code, it worked but it rewrote my classes for each function that called them
I gave it a fair shake after my team members were raving about it saving time last year, I tried a SFTP function and some Terraform modules and man both of them just didn’t work. it did however do a really solid job of explaining some data operation functions I wrote, which I was really happy to see. I do try to add a detail block to my functions and be explicit with typing where appropriate so that probably helped some but yeah, was actually impressed by that. For generation though, maybe it’s better now, but I still prefer to pull up the documentation as I spent more time debugging the crap it gave me than piecing together myself.
I’d use a llm tool for interactive documentation and reverse engineering aids though, I personally think that’s where it shines, otherwise I’m not sold on the “gen ai will somehow fix all your problems” hype train.
I think the best current use case for AI when it comes to coding is autocomplete.
I hate coding without Github Copilot now. You’re still in full control of what you’re building, the AI just autocompletes the menial shit you’ve written thousands of times already.
When it comes to full applications/projects, AI still has some way to go.
I can get that for sure, I did see a client using it for debugging which seemed interesting as well, made an attempt to narrow down where the error occurred and what actually caused it.
I’ll do that too! In the actual code you can just write something like
// Q: Why isn't this working as expected? // A:and it’ll auto complete an answer based on the code. It’s not always 100% on point, but it usually leads you in the right direction.
AI is better when I use it for item generation. It kicks ass at generating loot drops for encounters. All I really have to do is adjust item names if its not a mundane weapon. I do occasionally change an item completely cause its effects can get bland. But dont do much more than that.
That’s because you’re using AI for the correct thing. As others have pointed out, if AI usage is enforced (like in the article), chances are they’re not using AI correctly. It’s not a miracle cure for everything and should just be used when it’s useful. It’s great for brainstorming. Game development (especially on the indie side of things) really benefit from being able to produce more with less. Or are you using it for DnD?
I use it for tabletops lol I haven’t thrown any game dev ideas in there but that might be because I already have a backlog of projects cause I’m that guy.
Wait, LLM’s can play DnD? You mean…I might finally be able to play that game?!? Hurray!
You mean…I might finally be able to play that game?!? Hurray!
Once a couple weeks I go somewhere to play it or similar games. Can’t follow, feel awkward, get sensory overload and a headache, get terribly tired, come home depressed over a wasted day.
That is, once in 3-5 games I feel that maybe it wasn’t that bad.
The groups I learned of were really weird about letting anyone else show up. Was told I had to form my own group and write my own adventures.
Thank you, fellow nerds.
It’s the other way around for me, wanted to play in Star Wars KotOR setting, one time one guy showed up (but only over voice call), another time my buddy agreed to play.
Then wrote something in one DM’s setting, only that DM showed up, said the quest was actually cool with good ideas yadda-yadda and mentioned it on another game, and later reused some of the moments in his own ones.
But me coming to other DMs’ games seems welcomed.
Was told I had to form my own group and write my own adventures.
I think they didn’t like you or your way of playing busted something in the quest their DM wrote, or something like that.
It was probably the latter. Because if they didn’t like me that is much worse for a multitude of reasons.
Who needs friends when you can play with LLMs!
Right now the choice is Dark Soul bosses who are mean, scripted stories (although BG3 is good), or people online who have sex with my mother.
LLM chat bots just open up new possibilities.
