Don’t learn to code: Nvidia’s founder Jensen Huang advises a different career path::Don’t learn to code advises Jensen Huang of Nvidia. Thanks to AI everybody will soon become a capable programmer simply using human language.
I don’t think he’s seen the absolute fucking drivel that most developers have been given as software specs before now.
Most people don’t even know what they want, let alone be able to describe it. I’ve often been given a mountain of stuff, only to go back and forth with the customer to figure out what problem they’re actually trying to solve, and then do it in like 3 lines of code in a way that doesn’t break everything else, or tie a maintenance albatross around my neck for the next ten years.
Yesterday, I had to deal with a client that literally contradicted himself 3 times in 20 minutes, about whether a specific Date field should be obligatory or not. My boss and a colleague who were nearby started laughing once the client went away, partly because I was visibly annoyed at the indecision.
And that’s really what all these guys saying “AI will take er jobs” don’t understand. Good programmers are not just good coders, coding is really the easy part. They’re also good analysts and listeners. I understand what he’s saying - if you spend time accruing specific domain knowledge instead of computer science then you can perhaps make better, bespoke solutions because the “coding” can be handled by AI. But in present day, AI makes garbage code all the time and you’ll be left there not being able to do amything about it because it doesn’t make any sense to you. So who do you call? Someone who can code. Even if we get to this hypothetical dream scenario where you tell an AI to do something and it just does it perfect (gigantic IF), who’s making that AI? The interface for it? The important safety nets to make sure it doesn’t go on a rampage? Itself? Too much context is already lost in conversations between humans, let alone an AI. I can think of one kind of AI that would be able to do it perfectly though (assuming AIs could be perfected, that is), and that’s an AI pre-equipped with full understanding of the domain. But then in that case, why do you need the human in the mix at all?
You remember when everyone was predicting that we are a couple of years away from fully self-driving cars. I think we are now a full decade after those couple of years and I don’t see any fully self driving car on the road taking over human drivers.
We are now at the honeymoon of the AI and I can only assume that there would be a huge downward correction of some AI stocks who are overvalued and overhyped, like NVIDIA. They are like crypto stock, now on the moon tomorrow, back to Earth.
Quantuum computing is going to make all encryption useless!! Muwahahahahaaa!
. . . Any day now . . Maybe- ah! No, no thought this might be the day, but no, not yet.
Any day now.
If you’re able to break everybody’s encryption, why would you tell anybody?
Waymo exists and is now moving passengers around in three major cities. It’s not taking over yet, but it’s here and growing.The timeframe didn’t meet the hype but the technology is there.
Yes, the technology is there but it is not Level 5, it is 3.5-4 at best.
The point with a full self-driving car is that complexity increases exponentially once you reach 98-99% and the last 1-2% are extremely difficult to crack, because there are so many corner cases and cases you can’t really predict and you need to make a car that drives safer than humans if you really want to commercialize this service.
Same with generative AI, the leap at first was huge, but comparing GPT 3.5 to 4 or even 3 to 4 wasn’t so great. And I can only assume that from now on achieving progress will get exponentially harder and it will require usage of different yet unknown algorithms and models and advances will be a lot more modest.
And I don’t know for you but ChatGPT isn’t 100% correct especially when asking more niche questions or sending more complex queries and often it hallucinates and sometimes those hallucinations sound extremely plausible.
Two decades. DARPA Grand Challenge was in 2004.
Yeah, everybody always forgets the hyper cycle and the peak of inflated expectations.
I think the Jensen quote loosley implies we don’t need to learn a programming language but the logic was flimsy. Same goes for the author as they backtrack a few times. Not a great article in my opinion.
Jensen’s just trying to ride the AI bubble as far as itll go, next hell tell you to forget about driving or studying
the day programming is fully automated, so will other jobs.
At best, in the near term (5-10 years), they’ll automate the ability to generate moderate complexity classes and it’ll be up to a human developer to piece them together into a workable application, likely having to tweak things to get it working (this is already possible now with varying degrees of success/utter failure, but it’s steadily improving all the time). Additionally, developers do far more than just purely code. Ask any mature dev team and those who have no other competent skills outside of coding aren’t considered good workers/teammates.
Now, in 10+ years, if progress continues as it has without a break in pace… Who knows? But I agree with you, by the time that happens with high complexity/high reliability for software development, numerous other job fields will have already become automated. This is why legislation needs to be made to plan for this inevitability. Whether that’s thru UBI or some offshoot of it or even banning automation from replacing major job fields, it needs to be seriously discussed and acted upon before it’s too little too late.
Human can probably still look forward to back breaking careers of manual labor that consist of complex varied movements!
Humans wear out rather quickly compared to robots
Humans can be cheaper than robots if properly exploited!
Finally someone gets it! Gets where we are heading that is.
There’s good money to be made in selling leather jackets.
Don’t listen to electrical engineers, unless they are warning against licking a battery.
Do listen to whatever your gut says you want to do for a career.
Do learn to use AI in some fashion, even if for shits and giggles.
I use “AI” when I work. It’s like having a really smart person who knows a bit about everything available 24/7 with useful responses. Sure, it’s not all right, but it usually leads me down the path to solving my problem a lot faster than I could with “Googling.” Remember Google? What a joke.
It’s hallucinating garbage wrapped in over hyped marketing
I think it‘s less of a really smart person and more of a very knowledgeable person with an inflated ego so you take everything they say with a grain of salt. Useful nonetheless.
I think a colleague of mine made a great comparison: It’s like having access to a thousand junior devs who can reply really fast.
This. The technology is here to stay and will literally change the world. In a few years when the Sora and SD3 models are released and well understood, and desktop GPUs begin offering 24GB vram to midrange cards out of demand, it will be crazier than we can imagine. LLMs are already near human level with enough compute. As tech gets faster and commoditized, everyone becomes and artist and a programmer. Information will no longer be trusted, and digital verification technology will proliferate.
Invest now.
That and nuclear batteries capable of running pi like machines for decades. 1w is on the horizon by BetaVolt.
Unique style paintings will become even more valuable in the future. Generative AI only spews “art” based on previous styles it learned / was trained on. Everything will be even more rehashed than it is today (nod to Everything is a Remix). Having a painting made by an actual human hand on your wall will be more ego-boosting than an AI generated one.
Sure, for general digital art (ie logos, game character design, etc) when uniqueness isn’t really mandatory, AI is a good, very cheap tool.
As for the “everyone becomes a programmer” part… naah.
Having a painting made by an actual human hand on your wall will be more ego-boosting
Nothing really changes, this has always been the case.
I’m not sure why you’re being downvoted. I don’t think the current technology is going to replace programmers or artists any time soon (speaking as someone who works as an artist and programmer in a field that monitors ai and its uses) but I also acknowledge that my guess is as good as yours.
I don’t think it’s going to replace artists because as impressive as the demos we all see are, inevitably, whenever I’ve done any thorough testing, every AI model fails at coming up with something new. It’s so held back by what it’s trained on, that to contemplate it replacing an artist - who are very capable of imagining new things - seems absurd to me.
Same with programming - ask for something it doesn’t know about and it’ll lie and make something up and confidently proclaim it as truth. It can’t fact check itself and so I can only see it as a time saving tool for professionals and a really cool way for hobbyists to get results that were otherwise off the table.
I cant speak for certain about generating art, I’m no artist and my limit of experience there is playing around with stable diffusion, but it feels like its in the same place as LLMs for programming. Its incredibly impressive at first but once you’ve used it for a bit the flaws become obvious. It will be a very powerful tool for artists to use, just like LLMs are for programming, and will likely significantly decrease the time needed to produce something, but is nowhere near replacing a human entirely.
Yeah, for art it’s similar, you can get some really compelling results, but once tasked with creating something a bit too specific it ends up wasting your time more than anything.
There’s definitely uses for it and it’s really cool, but I don’t think it’s as close to replacing professionals as some people think.
Just being a stickler here but Electronics Engineers, not Electrical. Similar sounding but like the difference between a submarine captain and an airplane captain.
It’s not really about the coding, it’s about the process of solving the problem. And ai is very far away from being able to do that. The language you learn to code in is probably not the one you will use much of you life. It will just get replaced by which ai you will use to code.
Yep. The best guy on my team isn’t the best coder. He’s the best at visualizing the complete solution and seeing pinch points in his head.
This overglorified snake oil salesmanman is scared.
Anyone who understands how these models works can see plain as day we have reached peak LLM. Its not enshitifying on itself and we are seeing its decline in real time with quality of generated content. Dont believe me? Go follow some senior engineers.
Why do you think we’ve reached peak LLM? There are so many areas with room for improvement
You asked the question already answered. Pick your platform and you will find a lot of public research on the topic. Specifically for programming even more so
Any recommendations whom to follow? On Mastodon?
There is a reason they didn’t offer specific examples. LLM can still scale by size, logical optimization, training optimization, and more importantly integration. The current implementation is reaching it’s limits but pace of growth is also happening very quickly. AI reduces workload, but it is likely going to require designers and validators for a long time.
For sure evidence is mounting that model size benefit is not returning the quality expected. Its also had the larger net impact of enshitifying itself with negative feedback loops between training data, humans and back to training. This one being quantified as a large declining trend in quality. It can only get worse as privacy, IP laws and other regulations start coming into place. The growth this hype master is selling is pure fiction.
But he has a lot of product to sell.
And companies will gobble it all up.
On an unrelated note, I will never own a new graphics card.
Secondhand is better value, still new cost right now is nothing short of price fixing. You only need look at the size reduction in memory since A100 was released to know what’s happening to gpu’s.
We need serious competition, hopefully intel is able to but foreign competition would be best.
I doubt that any serious competitor will bring any change to this space. Why would it - everyone will scream ‘shut up and take my money’.
I think you answered your own question: money
Fediverse is sadly not as popular as we would like sorry cant help here. That said i follow some researchers blogs and a quick search should land you with some good sources depending on your field of interest
I don’t see how it would be possible to completely replace programmers. The reason we have programming languages instead of using natural language is that the latter has ambiguities. If you start having to describe your software’s behaviour in natural language, then one of three things can happen:
- either this new natural programming language has to make assumptions about what you intend, and thus will only be capable of outputting a certain class of software (i.e. you can’t actually create anything new),
- or you need to learn a new way of describing things unambiguously, and now you’re back to programming but with a new language,
- or you spend forever going back and forth with the generator until it gives you the output you want, and this would take a lot longer to do than just having an experienced programmer write it.
But that’s not what the article is getting at.
Here’s an honest take. Let me preface this with some credential: I’m an AI Engineer with many years in field. I’m directly working on right now multiple projects that augment and automate code generation, documentation, completion and even system design/understanding. We’re not there yet. But the pace of progress in how fast we are improving our code-AI is astounding. Exponential growth in capability and accuracy and utility.
As an anecdotal example; a few years ago I decided I would try to learn Rust (programming language), because it seemed interesting and we had a practical use case for a performant, memory-efficient compiled language. It didn’t really work out for me, tbh. I just didn’t have the time to get very fluent with it enough to be effective.
Now I’m on a project which also uses Rust. But with ChatGPT and some other models I’ve deployed (Mixtral is really good!) I was basically writing correct, effective Rust code within a week—accepted and merged to main.
I’m actively using AI code models to write code to train, fine-tune, and deploy AI code models. See where this is going? That’s exponential growth.
I honestly don’t know if I’d recommend to my young kids programming as a career now even if it has been very lucrative for me and will take me to my retirement just fine. It excites me and scares me at the same time.
There is more to a program then writing logic. Good engineers are people who understand how to interpret problems and translate the inherent lack of logic in natural language into something that machines are able to understand (or vice versa).
The models out there right now can truly accelerate the speed of that translation - but translation will still be needed.
An anecdote for an anecdote. Part of my job is maintaining a set of EKS clusters where downtime is… undesirable (five nines…). I actively use chatgpt and copilot when adjusting the code that describes the clusters - however these tools are not able to understand and explain impacts of things like upgrading the control plane. For that you need a human who can interpret the needs/hopes/desires/etc of the stakeholders.
Yeah I get it 100%. But that’s what I’m saying. I’m already working on and with models that have entire codebase level fine-tuning and understanding. The company I work at is not the first pioneer in this space. Problem understanding and interpretation— all of what you said is true— there are causal models being developed (I am aware of one team in my company doing exactly that) to address that side of software engineering.
So. I don’t think we are really disagreeing here. Yes, clearly AI models aren’t eliminating humans from software today; but I also really don’t think that day is all that far away. And there will always be need for humans to build systems that serve humans; but the way we do it is going to change so fundamentally that “learn C, learn Rust, learn Python” will all be obsolete sentiments of a bygone era.
Let’s be clear - current AI models are being used by poor leadership to remove bad developers (good ones don’t tend to stick around). This however does place some pressure on the greater tech job market (but I’d argue no different then any other downturn we have all lived through).
That said, until the issues with being confidently incorrect are resolved (and I bet people a lot smarter then me are tackling the problem) it’s nothing better then a suped up IDE. Now if you have a public resources you can point me to that can look at a meta repo full of dozens of tools and help me convert the python scripts that are wrappers of wrappers( and so on) into something sane I’m all ears.
I highly doubt we will ever get to the point where you don’t need to understand how an algorithm works - and for that you need to understand core concepts like recursion and loops. As humans brains are designed for pattern recognition - that means writing a program to solve a sodoku puzzle.
And if you don’t know how to code, how do you even know if it gave you the output you want until it fails in production?
Doubt
Why would he lie? Other than to pump the companies shares
Funny enough we now have prompt engineering which is specifically for talking to ai.
Jensen fucking Huang is a piece of shit and choke full of it too
Actually, AI can replace this dick at a fraction of the cost instead of replacing developers. Bring out the guillotine mfs
Your vulgarity and call to violence are quite convincing, sir. Mayhaps you moonlight as a bard?
Lets guillotine the Bard guy too.
You know what, let’s do a Stalin-style purge of Silion Valley suits. New people with perhaps, less evi lideas can take their place.
It’s just as crazy as saying “We don’t need math, because every problem can be described using human language”.
In other words, that might be true as long as your problem is not complex enough to be able to be understood using human language.
You want to solve a real problem? It’s way more complex with so many moving parts you can’t just take LLM to solve it, because that takes an actual understanding of a problem.
Ha
If you ever write code for a living first thing you notice is that people can’t explain what they need by using natural language ( which is what English, Mandarin etc is), even if they don’t need to get into details.
Also, natural language can be vague and confusing. Look at legalese and law statutes. “When it comes to the law, NOTHING is understood!” ‐- Dragline
Maybe more apt for me would be, “We don’t need to teach math, because we have calculators.” Like…yeah, maybe a lot of people won’t need the vast amount of domain knowledge that exists in programming, but all this stuff originates from human knowledge. If it breaks, what do you do then?
I think someone else in the thread said good programming is about the architecture (maintainable, scalable, robust, secure). Many LLMs are legit black boxes, and it takes humans to understand what’s coming out, why, is it valid.
Even if we have a fancy calculator doing things, there still needs to be people who do math and can check. I’ve worked more with analytics than LLMs, and more times than I can count, the data was bad. You have to validate before everything else, otherwise garbage in, garbage out.
It’s sounds like a poignant quote, but it also feels superficial. Like, something a smart person would say to a crowd to make them say, “Ahh!” but also doesn’t hold water long.
And because they are such black boxes, there’s the sector of Explainable AI which attempts to provide transparency.
However, in order to understand data from explainable AI, you still need domain experts that have experience in interpreting what that data means and how to make changes.
It’s almost as if any reasonably complex string of operations requires study. And that’s what tech marketing forgets. As you said, it all has to come from somewhere.
Founder of company which makes major revenue by selling GPUs for machine learning says machine learning is good.
Yes but Nvidia relies heavily on programmers themselves. Without them Nvidia wouldn’t have a single product. The fact that he despite this makes these claims is worth taking note.
Lol. They’re at the top of the food chain. They can afford the best developers. They do not benefit from competition. As with all leading tech corporations, they are protectionist, and benefit more from stifling competition than from innovation.
Also, more broadly the oligarchy don’t want the masses to understand programming because they don’t want them to fundamentally understand logic, and how information systems work, because civilization is an information system. It makes more sense when you realize Linux/FOSS is the socialism of computing, and anti-competitive closed source corporations like Nvidia (notorious for hindering Linux and FOSS) are the capitalist class of computing.
Techno-Mage has been trying to warn us this whole time.
It doesn’t make him wrong.
Just like we can now uss LLM to create letters or emails with a tone, it’s not going to be a big leap to allow it to do similar with coding. It’s quite exciting, really. Lots of people have ideas for websites or apps but no technical knowledge to do it. AI may allow it, just like it allows non artists to create art.
Until somewhere things go wrong and the supplier tries the “but an AI wrote it” as a defense when the client sues them for not delivering what was agreed upon and gets struck down, leading to very expensive compensations that spook the entire industry.
Aor Canada already tried that and lost. They had to refund the customer as the chatbot gave incorrect information.
Turns out the chatbot gave the correct information. Air Canada just didn’t realize they had legally enabled the AI to set company policy. :)
Well difference is you have to know coming to know did the AI produce what you actually wanted.
Anyone can read the letter and know did the AI hallucinate or actually produce what you wanted.
On code. It might produce code, that by first try does what you ask. However turns AI hallucinated a bug into the code for some edge or specialty case.
Hallucinating is not a minor hiccup or minor bug, it is fundamental feature of LLMs. Since it isn’t actually smart. It is a stochastic requrgitator. It doesn’t know what you asked or understand what it is actually doing. It is matching prompt patterns to output. With enough training patterns to match one statistically usually ends up about there. However this is not quaranteed. Thus the main weakness of the system. More good training data makes it more likely it more often produces good results. However for example for business critical stuff, you aren’t interested did it get it about right the 99 other times. It 100% has to get it right, this one time. Since this code goes to a production business deployment.
I guess one can code comprehensive enough verified testing pattern including all the edge cases and with thay verify the result. However now you have just shifted the job. Instead of programmer programming the programming, you have programmer programming the very very comprehensive testing routines. Which can’t be LLM done, since the whole point is the testing routines are there to check for the inherent unreliability of the LLM output.
It’s a nice toy for someone wanting to make a quick and dirty test code (maybe) to do thing X. Then try to find out does this actually do what I asked or does it have unforeseen behavior. Since I don’t know what the behavior of the code is designed to be. Since I didn’t write the code. good for toying around and maybe for quick and dirty brainstorming. Not good enough for anything critical, that has to be guaranteed to work with promise of service contract and so on.
So what the future real big job will be is not prompt engineers, but quality assurance and testing engineers who have to be around to guard against hallucinating LLM/ similar AIs. Prompts can be gotten from anyone, what is harder is finding out did the prompt actually produced what it was supposed to produce.
I use AI to write code for work every day. Many different models and services, including https:/ollama.ai on my own hardware. It’s useful for a developer, but it is by no means anywhere close to actually successfully writing code all on its own. Eventually maybe, but nowhere near anytime soon.
It can’t tell yet when the output is ridiculous or incorrect for non coding, but it will get there. Same for coding. It will continue to grow in complexity and ability.
It will get there, eventually. I don’t think it will be writing complex code any time soon, but I can see it being aware of all the libraries and foss that a person cannot be across.
I would foresee learning to code as similar to learning to do accounting manually. Yes, you’ll still need to understand it to be a coder, but for the average person that can’t code, it will do a good enough job, like we use accounting software now for taxes or budgets that would have been professionally done before. For complex stuff, it will be human done, or human reviewed, or professional coders giving more technical instructions for ai. For simple coding, like you might write a python script now, for some trivial task, ai will do it.
Agreed. I mainly use it for learning.
Instead of googling and skimming a couple blogs / so posts, I now just ask the AI. It pulls the exact info I need and sources it all. And being able to ask follow up questions is great.
It’s great for learning new languages and frameworks
It’s also very good at writing unit tests.
Also for recommending Frameworks/software for your use case.
I don’t see it replacing developers, more reducing the number of developers needed. Like excel did for office workers.
You just described all of my use cases. I need to get more comfortable with copilot and codeium style services again, I enjoyed them 6 months ago to some extent. Unfortunately current employer has to be federally compliant with government security protocols and I’m not allowed to ship any code in or out of some dev machines. In lieu of that, I still run LLMs on another machine acting, like you mentioned, as sort of my stackoverflow replacement. I can describe anything or ask anything I want, and immediately get extremely specific custom code examples.
I really need to get codeium or copilot working again just to see if anything has changed in the models (I’m sure they have.)
I think this is going to age really badly and I don’t like LLMs but I think it will be soon. People also said that AI as we see it now is decades away but we got it quite quickly so I think it’s a very small step to go from writing fully grammatically correct English to fully correct code. It’s basically just a language the ai has to learn. But I guess what do I know. We’ll just have to wait and see
I’ve been doing this for over a year now, started with GPT in 2022, and there have been massive leaps in quality and effectiveness. (Versions are sneaky, even GPT-4 has evolved many times over and over without people really knowing what’s happening behind the scenes.) The problem still remains the “context window.” Claude.ai is > 100k tokens now I think, but the context still limits an entire ‘session’ to only make so much code in that window. I’m still trying to push every model to its limits, but another big problem in the industry now is effectiveness via “perplexity” measurements given a context length.
https://pbs.twimg.com/media/GHOz6ohXoAEJOom?format=png&name=small
This plot shows that as the window grows in size, “directly proportional to the number of tokens in the code you insert into the window, combined with every token it generates at the same time” everything that it produces becomes less accurate and more perplexing overall.
But you’re right overall, these things will continue to improve, but you still need an engineer to actually make the code function given a particular environment. I just don’t get the feeling we’ll see that within the next few years, but if that happens then every IT worker on earth is effectively useless, along with every desk job known to man as an LLM would be able to reason about how to automate any task in any language at that point.
It might not make him wrong, but he also happens to be wrong.
You can’t compare AI art or literature to AI software, because the former are allowed to be vague or interpretive while the latter has to be precise and formally correct. AI can’t even reliably do art yet, it frequently requires several attempts or considerable support to get something which looks right, but in software “close” frequently isn’t useful at all. In fact, it can easily be close enough to look right at first glance while actually being catastopically wrong once you try to use it for real (see: every bug in any released piece of software ever)
Even when AI gets good enough to reliably produce what it’s asked for first time & every time (which is a long way away for quite a while yet), a sufficiently precise description of what you want is exactly what programmers spend their lives writing. Code is a description of a program which another program (such as a compiler) can convert into instructions for the computer. If someone comes up with a very clever program which can fill in the gaps by using AI to interpret what it’s been given, then what they’ve created is just a new kind of programming language for a new kind of compiler
I don’t disagree with your point. I think that is where we are heading. How we interact with computers will change. We’re already moving away from keyboard typing and clicks, to gestures and voice or image recognition.
We likely won’t even call it coding. Hey Google, I’ve downloaded all the episodes for the current season of Pimp My PC, can you rename the files by my naming convention and drop them into jellyfin. The AI will know to write a python script to do so. I expect it to be invisible to the user.
So, yes, it is just a different instruction set. But that’s all computers are. Data in, data out.
I can kind of see his point, but the things he is suggesting instead (biology, chemistry, finance) don’t make sense for several reasons.
Besides the obvious “why couldn’t AI just replace those people too” (even though it may take an extra few years), there is also a question of how many people can actually have a deep enough expertise to make meaningful contributions there - if we’re talking about a massive increase of the amount of people going into those fields.
