The gains in AI have been almost entirely in compute power and training, and those gains have run into powerful diminishing returns. At the core it’s all still running the same Markov chains as the machine learning experiments from the dawn of computing; the math is over a hundred years old and basically unchanged.
For us to see another leap in progress we’ll need to pioneer new calculations and formulate different types of thought, then find a way to integrate that with large transformer networks.
At the core it’s all still running the same Markov chains as the machine learning experiments from the dawn of computing
Sure but tanks today at their core still look like tanks from ww2, when things work well they work well, when did Mixture of Experts for example start to apply to deep learning? Can you think of anything else outside of compute and training that helps AI? What about building a search engine around the ability for it to get and summarise sources (perplexity)?
For us to see another leap in progress we’ll need to pioneer new calculations and formulate different types of thought, then find a way to integrate that with large transformer networks.
To be fair AI is already incredible, ai generated music/video/images are already getting billions of views and coding agents are already generating millions of lines of code every day and AI is already being utilised heavily in heathcare, learning, translation, military… this was posted earlier today:
Ukrainian sniper pulls off record 4-km shot that killed two Russians. Yes, it took AI
Rifle Used: 14.5 mm Snipex Alligator, an anti-materiel rifle originally meant to destroy equipment, not personnel. Its official effective range is 2,000 m—only half the distance achieved in this shot.
Guidance Tools: The sniper used AI-assisted targeting and drone surveillance to calibrate the record-breaking strike.
Mixture of experts has been in use since 1991, and it’s essentially just a way to split up the same process as a dense model.
Tanks are an odd comparison, because not only have they changed radically since WW2, to the point that many crew positions have been entirely automated, but also because the role of tanks in modern combat has been radically altered since then (e.g. by the proliferation of drone warfare). They just look sort of similar because of basic geometry.
Consider the current crop of LLMs as the armor that was deployed in WW1, we can see the promise and potential, but it has not yet been fully realized. If you tried to match a WW1 tank against a WW2 tank it would be no contest, and modern armor could destroy both of them with pinpoint accuracy while moving full speed over rough terrain outside of radar range (e.g. what happened in the invasion of Iraq).
It will take many generational leaps across many diverse technologies to get from where we are now to realizing the full potential of large language models, and we can’t get there through simple linear progression any more than tanks could just keep adding thicker armor and bigger guns, it requires new technologies.
nd modern armor could destroy both of them with pinpoint accuracy while moving full speed over rough terrain outside of radar range (e.g. what happened in the invasion of Iraq).
lol, that is NOT what happened in Iraq. The tanks were sitting on low boy trucks for the vast majority of the invasion. How do I know this? Because they were in my convoys.
Even for major offensives after the initial invasion, that’s not at all what happened. They were basically employed as large mortars, sitting about a half mile outside of a town, and leveling it.
Ah, got ya. Even then, most of that was done by aircraft sorties, though, and not much tank action. The US didn’t enter Iraq very far in the first Gulf War.
Well maybe one person is a little bit more impressed by some pretty pictures than another person. I really don’t see what that has to do with a company like Microsoft putting their money into this? They don’t make songs or movie trailers.
To me I’m stunned but that’s just me, on top of this we’re only in year like 5 of AI going mainstream, where will it be in 10 years? 20 years?
This is a common trap a lot of people fall into. See what improvements have been made the last couple of years, who knows where it will end up right? Unfortunately, reality doesn’t work like that. Improvements made in the past don’t guarantee improvements will continue in the future. There are ceilings that can be run into and are hard to break. There can even be hard limits that are impossible to break. There might be good reasons to not further develop promising technologies from the past into the future. There is no such thing as infinite growth.
Edit:
Just checked out that song, man that song is shit…
“My job vanished without lift.” What does that even mean? That’s not even English.
And that’s just one of the dozens of issues I’ve seen in 30 secs. You are kidding yourself if you think this is the future, that’s one shit future bro.
Well maybe one person is a little bit more impressed by some pretty pictures than another person.
Fair enough, quick question for you, make me an image that is similar to the screenshot I took of the movie, tree in the middle of a futuristic city without using AI.
I’m not asking you to make a movie or audio or anything like this, just make something that resembles a futuristic city, maybe you can do it in gimp? Let me know how you go :)
All right, we are done here. I’ve tried to engage with you in a fair and honest way. Giving you the benefit of the doubt and trying to respond to the points you are trying to make.
But it appears you are just a troll or an idiot, either way I’m done.
Really you heard this:
AI Took My Job 徐铭轩MaoMao
https://suno.com/song/14572e0f-a446-4625-90ff-3676a790a886
And went wow, a song that fuckin slaps made by a computer and weren’t impressed?
You saw this:
Age of Beyond
https://www.youtube.com/watch?v=vp7xoPeWzEw
And went a fuckin sci-fi movie trailer made in 2 months, what a piece of shit this AI is eh?
To me I’m fuckin stunned but that’s just me, on top of this we’re only in year like 5 of AI going mainstream, where will it be in 10 years? 20 years?
The gains in AI have been almost entirely in compute power and training, and those gains have run into powerful diminishing returns. At the core it’s all still running the same Markov chains as the machine learning experiments from the dawn of computing; the math is over a hundred years old and basically unchanged.
For us to see another leap in progress we’ll need to pioneer new calculations and formulate different types of thought, then find a way to integrate that with large transformer networks.
Sure but tanks today at their core still look like tanks from ww2, when things work well they work well, when did Mixture of Experts for example start to apply to deep learning? Can you think of anything else outside of compute and training that helps AI? What about building a search engine around the ability for it to get and summarise sources (perplexity)?
To be fair AI is already incredible, ai generated music/video/images are already getting billions of views and coding agents are already generating millions of lines of code every day and AI is already being utilised heavily in heathcare, learning, translation, military… this was posted earlier today:
https://euromaidanpress.com/2025/08/17/ukrainian-sniper-4km-ai-shot/
Now whether we get to AGI is a whole other thing, that I agree would need a major leap
Mixture of experts has been in use since 1991, and it’s essentially just a way to split up the same process as a dense model.
Tanks are an odd comparison, because not only have they changed radically since WW2, to the point that many crew positions have been entirely automated, but also because the role of tanks in modern combat has been radically altered since then (e.g. by the proliferation of drone warfare). They just look sort of similar because of basic geometry.
Consider the current crop of LLMs as the armor that was deployed in WW1, we can see the promise and potential, but it has not yet been fully realized. If you tried to match a WW1 tank against a WW2 tank it would be no contest, and modern armor could destroy both of them with pinpoint accuracy while moving full speed over rough terrain outside of radar range (e.g. what happened in the invasion of Iraq).
It will take many generational leaps across many diverse technologies to get from where we are now to realizing the full potential of large language models, and we can’t get there through simple linear progression any more than tanks could just keep adding thicker armor and bigger guns, it requires new technologies.
lol, that is NOT what happened in Iraq. The tanks were sitting on low boy trucks for the vast majority of the invasion. How do I know this? Because they were in my convoys.
Even for major offensives after the initial invasion, that’s not at all what happened. They were basically employed as large mortars, sitting about a half mile outside of a town, and leveling it.
I was talking about the Gulf War in the 90s: https://youtu.be/b5EeKsEFpHI
I think the Iraqi tanks were mostly blown up by the time Bush Jr did his invasion.
Ah, got ya. Even then, most of that was done by aircraft sorties, though, and not much tank action. The US didn’t enter Iraq very far in the first Gulf War.
True. Though in what tank vs tank combat there was, the advantages of modern armor were stark.
Well maybe one person is a little bit more impressed by some pretty pictures than another person. I really don’t see what that has to do with a company like Microsoft putting their money into this? They don’t make songs or movie trailers.
This is a common trap a lot of people fall into. See what improvements have been made the last couple of years, who knows where it will end up right? Unfortunately, reality doesn’t work like that. Improvements made in the past don’t guarantee improvements will continue in the future. There are ceilings that can be run into and are hard to break. There can even be hard limits that are impossible to break. There might be good reasons to not further develop promising technologies from the past into the future. There is no such thing as infinite growth.
Edit:
Just checked out that song, man that song is shit…
“My job vanished without lift.” What does that even mean? That’s not even English.
And that’s just one of the dozens of issues I’ve seen in 30 secs. You are kidding yourself if you think this is the future, that’s one shit future bro.
Fair enough, quick question for you, make me an image that is similar to the screenshot I took of the movie, tree in the middle of a futuristic city without using AI.
I’m not asking you to make a movie or audio or anything like this, just make something that resembles a futuristic city, maybe you can do it in gimp? Let me know how you go :)
Quickly making garbage doesn’t make the garbage good.
All right, we are done here. I’ve tried to engage with you in a fair and honest way. Giving you the benefit of the doubt and trying to respond to the points you are trying to make.
But it appears you are just a troll or an idiot, either way I’m done.
awww someone just realised how incredible AI is, congrats :)
Lol confirmed both idiot and troll, thanks :)
It’s all good bro, tell me more about the future of tech 🤓