And for AI at home?
Since this is a story about AI DataCenters
I want to get an AMD but the integration of Nvidia GPUs for processing ML/AI stuff is much higher.
So if I want to mess with running AI at home I only have 1 choice.
I hope AMD release something that competes on that front, and can still play games on the weekend, but currently, he is right there is no competition
I find this strange, because I had nothing but trouble getting my R9 390 working with any Linux distro, but my RTX 3060 hasn’t given me a single issue on like 6 different distros.
And AMD or Intel are better? Everyone complains about the drivers.
For Linux it is a huge difference. AMD and Intel have great open source drivers, while Nvidia have binary drivers with a lot of issues.
And for AI at home? Since this is a story about AI DataCenters
I want to get an AMD but the integration of Nvidia GPUs for processing ML/AI stuff is much higher. So if I want to mess with running AI at home I only have 1 choice.
I hope AMD release something that competes on that front, and can still play games on the weekend, but currently, he is right there is no competition
I run AI stuff just fine on my AMD GPU using HIP. At least LLMs and Stable Diffusion work perfectly fine but that’s the only things I’ve tested.
All the benchmarks put the equivalent Nvidia cards almost 2x more in Stable Diffusion https://www.tomshardware.com/pc-components/gpus/stable-diffusion-benchmarks
I hope that is an old benchmark and times have changed, but I can’t find anything like it that is more recent.
For a bit of my soul I get a lot more ai power.
AI works on AMD but the speed doesn’t seem to be anywhere near Nvidia.
I find this strange, because I had nothing but trouble getting my R9 390 working with any Linux distro, but my RTX 3060 hasn’t given me a single issue on like 6 different distros.
Are you talking about a laptop or a desktop? If desktop, using offload or something like that?
Desktop, both Intel and AMD builds. And no, I just had multiple SSDs that I played with distros on.
Nvidia works flawlessly most of the time on desktops. The suckyness of their drivers shows its ugly head mostly on laptops.
And it’s bad, crash your computer bad some times.
I guess I’ve been lucky with my laptop, although it is fairly old at this point.