- cross-posted to:
- technology@lemmy.ml
- cross-posted to:
- technology@lemmy.ml
You must log in or register to comment.
Is that fast enough to put an LLM in swap and have decent performance?
Note that this in theory speaks to performance of a non volatile memory. It does not speak to cost.
We already have a faster than NAND non volatile storage in phase change memory . It failed due to expense.
If this thing is significantly more expensive even than RAM, then it may fail even if it is everything it says it is. If it is at least as cheap as ram, it’ll be huge since it is faster than RAM and non volatile.
Swap is indicated by cost, not by non volatile characteristics.
China scientists
So, Chinese scientists?
Me stutter? No think so!
Him legend.
Seriously, for me a “China scientist” is someone doing research on China, like a space scientist would do research on astronomy and similar. But I’m not a native English speaker, so, idk
Someone doing research on China is a chiologist.
Same as someone doing research on biology is a biologist.
Biology -> biolog -> biologist
China -> chin -> chinist?
Chientists
(acts confused in French)
Probably because is an ethnicity and nationality. There are ethnic Chinese people all over the world and a few countries and regions are made of a majority of ethnic Chinese but are not related to China. Calling them the same thing is playing into the PRC’s “all ethnic Chinese pledge their allegiance to China” nonsense.
Isreal like that game of pretend. They believe anti zionist Jews are traitors.
Isn’t that true for every (older) country though?
Perhaps but I haven’t encountered that myself. I’m ethnic Chinese that’s a citizen of another ethnic Chinese majority nation so I’ve encountered this specific type a lot more.
It’s a reasonable assumption that someone in China is Chinese.
The reverse, however, isn’t true. It may be somewhat understandable but not entirely reasonable to assume someone who is Chinese is from China which is what I’m trying to say.
No, it’s people who study fine tableware.
I think it’s a slightly different connotation. “China scientists” infers scientists residing in China while not presuming their ethnicity, while “Chinese scientists” implies their ethnicity but not their location.
You literally never hear “America scientists” even if some of them might be from another country. Same with every single other country I can think of, except China.
US scientists works in the same way.
deleted by creator
Real talk, why is discussion around people and subjects in China so fucking weird?
If it’s not referring to the entire population when it only applies to the government or a subset of them as a global “the Chinese” or doing silly shit like “China scientists” everyone’s grammatical skills suddenly tank when even broaching a topic even tangential to the PRC.
You just fucking wait. Trump is bringing manufacturing to the US. And when that plant opens someday you’ll be so sorry you doubted.
I’m sure the foxconn plant in Wisconsin will fire up ANY DAY NOW! drums fingers
I talked to like 50 people today and all of the people said they were starting manufacturing plants tomorrow and they’ll be fully functional Tuesday around 3:15.
I started mine earlier and I’ve already done manufacturing 3 times today. It’s really easy. By this time tomorrow I’ll have a couple more and they’ll all be winning manufacturing.
Tariffs gave me the ability to finally believe in myself. Tariffs have increased my stamina in bed, given me a full head of hair again, and since I started manufacturing plant yesterday I’ve dropped 50 pounds.
Wow, finally graphene has been cracked. Exciting times for portable low-energy computing
Too bad the US can’t import any of it.
they can if they pay 6382538% tariffs.
or was it 29403696%?
That was yesterday. It doubled since then IIRC
“These chips are 10,000 times faster, therefore we will increase our tariffs to 10,100%!”
AI AI AI AI
Yawn
Wake me up if they figure out how to make this cheap enough to put in a normal person’s server.
You can get a Coral TPU for 40 bucks or so.
You can get an AMD APU with a NN-inference-optimized tile for under 200.
Training can be done with any relatively modern GPU, with varying efficiency and capacity depending on how much you want to spend.
What price point are you trying to hit?
What price point are you trying to hit?
With regards to AI?. None tbh.
With this super fast storage I have other cool ideas but I don’t think I can get enough bandwidth to saturate it.
With regards to AI?. None tbh.
TBH, that might be enough. Stuff like SDXL runs on 4G cards (the trick is using ComfyUI, like 5-10s/it), smaller LLMs reportedly too (haven’t tried, not interested). And the reason I’m eyeing a 9070 XT isn’t AI it’s finally upgrading my GPU, still would be a massive fucking boost for AI workloads.
You’re willing to pay $none to have hardware ML support for local training and inference?
Well, I’ll just say that you’re gonna get what you pay for.
No, I think they’re saying they’re not interested in ML/AI. They want this super fast memory available for regular servers for other use cases.
Precisely.
I have a hard time believing anybody wants AI. I mean, AI as it is being sold to them right now.
I mean the image generators can be cool and LLMs are great for bouncing ideas off them at 4 AM when everyone else is sleeping. But I can’t imagine paying for AI, don’t want it integrated into most products, or put a lot of effort into hosting a low parameter model that performs way worse than ChatGPT without a paid plan. So you’re exactly right, it’s not being sold to me in a way that I would want to pay for it, or invest in hardware resources to host better models.
normal person’s server.
I’m pretty sure I speak for the majority of normal people, but we don’t have servers.
“Normal person” is a modifier of server. It does not state any expectation of every normal person having a server. Instead, it sets expectation that they are talking about servers owned by normal people. I have a server. I am norm… crap.
Yeah, when you’re a technology enthusiast, it’s easy to forget that your average user doesn’t have a home server - perhaps they just have a NAS or two.
(Kidding aside, I wish more people had NAS boxes. It’s pretty disheartening to help someone find old media and they show a giant box of USB sticks and hard drives. In a good day. I do have a USB floppy drive and a DVD drive just in case.)
Hello fellow home labber! I have a home built xpenology box, proxmox server with a dozen vm’s, a hackentosh, and a workstation with 44 cores running linux. Oh, and a usb floppy drive. We are out here.
I also like long walks in Oblivion.
Man oblivion walks are the best until a crazy woman comes at you trying to steal your soul with a fancy sword
lol yeah, the lemmy userbase is NOT an accurate sample of the technical aptitude of the general population 😂
It’s pretty disheartening to help someone find old media and they show a giant box of USB sticks and hard drives.
Equally disheartening is knowing that both of those have a shelf-life. Old USB flash drives are more durable than the TLC/QLC cells we use today, but 15 years sitting unpowered in a box doesn’t have very good prospects.
You… you don’t? Surely there’s some mistake, have you checked down the back of your cupboard? Sometimes they fall down there. Where else do you keep your internet?
Appologies, I’m tired and that made more sense in my head.
Well obviously the internet is kept in a box, and it’s wireless. The elders of the internet let me borrow it occasionally.
Ikr…Dude thinks we’re restaurants or something.
Hopefully they can use it against covid.
Clickbait article with some half truths. A discovery was made, it has little to do with Ai and real world applications will be much, MUCH more limited than what’s being talked about here, and will also likely still take years to come out
The key word is China, let us not kid ourselves. Otherwise it would be just another pop sci click but now it can be an ammunition in the fight with imperialist degenerated west or some bs like that
Well, I’ll never see it, unless TI or another American company designs their own version.
Or they can do what they normally do, steal it and then sue to be considered the original invento/founder and then make a Hollywood film about how they invented it/found it.
It’s called an iPod, it’s not an mp3 player.
They are called airpods, they are not earbuds.
It’s called an airplane, not an aeroplane.
Whenever they say X whatever times, I doubt it right away, because they always interpret the statistics in the dumbest ways possible. You have a solar panel that is 28% efficient. There is no way it can be 20x times as efficient, that’s just clickbait.
trustworthiness = 1/(claimed improvement)
Brother, have you heard of buses? Even INSIDE cpus/socs bus speeds are a limitation. Also i fucking hate how the first thing people mention now is how ai could benefit from a jump in computing power.
Edit: I havent dabbled that much in high speed stuff yet but isnt the picosecond range so fast that the capacitance of simple traces and connectors between chips influence the rising and falling edge of chips?
That’s pretty much my understanding. Most of the advancements happened in memory speeds are related to the physical proximity of the memory and more efficient transmission/decoding.
GDDR7 chips for example are packed as close as physically possible to the GPU die, and have insane read speeds of 28 Gbps/pin (and a 5090 has a 512-bit bus). Most of the limitation is the connection between GPU and RAM, so speeding up the chips internally 1000x won’t have a noticeable impact without also improving the memory bus.
Yeah, but endurance. and accuracy. and longevity. How about those?
And price and maye write more than 1 single bit
Yeah… At best click baity as fuck, at worst a complete scam.
Any time there is a 10x or more in a headline you are 10x or more likely to be right by calling it BS.
Link to the actual paper: https://www.nature.com/articles/s41586-025-08839-w
The repro and verification will take time. Months or even years. Don’t trust anyone who says it’s definitely real or definitely bunk. Time will tell.
Speaking of, did you hear there’s a new room temperature super conductor?
deleted by creator
Removed by mod
Not possible.
No? Oh, that’s a shame. I was hoping for some improvement in the world, but a random person on the internet said it wasn’t possible without giving any reasons at all. Oh well.
No it’s literally impossible without bypassing the speed of light and/or the size of atoms.
Why? If they looked at how current tech works then they could easily develop the same tech 10000x faster
How
replace “the joke” with “irony” and then send the image to yourself
Holy shit I think with the joke, irony, and the two of you, I might be able to put some sort of perpetual motion machine together! Now I just need some investors…
Most Don’t Know This
Easy, instead of developing the technology themselves they just copy it and claim they developed it 10000 times faster.
It’s a play on the original title.
