zwaetschgeraeuber@lemmy.worldtoTechnology@lemmy.world•Mozilla lays off 60 people, wants to build AI into FirefoxEnglish
0·
9 months agoYou can run a 7b model on cpu really fast even on a phone.
You can run a 7b model on cpu really fast even on a phone.
Thats what i said lol
Ok have to correct myself, they crawled back from this 2 weeks ago due to backlash, but i doubt they wont do it at least in a similar way or hidden like they did with reducing power on older devices to “save battery” https://www.wired.com/story/apple-photo-scanning-csam-communication-safety-messages/
Yea thats why they look trough your images for “cp”
Even if it will plateau, same was said with moorrs law, which held up way longer than expected. There are so many ways to improve this. Open source community is getting to the point where you can actually run decent models on normal private hardware (talking about 70-120b model)