Track_Shovel@slrpnk.net to Lemmy Shitpost@lemmy.worldEnglish · 6 months agoHexadecimalslrpnk.netexternal-linkmessage-square127linkfedilinkarrow-up11arrow-down10
arrow-up11arrow-down1external-linkHexadecimalslrpnk.netTrack_Shovel@slrpnk.net to Lemmy Shitpost@lemmy.worldEnglish · 6 months agomessage-square127linkfedilink
minus-squaressillyssadass@lemmy.worldlinkfedilinkarrow-up0·6 months agoDon’t you need a beefy GPU to run local LLMs?
minus-squareMasterNerd@lemm.eelinkfedilinkarrow-up0·6 months agoDepends on how many parameters you want to use. I can run it with 8billion on my laptop.
Don’t you need a beefy GPU to run local LLMs?
Depends on how many parameters you want to use. I can run it with 8billion on my laptop.