cyrano@lemmy.dbzer0.com to United States | News & Politics@midwest.social · 1 day agoProposed bill to make it a crime to download DeepSeek in the USwww.congress.govexternal-linkmessage-square37fedilinkarrow-up1208arrow-down16
arrow-up1202arrow-down1external-linkProposed bill to make it a crime to download DeepSeek in the USwww.congress.govcyrano@lemmy.dbzer0.com to United States | News & Politics@midwest.social · 1 day agomessage-square37fedilink
minus-squareBreadstickNinja@lemmy.worldlinkfedilinkEnglisharrow-up2·14 hours agoI’m with you on principle, but the thing is also like 600 GB of data. Not sure I have the disk space to take a stand on this one.
minus-squaretrevor@lemmy.blahaj.zonelinkfedilinkEnglisharrow-up2·14 hours agoNo worries. I’ve got some 20TB drives i can throw these on 😁 Now, running a model that large… Well, I’ll just have to stick with the 8-13b params.
minus-squarePup Biru@aussie.zonelinkfedilinkEnglisharrow-up1·8 hours agoyou can actually run the model, but it just goes very slowly… i run the 70b model on my m1 mbp, and it technically “requires” 128gb or VRAM - it still runs, just not super fast (though i’d say it’s useable in this case a about 1 word per ~300ms)
minus-square🇰 🌀 🇱 🇦 🇳 🇦 🇰 🇮 linkfedilinkEnglisharrow-up1·14 hours agoI’d have to remove all my games, the operating system, and run my SSDs in RAID to be able to fit that and still generate things with it. 😮
I’m with you on principle, but the thing is also like 600 GB of data. Not sure I have the disk space to take a stand on this one.
No worries. I’ve got some 20TB drives i can throw these on 😁
Now, running a model that large… Well, I’ll just have to stick with the 8-13b params.
you can actually run the model, but it just goes very slowly… i run the 70b model on my m1 mbp, and it technically “requires” 128gb or VRAM - it still runs, just not super fast (though i’d say it’s useable in this case a about 1 word per ~300ms)
I’d have to remove all my games, the operating system, and run my SSDs in RAID to be able to fit that and still generate things with it. 😮