pavnilschanda@lemmy.world to Technology@lemmy.worldEnglish · 2 years agoLLMs are surprisingly great at compressing images and audio, DeepMind researchers findventurebeat.comexternal-linkmessage-square12fedilinkarrow-up1102arrow-down15cross-posted to: technology@lemmy.ml
arrow-up197arrow-down1external-linkLLMs are surprisingly great at compressing images and audio, DeepMind researchers findventurebeat.compavnilschanda@lemmy.world to Technology@lemmy.worldEnglish · 2 years agomessage-square12fedilinkcross-posted to: technology@lemmy.ml
minus-squareNaibofTabr@infosec.publinkfedilinkEnglisharrow-up9·2 years agoDo you need the dataset to do the compression? Is the trained model not effective on its own?
minus-squareTibert@compuverse.uklinkfedilinkEnglisharrow-up13·2 years agoWell from the article a dataset is required, but not always the heavier one. Tho it doesn’t solve the speed issue, where the llm will take a lot more time to do the compression. gzip can compress 1GB of text in less than a minute on a CPU, an LLM with 3.2 million parameters requires an hour to compress
Do you need the dataset to do the compression? Is the trained model not effective on its own?
Well from the article a dataset is required, but not always the heavier one.
Tho it doesn’t solve the speed issue, where the llm will take a lot more time to do the compression.
deleted by creator