BrikoX@lemmy.zipM to Technology@lemmy.zipEnglish · 5 days agoResearchers upend AI status quo by eliminating matrix multiplication in LLMsarstechnica.comexternal-linkmessage-square8fedilinkarrow-up147arrow-down11file-textcross-posted to: machine_learning@programming.devtechnology@lemmy.worldsingularity@lemmit.online
arrow-up146arrow-down1external-linkResearchers upend AI status quo by eliminating matrix multiplication in LLMsarstechnica.comBrikoX@lemmy.zipM to Technology@lemmy.zipEnglish · 5 days agomessage-square8fedilinkfile-textcross-posted to: machine_learning@programming.devtechnology@lemmy.worldsingularity@lemmit.online
minus-squarePennomi@lemmy.worldlinkfedilinkEnglisharrow-up2·5 days agoOnly for maximum efficiency. LLMs already run tolerably well on normal CPUs and this technique would make it much more efficient there as well.
Only for maximum efficiency. LLMs already run tolerably well on normal CPUs and this technique would make it much more efficient there as well.