floofloof@lemmy.ca to Technology@lemmy.worldEnglish · 1 month ago1-bit LLMs Could Solve AI’s Energy Demandsspectrum.ieee.orgexternal-linkmessage-square36fedilinkarrow-up1120arrow-down115cross-posted to: singularity@lemmit.onlineartificial_intel@lemmy.mlhackernews@lemmy.smeargle.fans
arrow-up1105arrow-down1external-link1-bit LLMs Could Solve AI’s Energy Demandsspectrum.ieee.orgfloofloof@lemmy.ca to Technology@lemmy.worldEnglish · 1 month agomessage-square36fedilinkcross-posted to: singularity@lemmit.onlineartificial_intel@lemmy.mlhackernews@lemmy.smeargle.fans
minus-squareKnock_Knock_Lemmy_In@lemmy.worldlinkfedilinkEnglisharrow-up11arrow-down1·29 days agoSmaller and speedier means larger token windows and greater variety of models. Not less energy.
Smaller and speedier means larger token windows and greater variety of models.
Not less energy.