cm0002@lemmy.world to Technology@lemmy.worldEnglish · 20 hours agoMajority of AI Researchers Say Tech Industry Is Pouring Billions Into a Dead Endfuturism.comexternal-linkmessage-square144fedilinkarrow-up1670arrow-down112
arrow-up1658arrow-down1external-linkMajority of AI Researchers Say Tech Industry Is Pouring Billions Into a Dead Endfuturism.comcm0002@lemmy.world to Technology@lemmy.worldEnglish · 20 hours agomessage-square144fedilink
minus-squaredeegeese@sopuli.xyzlinkfedilinkEnglisharrow-up105·20 hours agoOptimizing AI performance by “scaling” is lazy and wasteful. Reminds me of back in the early 2000s when someone would say don’t worry about performance, GHz will always go up.
minus-squaremorrowind@lemmy.mllinkfedilinkEnglisharrow-up1·4 hours agoIt always wins in the end though. Look up the bitter lesson.
minus-squareNoiseColor @lemmy.worldlinkfedilinkEnglisharrow-up27arrow-down2·18 hours agoThing is, same as with GHz, you have to do it as much as you can until the gains get too small. You do that, then you move on to the next optimization. Like ai has and is now optimizing test time compute, token quality, and other areas.
minus-square🇸🇵🇪🇨🇺🇱🇦🇹🇪🇷@lemmy.worldlinkfedilinkEnglisharrow-up6·15 hours agoTo be fair, GHz did go up. Granted, it’s not why modern processors are faster and more efficient.
minus-squarech00f@lemmy.worldlinkfedilinkEnglisharrow-up17·20 hours agohttps://en.wikipedia.org/wiki/Wirth's_law
minus-squaredanc4498@lemmy.worldlinkfedilinkEnglisharrow-up1arrow-down1·11 hours agoI miss flash players.
Optimizing AI performance by “scaling” is lazy and wasteful.
Reminds me of back in the early 2000s when someone would say don’t worry about performance, GHz will always go up.
It always wins in the end though. Look up the bitter lesson.
Thing is, same as with GHz, you have to do it as much as you can until the gains get too small. You do that, then you move on to the next optimization. Like ai has and is now optimizing test time compute, token quality, and other areas.
To be fair, GHz did go up. Granted, it’s not why modern processors are faster and more efficient.
https://en.wikipedia.org/wiki/Wirth's_law
TIL
I miss flash players.