That’s not what I said. We’re using those hardware efficiency gains to offset the performance losses of additional abstraction layers. If we were to make the software more efficient, the hardware efficiency gains would actually be noticeable and we wouldn’t be wasting nearly as much energy overall.
That’s not what I said. We’re using those hardware efficiency gains to offset the performance losses of additional abstraction layers. If we were to make the software more efficient, the hardware efficiency gains would actually be noticeable and we wouldn’t be wasting nearly as much energy overall.
This is all ai compute. Yes modern software is bloated but ai inference currently kind of has to run on gpus.