But the figures rely on hardware and usage assumptions that may be inaccurate.

The University of Rhode Island’s AI lab estimates that GPT-5 averages just over 18 Wh per query, so putting all of ChatGPT’s reported 2.5 billion requests a day through the model could see energy usage as high as 45 GWh.

A daily energy use of 45 GWh is enormous. A typical modern nuclear power plant produces between 1 and 1.6 GW of electricity per reactor per hour, so data centers running OpenAI’s GPT-5 at 18 Wh per query could require the power equivalent of two to three nuclear power reactors, an amount that could be enough to power a small country.

    • Evono@lemmy.dbzer0.comEnglish
      2·
      2 hours ago

      Basicly I can run 9b models on my 16gb gpu mostly fine like getting responses of lets say 10 lines in a few seconds.

      Bigger models if they don’t outright crash take for the same task then like 5x or 10x longer so long it isn’t even useful anymore

      So very worse.

    • Encrypt-Keeper@lemmy.worldEnglish
      2·
      2 hours ago

      Like make a query and then go make yourself a sandwich while it spits out a word every other second slow.

      There are very small models that can run on mid range graphics cards and all, but it’s not something you’d look at and say “Yeah this does most of what chatGPT does”

      I have a model running on a gtx 1660 and I use it with Hoarder to parse articles and create a handful a tags for them and it’s not… great at that.