Given its extremely high energy and water consumption, the increased minimum system requirements driving premature hardware obsolescence, among other very problematic social and political issues, genAI/LLMs are not compatible with the values and goals of KDE Eco.
KDE is a diverse community and the opinions and projects of some KDE contributors are not representative of the entire community or KDE Eco projects.
To put it into perspective how much energy does a promt consume?
I asked an ai. Are the numbers roughly right?
There are some things “AI” isn’t fit to answer, like questions with nuance. And a “prompt” in itself isn’t a quantifiable unit. I can tell you that my gaming rig with 96 GB of RAM and an RTX 2080 could only run a quantized model – the model weights will eat up my RAM and keep my system drinking electricity. My CPU could handle it like a champ but let’s be real, all of that is to get a crappy-performance model doing work.
I could believe that, like, a full day of heavy agent work consumed that much power running the agentic workload on my device, but there’s no way that number is accounting for the power consumed in hosted model inference, let alone training.
TLDR: Energy consumption isn’t really high, especially generic conversational prompts. Advanced prompts are only used by a very niche group. The main impact is largely on the locales immediately surrounding data centers.
Sounds like the real problem is just data centres being in the wrong places, sucking the wrong resources.
In a way. And that is mostly due to capitalism. Had they taken the time to slowly scale up and use renewables, they wouldn’t have triggered this level of lashback. But no, they had to race to be first.
I hope you’re trolling