• mindbleach@sh.itjust.works
    link
    fedilink
    arrow-up
    15
    arrow-down
    10
    ·
    6 days ago

    You already shouldn’t be using Chrome, and if this is what moves the needle, great.

    At a billion-device scale the climate costs are insane.

    No.

    Just flatly, no.

    Local models spin your GPU like a video game. Unless you think Overwatch is a climate disaster, please learn to separate datacenter condemnation from people running their own computers a little harder.

    • XLE@piefed.social
      link
      fedilink
      English
      arrow-up
      15
      arrow-down
      3
      ·
      6 days ago

      I’d say you should read the article a little more closely, but it’s not written very well. But it brings up interesting things that have nothing to do with your local GPU usage. For example, it names an interesting point about simply delivering 4 gigabytes of data to that many people. If pushed out to ~15% of Chrome users without consent:

      • That’d be 500 million people
      • It would be 2 exabytes of data
      • 120 GWh of energy, equivalent to the annual electricity consumption of about 36,000 average UK households
      • 30,000 tonnes CO2 emitted, roughly the annual emissions of 6,500 cars

      And that’s just for the initial data push. Models need ✨updates!✨

      • I hate the idea of AI agents on my phone without my consent. So this is definitely fucked up. And fuck google in general.

        But the power consumption argument makes little sense. That’s like downloading one movie in 1080p.

        • XLE@piefed.social
          link
          fedilink
          English
          arrow-up
          11
          arrow-down
          1
          ·
          6 days ago

          Installing a game you want is different than hundreds of millions of people having something they didn’t ask for getting pushed on them.

            • shrek_is_love@lemmy.ml
              link
              fedilink
              arrow-up
              9
              arrow-down
              2
              ·
              6 days ago

              Power use is not always bad. Power waste is. 4GB I’m not going to use is much worse than 6GB I will use.

              • mindbleach@sh.itjust.works
                link
                fedilink
                arrow-up
                4
                arrow-down
                9
                ·
                6 days ago

                The atmosphere doesn’t care whether you found joy in how you’ve impacted it. Either downloading files is bad, actually, or it’s not a big deal.

            • XLE@piefed.social
              link
              fedilink
              English
              arrow-up
              1
              arrow-down
              1
              ·
              6 days ago

              What happened to separating personal use from condemning data centers for expending unnecessary and unwanted energy?

                • XLE@piefed.social
                  link
                  fedilink
                  English
                  arrow-up
                  2
                  arrow-down
                  1
                  ·
                  6 days ago

                  Here, yes. Two exabytes of data transfer could have been one or zero.

                  I don’t get the point you’re trying to make here.

                  • mindbleach@sh.itjust.works
                    link
                    fedilink
                    arrow-up
                    4
                    arrow-down
                    4
                    ·
                    6 days ago

                    The point is that servers don’t belch black smoke when they send you one file. This model is the size of a four-hour Youtube video. How many people watch how many hours of video, every single day? We only see this hand-wringing minutia over internet use when talking about neural networks, and it’s getting weird.

    • crusa187@lemmy.ml
      link
      fedilink
      arrow-up
      7
      ·
      6 days ago

      Agreed. Hate the data centers and corporate obsession with extreme waste for total value capture. Not the tech, especially on a local scale.

      A 128GB amd strix halo runs at 120W and can host large LLMs at home. If you ran it full time for inference it would still be under $20/mo in electricity costs.

    • OwOarchist@pawb.social
      link
      fedilink
      English
      arrow-up
      7
      arrow-down
      3
      ·
      6 days ago

      Local models spin your GPU like a video game. Unless you think Overwatch is a climate disaster

      90% of users aren’t playing Overwatch.

      And even if you are, that’s a significant increase in power draw if you’re spinning up a local LLM every time you start to type into your browser’s address bar to do a search or something.

      And, most importantly, you can choose when and if you want to play Overwatch. It didn’t get installed without your knowledge and consent, and it doesn’t run automatically.

      • Mystic Mushroom [Ze/Zir]@lemmy.dbzer0.com
        link
        fedilink
        arrow-up
        2
        arrow-down
        1
        ·
        6 days ago

        Please tell me you aren’t using a carbon footprint argument, you know. The ones Oil companies use to blame us, a population of people for climate change, instead of take action against them, and their corporate buddies. Who are a single large contributor, if not the entire problem in and of itself.

        Even though we’re probably very different in our beliefs I would agree that I don’t want things using GPU without my consent. But I don’t agree in justifying it or hatred of AI with carbon footprint rhetoric created by the companies who created this problem in the first place.

        • OwOarchist@pawb.social
          link
          fedilink
          English
          arrow-up
          1
          arrow-down
          2
          ·
          6 days ago

          I’m not sure if that would rise the level of ‘catastrophe’ but it would certainly draw a lot of power, which would be bad for the climate, since much of that power would come from burning fossil fuels.

          • mindbleach@sh.itjust.works
            link
            fedilink
            arrow-up
            3
            arrow-down
            2
            ·
            6 days ago

            Does the general existence of the video game industry deserve the same finger-wagging about environmental impact? Guy in the other subthread did the math for everyone downloading this one file, and refuses to extend that concern to all the people streaming movies.

            I don’t feel like using your video card is the worst thing most randos have done re: climate change. There’s some uncomfortable accounting every time you eat a hamburger.

            The power involved here is just not a big deal. Not unless we want to harangue people for a variety of other unremarkable habits.