• blackbeans@lemmy.zip
    link
    fedilink
    English
    arrow-up
    29
    ·
    2 months ago

    Personally, I find myself using the Chinese alternatives more and more as they are just way cheaper.

    • abbadon420@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      26
      arrow-down
      3
      ·
      2 months ago

      The good thing is that a deepseek can be run locally relatively well with consumer hardware. I trust chinese companies as much as i trust american companies with my data and my prompts.

        • De Lancre@lemmy.world
          link
          fedilink
          English
          arrow-up
          2
          arrow-down
          2
          ·
          edit-2
          2 months ago

          You don’t need 170+ GB of VRAM. Whole model can be run at around 1 token/second on a modern hardware from an ssd. Which is slow, don’t get me wrong, but it still somewhat useable.

          Upd.Once again, for those who use AI because struggles to read: it is slow, but it is usable. Which is, by definition, means that you don’t need 170+ GB of VRAM to run this model. Period. It runs from ssd. That is a fact.

    • mesa@piefed.social
      link
      fedilink
      English
      arrow-up
      3
      arrow-down
      1
      ·
      2 months ago

      Theres a lot of good models free online that are open source/Chinese and the only cost is a bit of slowness on my rig. No token limit or whatever. Totally agree.

      Its about as good as commercial products now…