• John Richard@lemmy.world
      link
      fedilink
      English
      arrow-up
      22
      ·
      25 days ago

      Sucks that people lump AI into a single category of whatever cloud-hosted subscription that tech bros from Silicon Valley are pushing.

    • Fluffy Kitty Cat@slrpnk.net
      link
      fedilink
      English
      arrow-up
      3
      ·
      24 days ago

      Given how memory is the bottleneck especially at the very low end it makes me wonder if one bit quantization of an extremely large model would be a gigabyte per gigabyte of ram better