• SleeplessCityLights@programming.dev
    link
    fedilink
    English
    arrow-up
    8
    ·
    2 days ago

    It’s subsidized. I will eat my hat if the number is less than 50%. It is even crazier at work. My personal account cost 3 times as much for the same prompt on my work account. Inference cost is the same for all users, you can’t mega-ultra scale something that is at maximum scale labeled as a hyper scale.

    • dan@upvote.au
      link
      fedilink
      English
      arrow-up
      1
      ·
      23 hours ago

      My personal account cost 3 times as much for the same prompt on my work account.

      That’s interesting. My employer is too large to use subscriptions and also we have our own harnesses, so they have to pay per token. Some employees spend thousands of dollars (or more) per month, but if they were doing it at home, they’d be easily able to fit the same usage into a $200/m subscription.

      • SleeplessCityLights@programming.dev
        link
        fedilink
        English
        arrow-up
        1
        ·
        19 hours ago

        I was comparing API costs at home, the plans give you a lot of value. When I had to use GitHub Copilot the API cost was closer to my home cost, but whatever Enterprise plan we have through Anthropic is crazy.

    • Wildmimic@anarchist.nexus
      link
      fedilink
      English
      arrow-up
      8
      ·
      2 days ago

      Yeah, subsidized by mainly Nvidias circular financing crap. This will cause a major recession, and it is so obvious for everyone looking at how much cash investors are throwing at this thing and how much you can actually earn with something that confidently misinforms you on the regular. Roleplaying like Character.ai is one of the better uses, because there false information isn’t that relevant. Then there’s coding where it is easy to automatically check for errors, and then… scientific uses. But i think that’s it, and you can’t prop up all that investment just with coding, RP and weather analysis (which is woke by definition in the US to boot) or interpreting CT scans.