I just don’t understand how this is a metric now. With programmers, I can at least see how someone who doesn’t know any better might think lines of code is a good metric. But this?
And it gets worse: The company now has to pay both for its employees(’ brain) and the damn text-completion machine.
> Company sets token usage as performance metric
> I build an “agent” that uses browser automation to navigate company’s entire website and verify it for correctness on every code change
> Set it to use top model on highest effort
> Rack up thousands of dollars of usage daily
> Suddenly we all have tokens caps and it’s no longer tracked as a performance metric