Tag: tokens
-
Relative to your interests, Tuesday
I have been on vacation for a little while, in Finland for the third time. Finland feels different than the other parts of Europe I have been to. Perhaps it’s because I spent my time there in rural Finland. But it also feels like most of Finland is rural. In that way, it feels a…
-
here come the normies
Consulting giant Accenture is trying to figure out how to stop non-technical workers from blowing through companies AI token budget on trivial tasks like converting PDFs to presentation slides, according to leaked audio obtained by 404 Media. Across the industry Accenture is seeing “soaring token spend,” according to the audio. To consider: There is a…
-
Reducing token usage
Better Defaults (not Usage Caps) — Engineers can choose any model they want, but defaults matter. We’re experimenting with defaulting to open weight models like GLM 5.2 and Kimi 2.7 through our LLM gateway, while still encouraging engineers to choose the right model for the task. 91% of our employees were never hitting their usage…
You must be logged in to post a comment.