Companies Are Throttling Employees’ AI Use Because It’s Too Expensive
3 months ago by sanitation to c/technology
Start by learning all the critical things like Skills, MCP, Agents, etc.
Then look up skills and MCP tools that reduce token usage, improve recall, improve searching, improve parsing, etc
Then learn how to use sub agents bound to cheaper models for more expensive operations (the largest of which us always search and find ops)
Swapping to a cheaper model for a subagent with the job to just go find a specific thing alone can reduce costs like 30%, equipping it with tools that can search and find faster can push that to 70%
@lemmy.world
go to feed...
@lemmy.world
go to feed...
Thus just in: handing your employees a bunch of nail guns with near zero effort put into training them on how to use the nail guns has resulted in terrible outcomes, to no one's surprise.
Its possible to use the tools efficiently at a low cost.
But the average dev Ive worked with has zero clue how to do this and has had zero training and will just rip through tokens willy nilly.
save