8 billion tokens a day forced AT&T to rethink AI orchestration — and cut costs by 90%
via venturebeat.com
Short excerpt below. Read at the original source.
When your average daily token usage is 8 billion a day, you have a massive scale problem. This was the case at AT&T, and chief data officer Andy Markus and his team recognized that it simply wasn’t feasible (or economical) to push everything through large reasoning models. So, when building out an internal Ask AT&T […]