AI advances through benchmarking. The major LLMs are systematically benchmarked as they are released and compete to appear at the top of the leaderboard. When developing FinAI Intercom fought hard to improve on its own benchmarking. Is there a general approach we can take to benchmarking AI agents for business? Will value models become the standard frame for benchmarking AI agents?

Many companies are considering revising their pricing model given the rapid changes in the economy, technology advances and the emergence of agents a packaging pattern. Ibbaka has been working with Michael Mansard on a framework for pricing model assessment. We assess from the perspective of the vendor and the buyer. Intercom’s popular FinAI agent is used as an example.