Choosing how to charge for an AI product
Customer usage varied. Every evaluation carried an LLM cost. I connected model benchmarking with a consumption-pricing business case and secured C-suite approval.
Read the case study
The problem
A GenAI product for customer experience quality evaluation had to serve customers with very different evaluation volumes. A uniform license fee was a difficult fit for that variation.
The evidence
I tested multiple LLMs through an automated pipeline using a fixed set of call transcripts and prompts covering edge cases. LLM-as-a-judge scoring and manual review against golden data helped compare accuracy with cost per evaluation.
The decision
I weighed licensing against consumption pricing. The recommendation linked charges to usage for the GenAI capabilities within a broader model that also included subscription licensing.
Executive approval
Model-cost business cases and working AI prototypes made the trade-offs concrete. Leadership approved the consumption-pricing approach.
Model evaluation, pricing rationale, commercial packaging and the executive business case.
Quality, cost to serve and customer usage informed the recommendation.