OpenAI

Microsoft and GitHub recently introduced new usage limits and charges for premium AI models in Copilot. Under the new structure - standard subscriptions now have a strict monthly quota for queries using top-tier models like GPT-4o or Claude 3.5 Sonnet. Once you hit the limit, you either pay extra or fall back to standard base models.

They were completely honest about the reason: the massive operational cost of running advanced frontier models at scale.

Across consultations on bringing AI into client products, the same concerns keep surfacing: unpredictable spend, lack of visibility into usage, and the risk of runaway bills from bugs or developers’ misuse. Clients ask for monitoring, budgets, alerts, and cost allocation at various levels of granularity — by project, feature, environment, region, and team — along with credible forecasts. To streamline those conversations, I decided to put the key guidance and patterns into this blog post.

Recently, while developing my AI agent library, agentai, I introduced a new CI pipeline to run examples against various models for each pull request. This process ensures that all elements of the library work correctly with each new release. I started by running these tests using GitHub Models, primarily for convenience (as they are already integrated) and to enable external contributors to use the same test suite in the same environment.