The usage field that sums prompt_tokens and completion_tokens, for example 37 + 86 = 123. Billing applies to both kinds of token.
Also called usage.
Read more: Microsoft Learn
In the Ultra Transcenders books
Each book explains total_tokens in context, with comparison tables and the common traps.
Terms in this definition
- Token
The unit of text an LLM works with, which may be a word, part of a word or punctuation. Billing, limits and context windows are all counted in these units.
Related terms
- Agent Dashboard
Gives leaders and analysts a picture of agent uptake and the credits those agents burn through, inside Viva Insights. It won't show data until a tenant has 50 or more Microsoft Copilot licences plus some agent usage.
- API Management llm-token-limit policy
Inbound AI gateway policy that caps token usage per counter key. Exceeding tokens-per-minute produces 429, an exhausted token quota produces 403, and estimate-prompt-tokens lets it reject before calling the backend.
- Background operation
Refreshes, scheduled jobs and most warehouse work fall into this Fabric capacity category, and their compute usage is smoothed across a full 24 hours. Interactive work, report queries for example, is smoothed over a much shorter 5 to 64 minutes.
- Billing policy
Ties an Azure subscription and resource group to the whole tenant or to one group, so that pay-as-you-go Copilot usage (SharePoint agents or agents in Copilot Chat, for instance) gets charged. Admins create them in the Microsoft 365 admin center, can have 50 at most, and a budget on one only raises alerts.
- Capacity notifications
Settings on a capacity that send an email to its admins, or to named contacts, once usage crosses a chosen percentage or goes beyond what is available. Usage is checked every quarter of an hour, and the same alert is sent at most once in three hours.
- Cloud computing
Getting servers, storage, databases, networking, software, analytics and similar services over the internet, with charges based on usage instead of buying equipment in advance.
- Connected mode
Online licensing option for VCF Operations, and the preferred one: registration with the Business Services console happens over the internet and usage reporting needs no manual steps.
- Consumption Dashboard
A Viva Insights dashboard within Copilot Analytics that breaks down Copilot Credit usage by agent, service and user. Analysts, managers and Global Administrators can use it.