LLM Tokens – Copilot Tokens Limit ??
How to check token consumption?
Response got from MS copilot support team: CoPilot has certain limits in place to manage the usage of LLM tokens. These limits help prevent overloading the system and ensure fair resource allocation. Specifically, users are allowed a certain number of LLM tokens per hour. If this limit is reached, they’ll need to wait before continuing their interaction with CoPilot.
It’s important to note that the calculation of LLM tokens isn’t always straightforward—it doesn’t directly correlate with the user’s input prompt. CoPilot employs complex logic to determine token usage. If you encounter any throttling, consider optimizing your prompt and reducing overall token consumption”
How to check token consumption?Response got from MS copilot support team: CoPilot has certain limits in place to manage the usage of LLM tokens. These limits help prevent overloading the system and ensure fair resource allocation. Specifically, users are allowed a certain number of LLM tokens per hour. If this limit is reached, they’ll need to wait before continuing their interaction with CoPilot.It’s important to note that the calculation of LLM tokens isn’t always straightforward—it doesn’t directly correlate with the user’s input prompt. CoPilot employs complex logic to determine token usage. If you encounter any throttling, consider optimizing your prompt and reducing overall token consumption” Read More