Hi,

I am trying to find a way to transfer the model token usage data to BigQuery, here are my attampts:

1. OpenAI model- deployment – metrics. It provides token usage directly, but I failed to find a way to export it on a scheduled basis.

2. API management service. Not working when using streaming responses with Azure OpenAI models because it requires more configuration to capture model completions.  As I am developing a chatbot, the streaming feature is necessary.

3. Export native logs by diagnostic settings. Unfortunately there is no token usage related info included.

So I wanna kindly ask for a potential solution for exporting the token usage to BigQuery with streaming function when using openai model. Thanks!

​Hi,I am trying to find a way to transfer the model token usage data to BigQuery, here are my attampts:1. OpenAI model- deployment – metrics. It provides token usage directly, but I failed to find a way to export it on a scheduled basis.2. API management service. Not working when using streaming responses with Azure OpenAI models because it requires more configuration to capture model completions.  As I am developing a chatbot, the streaming feature is necessary.3. Export native logs by diagnostic settings. Unfortunately there is no token usage related info included. So I wanna kindly ask for a potential solution for exporting the token usage to BigQuery with streaming function when using openai model. Thanks!  Read More

​