Getting truncated response from Azure OpenAI API
Hi All,
I am calling the Azure OpenAI API to get the data. I am using the below model. I am passing the data as prompt. I am trying to extract the data from a 65 page PDF file. One of the field has little more data.
Model name: gpt-4-32k
Model version: 0613
Tokens per Minute Rate Limit (thousands): 30
Rate limit (Tokens per minute): 30000
Rate limit (Requests per minute): 180
Here is the response I got. The last field i.e. ‘Limitation of Liability’ content is truncated. The total token details given in the below JSON.
{
“choices”: [
{
“finish_reason”: “stop”,
“index”: 0,
“message”: {
“content”: “{n “Trust Name”: “XXXXXX”,n “Trustee name”: “XXXX”,n “ACN”: “XXXX”,n “ABN”: “XXXXX”,n “Address”: “XXXXXXXX”,n “Trust Deed Date(a.k.a Commencement Date)”: “XXXX”,n “Expiry Date”: “XXXXX”,n “Lease Term”: “XXXXX”,n “Officer Name”: “XXXXX”,n “Officer Tile(a.k.a Designation)”: “Director, Director”,n “Limitation of liability”: “XXXXXXXXXXXXXXXXXXX”n}”,
“role”: “assistant”
}
}
],
“created”: XXXX,
“id”: “XXXXXX”,
“model”: “gpt-4-32k”,
“object”: “chat.completion”,
“system_fingerprint”: null,
“usage”: {
“completion_tokens”: 341,
“prompt_tokens”: 24600,
“total_tokens”: 24941
}
}
Please let me know how to fix it.
REgards
Anjan
Hi All,I am calling the Azure OpenAI API to get the data. I am using the below model. I am passing the data as prompt. I am trying to extract the data from a 65 page PDF file. One of the field has little more data. Model name: gpt-4-32kModel version: 0613Tokens per Minute Rate Limit (thousands): 30Rate limit (Tokens per minute): 30000Rate limit (Requests per minute): 180 Here is the response I got. The last field i.e. ‘Limitation of Liability’ content is truncated. The total token details given in the below JSON. {
“choices”: [
{
“finish_reason”: “stop”,
“index”: 0,
“message”: {
“content”: “{n “Trust Name”: “XXXXXX”,n “Trustee name”: “XXXX”,n “ACN”: “XXXX”,n “ABN”: “XXXXX”,n “Address”: “XXXXXXXX”,n “Trust Deed Date(a.k.a Commencement Date)”: “XXXX”,n “Expiry Date”: “XXXXX”,n “Lease Term”: “XXXXX”,n “Officer Name”: “XXXXX”,n “Officer Tile(a.k.a Designation)”: “Director, Director”,n “Limitation of liability”: “XXXXXXXXXXXXXXXXXXX”n}”,
“role”: “assistant”
}
}
],
“created”: XXXX,
“id”: “XXXXXX”,
“model”: “gpt-4-32k”,
“object”: “chat.completion”,
“system_fingerprint”: null,
“usage”: {
“completion_tokens”: 341,
“prompt_tokens”: 24600,
“total_tokens”: 24941
}
} Please let me know how to fix it. REgardsAnjan Read More