add tokenizer ,

[3400442579]

var chatMessages= new ChatMessage[] {
ChatMessage.CreateUserMessage(cont)
}

int tokenCount=tokenizer (chatMessages); //

ChatCompletion completion = await _sdk.GetChatClient("gpt-4")
.CompleteChatAsync(
new ChatMessage[] {
ChatMessage.CreateUserMessage(cont)
}
, new OpenAI.Chat.ChatCompletionOptions
{
MaxTokens = 8192 - tokenCount
}
);

[StephenHodgson]

Personally I think a better solution is to have an endpoint that tokenizes for you.

openai/openai-openapi#205