DEV Community: Brady Guy Chambers

The importance of release testing & questionable compiler optimizations

Brady Guy Chambers — Fri, 06 Dec 2024 16:29:59 +0000

I ran into a problem with an azure function this week while working on my mobile project MyNextBook and prototyping some Microsoft Azure OpenAI capabilities. The core code of the function is relatively simple and didn’t take much time at all to knock out. Getting Azure resource configured correctly took most of the time and then the discovery of compiler optimization error took quite some time to figure out. After some debugging time with writeline statements I realized that the json being produced was different in release mode. With a little help from github CoPilot a more detailed explanation explained the problem.

Azure OpenAI C# some Learnings

Brady Guy Chambers — Wed, 20 Nov 2024 21:01:12 +0000

I have shared a detailed practicle example of using Azure OpenAI with REST and the OpenAI SDK at the link below. Some of the quick learnings are:

Models that don't support standardized_output you pass in either a json schema or an example json document that represents what you want to come out of the model.
If content filters are triggered you still get a 200, your json is truncated and the response includes a json section that defines the content filtering results. Note: this is what I observed with the Azure OpenAI hosted models. Be sure and look at the returned response and parse through the content filter sections.
If the model does not support image input an error something like : Error copying to stream is returned.
structured_output – way cool for the models that support it, if you have a class that you want the model to return the answer in use the CreateJsonSchemaFormat with your class. Not that many models currently support structured output.

ChatCompletionOptions options = new ChatCompletionOptions() { ResponseFormat = StructuredOutputsExtensions.CreateJsonSchemaFormat<Recipe>(“Recipe”, jsonSchemaIsStrict: true), MaxOutputTokenCount = 14000, Temperature = 0.1f, TopP = 1.0f, };
Azure OpenAI C# Learnings

Azure Icons Cheat Sheet

Brady Guy Chambers — Tue, 19 Nov 2024 15:57:25 +0000

Fellow architects and Azure solutions designers: Microsoft makes available their azure public service icons for download. I could not find a cheat sheet that would allow me to quickly and easily find the icon I was looking for. Find here a pdf version that shows all the icons for quick reference.

Azure Icons Cheat Sheet