Deploy AI medical copilot by using Microsoft healthcare agent service and use it in Powerapps

Hello all Power enthusiasts, welcome to my new blog. This is about how to deploy a AI medical Copilot and use in PowerApps. Before starting the steps about the confirguration here is a brief description about AI medical Copilot. AI medical copilot is a novel technique for clinicians to improve their clinical documentation and decision-making. It can provide numerous advantages, including increased efficiency, quality, and results. However, it faces numerous obstacles and constraints, including data quality, data privacy, human factors, and clinical validation. AI medical copilot is not a replacement for human doctors, but rather a smart assistant who may supplement and enhance their clinical workflow.

To create an AI medical copilot we are going to use Microsoft Healthcare Agent service.The Healthcare agent service is a cloud platform that enables developers in healthcare organizations to create and deploy compliant Generative AI healthcare copilots. These cutting-edge tools assist to expedite procedures, improve patient experiences, and lower operating expenses. Using Generative AI, healthcare organizations can develop intelligent systems that act as copilots for healthcare professionals, allowing them to successfully manage administrative tasks and improve service delivery.

Following are the objectives of this blog:

Objectives:-

Tasks

1. Create your healthcare agent service with Copilot Features.
2. Download and configure your Copilot Studio integration.
3. Allow Copilot Studio to contact the healthcare agent service.
4. Utilize the healthcare agent service in Copilot Studio.
5. Use the Copilot in Powerapps.

Prerequisites:-

• Access to Power Platform with Premium connection.
• Access to Power Copilot Studio.
• Basic understanding of Microsoft Power Platform
• Experience in administering solutions in Microsoft Azure is preferred.

Here’s a step-by-step guide to help you configure AI medical Copilot and apply it in PowerApps.

Task 1: Create your healthcare agent service with Copilot Features.

In this task, you create a healthcare agent service using Copilot features.

• Log in to Microsoft Azure portal.
• In the Azure global search, look for "healthcare agent service". Then select the Healthcare agent service from the list.

• In the healthcare agent service management portal, select "Create" to create a new healthcare agent service instance.

• Follow the steps in the resource creation wizard and provide the required details for your new healthcare agent service resource. It's important to select the Agent Tier to have access to the Copilot Studio Connector.

• Enter the details as per the below image and click Review + Create.

• Once the validation completed successfully, please select Create.
• After completing the deployment, click on Go to resource. When you create a healthcare agent service in the Agent Tier, you will automatically gain access to all copilot functionalities. By default, we enable the Healthcare Orchestrator, which includes Generative Credible Fallback.

• In the overview section you can see the management portal link, please copy the link and paste in a new tab.

If it ask for credentials, please enter your credentials to access the Healthcare agent service - ai-medical-copilot portal.

Task 2: Download and configure your Copilot Studio integration.

• You must download the pre-configured Copilot Studio Solution from the healthcare agent service portal in order to begin the Copilot Studio integration. Choose the Bot Administration icon located on the upper right corner of the page once you are in the portal.

• On the side pane you can now download your Copilot Studio Solution.

• Once the solution has been downloaded, open Copilot Studio, choose Copilots, and then click Import Copilot.

• After you clicked on Import Copilot, then click on Go to Solutions, then click on import solutions.

• On the side screen click on Browse button and select the downloaded copilot solution, it should be a zip file and click on Next.

• On the next screen make sure Enable Plugin steps and flows included in the solution is enabled and then click on Next.

• The solution requires two parameters, which are already pre-populated and linked to your healthcare agent service. There is no need to update these parameters and then click Import.

• Now your solution is importing. Please wait, it will take couple of minutes to complete.

• After sometime you can see the imported solution.

Task 3: Allow Copilot Studio to contact the healthcare agent service.

When the import is finished, you see a new Copilot in your Copilot Studio environment called ai-medical-copilot agent Before calling the healthcare agent service from Copilot Studio, you need to configure one last security element.

• Navigate to Copilot Studio Click on the ai-medical-copilot agent, then select Settings and then select Advanced and then Metadata.

• Copy your Copilot app ID.

• Navigate to your healthcare agent service instance and select on
  Integration - Skills.

• Make sure that Accept requests from any skill consumer is disabled.
  Enabling this means everyone can call your bot.

• Select on Add new item and fill in the Copilot app ID in the Skill consumer bot app ID and select Save from the top.

Task 4: Utilize the healthcare agent service in Copilot Studio.

Navigate back to Copilot Studio.

• Select Knowledge pane and add one or two public websites link to add knowledge so your copilot can provide more relevant information and insights about the subject.

• After entering the link please click Add.

• You have successfully added the knowledge base to the copilot.

• Select the imported Copilot and go to Actions,and click on Healthcare actions.

This is a dedicated action that directs all healthcare-related inquiries to the healthcare agent service.

You can now begin asking healthcare-related questions in Copilot Studio, which are safeguarded by the Healthcare Safeguards, based on your or our reputable sources, and orchestrated by a healthcare-specific orchestrator.

• Test your copilot by entering some medical related questions.

Task 5: Use the Copilot in Powerapps.

• Go to your Powerapps platform and select apps, then select Start with copilot.

• Enter Health App and click on Generate.

• After generating the related tables please select Save and Open App. The app will create in few minutes.
• After creating the app, please save and publish the app.
• After publishing the app go to the solutions and select ai_medical_copilot_agent solution.
• Select +Add Existing, then select App - Canvas App.

• Select the Health App from the existing canvas app list and then click Add.

• Select the app and click on play.

• You can see there is no copilot available with the app on the top of the screen.

• Open the Powerapp studio by clicking on the Health App, then select Settings icon from the left side of the screen.

• On the Settings window select Copilot and then select ai_medical_copilot_agent copilot. Please save and publish the app.

• The new version of the app updated and you can play the app again.You can see the Copilot along with the app.

Successfully completed a small example of creating a Copilot by using Microsoft Healthcare Agent service, imported in Copilot studio and then publishing along with a Powerapp canvas app.

Thanks all !!!

Hope You Enjoyed the Post!!!

Keep Learning | Spread Knowledge | Stay blessed |