Post Overview

  • Using Bing Search to ground LLM responses

    Using Bing Search to ground LLM responses

    We often get the question to build an assistant based on the content of a website. These assistants often get implemented in one of two ways: In both cases, you have to make a decision about how to ground the LLM with your website content. There are several approaches: In the first two approaches, you… Read more

  • Creating an agent with the Azure AI Agent SDK

    Azure AI Agents Service simplifies building intelligent agents by combining advanced AI models, tools, and technology from Microsoft, OpenAI, and partners like Meta and Cohere. It enables integration with knowledge sources such as Bing, SharePoint, and Azure AI Search, and lets agents perform actions across Microsoft and third-party applications using Logic Apps, Azure Functions, and… Read more

  • Using WebRTC with the OpenAI Realtime API

    Using WebRTC with the OpenAI Realtime API

    In October 2024, OpenAI introduced the Realtime API. It enables developers to integrate low-latency, multimodal conversational experiences into their applications. It supports both text and audio inputs and outputs, facilitating natural speech-to-speech interactions without the need for multiple models. It addresses the following problems: If you have used Advanced Voice Mode in ChatGPT, the Realtime… Read more

  • Using the Azure AI Inference Service

    Using the Azure AI Inference Service

    If you are a generative AI developer that works with different LLMs, it can be cumbersome to make sure your code works with your LLM of choice. You might start with Azure OpenAI models and the OpenAI APIs but later decide you want to use a Phi-3 model. What do you do in that case?… Read more

  • Create a Copilot declarative agent that calls an API with authentication

    Create a Copilot declarative agent that calls an API with authentication

    In a previous post, we looked at creating a Copilot declarative agent. The agent had one custom action that called the JSONPlaceholder API. Check that post for an introduction to what these agents can do. Using a dummy, unauthenticated API is not much fun so let’s take a look at doing the same for a… Read more

  • Creating a Copilot declarative agent with VS Code and the Teams Toolkit

    Creating a Copilot declarative agent with VS Code and the Teams Toolkit

    If you are a Microsoft 365 Copilot user, you have probably seen that the words “agent” and “Copilot agent” are popping up here and there. For example, if you chat with Copilot there is an Agents section in the top right corner: Above, there is a Visual Creator agent that’s built-in. It’s an agent dedicated… Read more