Millions of people use Azure AI Search every day without knowing it. You can enable your apps with the same search that enables retrieval-augmented generation (RAG) capabilities when you build Custom GPTs or attach files in your ChatGPT prompts.

Pablo Castro, Microsoft CVP and Distinguished Engineer Azure AI Search, joins Jeremy Chapman to share how with Azure AI Search, you can create custom applications that retrieve the most relevant information quickly and accurately, even from billions of records.

Manage massive-scale datasets while maintaining high-quality search results with ultra-compact, binary quantized vector search indexes that use Matryoshka Representation Learning (MRL) and oversampling to equal the search accuracy of vector indexes up to 96 times larger. These approaches drive significant cost savings by optimizing your vector indexes without compromising quality.

► QUICK LINKS: 00:00 - RAG powered by Azure AI Search 00:50 - Azure AI Search role in ChatGPT 02:01 - Azure AI Search use case - AT&T 03:27 - Start in Azure Portal 04:35 - Massive scale and vector index 06:08 - Scalar & Binary Quantization 07:21 - Martyoshka technique 09:07 - Oversampling 11:31 - How to build an app using Azure AI Search 13:00 - See it in action 14:28 - Enable binary quantization with oversampling 14:54 - Wrap up

► Link References

Get sample code on GitHub at https://aka.ms/SearchQuantizationSample 

Check out search solutions at https://aka.ms/AzureAISearch

► Unfamiliar with Microsoft Mechanics? 

As Microsoft's official video series for IT, you can watch and share valuable content and demos of current and upcoming tech from the people who build it at Microsoft.

• Subscribe to our YouTube: https://www.youtube.com/c/MicrosoftMechanicsSeries

• Talk with other IT Pros, join us on the Microsoft Tech Community: https://techcommunity.microsoft.com/t5/microsoft-mechanics-blog/bg-p/MicrosoftMechanicsBlog

• Watch or listen from anywhere, subscribe to our podcast: https://microsoftmechanics.libsyn.com/podcast

► Keep getting this insider knowledge, join us on social:

• Follow us on Twitter: https://twitter.com/MSFTMechanics 

• Share knowledge on LinkedIn: https://www.linkedin.com/company/microsoft-mechanics/

• Enjoy us on Instagram: https://www.instagram.com/msftmechanics/

• Loosen up with us on TikTok: https://www.tiktok.com/@msftmechanics

Take a look at how wave two of Microsoft 365 Copilot can specifically help your small business by leveraging the secure application of generative AI with your work data. Use it to author presentations and content, reduce digital debt to focus on what’s important as you engage with customers, and automate everyday tasks and processes. For IT, see how to light up Microsoft 365 Copilot in your tenant, and get tips and resources for onboarding your organization.

Mary David Pasch, Principal Product Manager for Microsoft 365 Copilot, joins Jeremy Chapman to share how to use Copilot to save time, drive productivity, and foster stronger connections with your customers.

► QUICK LINKS: 00:00 - Microsoft 365 Copilot Small Business Guide 00:53 - Save time 02:14 - Privacy & safety 05:03 - How Microsoft 365 Copilot can assist you 06:24 - Work smarter, improve skill sets 08:13 - Create custom experiences 08:48 - Enable Copilot and onboard users 10:28 - How to apply Copilot to specific areas in your company 12:18 - Guidance & resources 14:07 - Wrap up 

► Link References

Watch our whole series at https://aka.ms/CopilotSMBMechanics

Check out our show on preparing for Copilot at https://aka.ms/SMBOversharingMechanics See how to create custom experiences at https://aka.ms/Wave2Mechanics

Use role-based scenario guidance at https://aka.ms/AIforAll Get a Success Kit at https://aka.ms/CopilotSMBSuccesskit

Sign up for or watch Quickstart Training at https://aka.ms/QuickStartCopilot 

► Unfamiliar with Microsoft Mechanics? 

As Microsoft's official video series for IT, you can watch and share valuable content and demos of current and upcoming tech from the people who build it at Microsoft.

• Subscribe to our YouTube: https://www.youtube.com/c/MicrosoftMechanicsSeries

• Talk with other IT Pros, join us on the Microsoft Tech Community: https://techcommunity.microsoft.com/t5/microsoft-mechanics-blog/bg-p/MicrosoftMechanicsBlog

• Watch or listen from anywhere, subscribe to our podcast: https://microsoftmechanics.libsyn.com/podcast

► Keep getting this insider knowledge, join us on social:

• Follow us on Twitter: https://twitter.com/MSFTMechanics 

• Share knowledge on LinkedIn: https://www.linkedin.com/company/microsoft-mechanics/

• Enjoy us on Instagram: https://www.instagram.com/msftmechanics/

• Loosen up with us on TikTok: https://www.tiktok.com/@msftmechanics

What are prompt injection attacks and how do you stop them? How do you avoid deceptive responses? Can AI traffic be end-to-end encrypted? We'll answer these questions and more with technical demonstrations to make it real.

Mark Russinovich will show you how to develop and deploy AI applications that prioritize safety, privacy, and integrity. Leverage real-time safety guardrails to filter harmful content and proactively prevent misuse, ensuring AI outputs are trustworthy. The integration of confidential inferencing enables users to maintain data privacy by encrypting information during processing, safeguarding sensitive data from exposure. Enhance AI solutions with advanced features like Groundedness detection, which provides real-time corrections to inaccurate outputs, and the Confidential Computing initiative that extends verifiable privacy across all services.

Mark Russinovich, Azure CTO, joins Jeremy Chapman to share how to build secure AI applications, monitor and manage potential risks, and ensure compliance with privacy regulations.

► QUICK LINKS: 00:00 - Keep data safe and private 01:19 - Azure AI Content Safety capability set 02:17 - Direct jailbreak attack 03:47 - Put controls in place 04:54 - Indirect prompt injection attack 05:57 - Options to monitor attacks over time 06:22 - Groundedness detection 07:45 - Privacy—Confidential Computing 09:40 - Confidential inferencing Model-as-a-service 11:31 - Ensure services and APIs are trustworthy 11:50 - Security 12:51 - Web Query Transparency 13:51 - Microsoft Defender for Cloud Apps 15:16 - Wrap up

► Link References

Check out https://aka.ms/MicrosoftTrustworthyAI 

For verifiable privacy, go to our blog at https://aka.ms/ConfidentialInferencing 

► Unfamiliar with Microsoft Mechanics? 

As Microsoft's official video series for IT, you can watch and share valuable content and demos of current and upcoming tech from the people who build it at Microsoft.

• Subscribe to our YouTube: https://www.youtube.com/c/MicrosoftMechanicsSeries

• Talk with other IT Pros, join us on the Microsoft Tech Community: https://techcommunity.microsoft.com/t5/microsoft-mechanics-blog/bg-p/MicrosoftMechanicsBlog

• Watch or listen from anywhere, subscribe to our podcast: https://microsoftmechanics.libsyn.com/podcast

► Keep getting this insider knowledge, join us on social:

• Follow us on Twitter: https://twitter.com/MSFTMechanics 

• Share knowledge on LinkedIn: https://www.linkedin.com/company/microsoft-mechanics/

• Enjoy us on Instagram: https://www.instagram.com/msftmechanics/

• Loosen up with us on TikTok: https://www.tiktok.com/@msftmechanics

With more than 1700 models to choose from on Azure, selecting the right one is key to enabling the right capabilities, at the right price point, and with the right protections in place. That's where the Azure AI model catalog and model benchmarks can help.

With Azure AI, you can seamlessly integrate powerful GenAI models into your app development process, making your applications smarter, more efficient, and highly scalable. Access a vast selection of AI models, from sophisticated large language models to efficient small models that can run offline.

Matt McSpirit, Microsoft Azure expert, shows how to compare and select the right AI model for your specific needs. Azure AI's model benchmarks evaluate models on accuracy, coherence, groundedness, fluency, relevance, and similarity. Experiment with different models in Azure AI Studio or your preferred coding environment, and optimize costs with serverless pricing options.

► QUICK LINKS:

00:00 - Build GenAI powered apps 00:53 - Model choice 02:11 - Use your environments of choice 02:44 - Choose the right AI model 05:28 - Compare models 08:04 - Wrap up

► Link References Get started at https://ai.azure.com  

See data, privacy, and security for use of models at https://aka.ms/AzureAImodelcontrols

► Unfamiliar with Microsoft Mechanics? 

As Microsoft's official video series for IT, you can watch and share valuable content and demos of current and upcoming tech from the people who build it at Microsoft.

• Subscribe to our YouTube: https://www.youtube.com/c/MicrosoftMechanicsSeries • Talk with other IT Pros, join us on the Microsoft Tech Community: https://techcommunity.microsoft.com/t5/microsoft-mechanics-blog/bg-p/MicrosoftMechanicsBlog • Watch or listen from anywhere, subscribe to our podcast: https://microsoftmechanics.libsyn.com/podcast

► Keep getting this insider knowledge, join us on social:

• Follow us on Twitter: https://twitter.com/MSFTMechanics • Share knowledge on LinkedIn: https://www.linkedin.com/company/microsoft-mechanics • Enjoy us on Instagram: https://www.instagram.com/msftmechanics • Loosen up with us on TikTok: https://www.tiktok.com/@msftmechanics

Streamline threat detection and response across diverse environments with Microsoft Sentinel, your cloud-native SIEM solution. With features like Auxiliary logs for low-cost storage and proactive data optimization recommendations, you can efficiently manage high volumes of security data without compromising on threat intelligence. Leverage built-in AI and automation to uncover hidden threats and reduce investigation time from days to minutes.

Rob Lefferts, CVP for Security Solutions at Microsoft, joins Jeremy Chapman to show how to migrate from existing SIEM solutions with built-in migration tools, ensuring seamless access to your security logs while maintaining investigative integrity.

► QUICK LINKS: 00:00 - Microsoft Sentinel, modern Cloud SIEM 01:12 - Unified security operations platform 02:55 - Prioritize security updates 04:27 - Storage options 05:11 - Optimize data coverage and usage 06:17 - Protect against long-term persistent attacks 07:58 - Automation using auxiliary logs 08:59 - Manual effort 10:10 - Automation 12:07 - Migration 13:31 - Wrap up

► Link References

Get started at https://aka.ms/MicrosoftSentinel Find samples for the Playbook Logic App and the Function app at https://aka.ms/AuxLogsTIapp

► Unfamiliar with Microsoft Mechanics? 

As Microsoft's official video series for IT, you can watch and share valuable content and demos of current and upcoming tech from the people who build it at Microsoft.

• Subscribe to our YouTube: https://www.youtube.com/c/MicrosoftMechanicsSeries

• Talk with other IT Pros, join us on the Microsoft Tech Community: https://techcommunity.microsoft.com/t5/microsoft-mechanics-blog/bg-p/MicrosoftMechanicsBlog

• Watch or listen from anywhere, subscribe to our podcast: https://microsoftmechanics.libsyn.com/podcast

► Keep getting this insider knowledge, join us on social:

• Follow us on Twitter: https://twitter.com/MSFTMechanics 

• Share knowledge on LinkedIn: https://www.linkedin.com/company/microsoft-mechanics/

• Enjoy us on Instagram: https://www.instagram.com/msftmechanics/

• Loosen up with us on TikTok: https://www.tiktok.com/@msftmechanics

Build your own custom applications with Azure AI right from your code. With Azure AI, leverage over 1,700 models, seamlessly integrating them into your coding environment to create tailored app experiences. Utilize features like Retrieval Augmented Generation and vector search to enrich responses with contextual information, as well as prebuilt Azure AI services to incorporate cognitive skills such as language, vision, and safety detection.

Dan Taylor, Principal Product Architect for Microsoft Azure AI, also shares how to streamline your development process with tools for orchestration and monitoring. Use templates to simplify resource deployment and run evaluations against large datasets to optimize performance. With Application Insights, gain visibility into your app's metrics, enabling data-driven decisions for continuous improvement.

► QUICK LINKS: 00:00 - Build custom AI apps with the studio in Azure AI 00:27 - Leverage the studio in Azure AI 01:37 - Build apps grounded on custom data 03:03 - Retrieval Augmented Generation 03:48 - Vector search 04:17 - Set up your coding environment 06:11 - How to build in code 07:16 - Traces 07:45 - Evaluate performance against large data set 08:19 - Options for monitoring 08:58 - Wrap up

► Link References

To get started, go to https://ai.azure.com

Check out our code samples at https://aka.ms/AIAppTemplates

► Unfamiliar with Microsoft Mechanics? 

As Microsoft's official video series for IT, you can watch and share valuable content and demos of current and upcoming tech from the people who build it at Microsoft.

• Subscribe to our YouTube: https://www.youtube.com/c/MicrosoftMechanicsSeries

• Talk with other IT Pros, join us on the Microsoft Tech Community: https://techcommunity.microsoft.com/t5/microsoft-mechanics-blog/bg-p/MicrosoftMechanicsBlog

• Watch or listen from anywhere, subscribe to our podcast: https://microsoftmechanics.libsyn.com/podcast

► Keep getting this insider knowledge, join us on social:

• Follow us on Twitter: https://twitter.com/MSFTMechanics 

• Share knowledge on LinkedIn: https://www.linkedin.com/company/microsoft-mechanics/

• Enjoy us on Instagram: https://www.instagram.com/msftmechanics/

• Loosen up with us on TikTok: https://www.tiktok.com/@msftmechanics

Enhance security, performance, and user experience with Windows 11, version 24H2. Keep your data and identity protected with features like personal data encryption, Windows Hello with passkeys, and Windows Studio Effects. Built-in AI capabilities, including live captions with real-time translation and advanced video call enhancements, leverage powerful NPUs for seamless, efficient performance. Whether you’re a business professional or a creative, Windows 11, version 24H2 offers significant improvements in productivity, energy efficiency, and multitasking capabilities.

Deployment and migration is straightforward, ensuring compatibility with most existing hardware and peripherals. Tools like Windows Autopatch and Windows Autopilot, integrated with Microsoft Intune, streamline the update and provisioning processes, making device setup and compliance effortless. Jeremy Chapman, Director of Microsoft 365 shares how Windows 11, version 24H2 ensures your organization stays secure, productive, and ready for the future.

► QUICK LINKS: 00:00 - Windows 11, version 24H2 00:51 - Personal Data Encryption 02:20 - Windows Hello with passkeys 03:26 - Default proactive protection 04:01 - Windows 11, version 24H2 updates 05:35 - Accessibility updates 06:03 - AI capabilities- live captions 07:13 - Built-in AI—Windows Studio Effects 08:29 - Performance and efficiency 09:13 - Deployment and migration 10:25 - Windows Autopatch 11:36 - Windows Autopilot 12:29 - Wrap up

► Link References

Get started at https://aka.ms/Windows11Enterprise 

► Unfamiliar with Microsoft Mechanics? 

As Microsoft's official video series for IT, you can watch and share valuable content and demos of current and upcoming tech from the people who build it at Microsoft.

• Subscribe to our YouTube: https://www.youtube.com/c/MicrosoftMechanicsSeries

• Talk with other IT Pros, join us on the Microsoft Tech Community: https://techcommunity.microsoft.com/t5/microsoft-mechanics-blog/bg-p/MicrosoftMechanicsBlog

• Watch or listen from anywhere, subscribe to our podcast: https://microsoftmechanics.libsyn.com/podcast

► Keep getting this insider knowledge, join us on social:

• Follow us on Twitter: https://twitter.com/MSFTMechanics 

• Share knowledge on LinkedIn: https://www.linkedin.com/company/microsoft-mechanics/

• Enjoy us on Instagram: https://www.instagram.com/msftmechanics/

• Loosen up with us on TikTok: https://www.tiktok.com/@msftmechanics

Prevent attackers from stealing your identity and data by protecting your tokens. In single sign-on systems like SAML and OAUTH, tokens are how services know who you are and what you can do. When you sign in to your machine with your Microsoft Entra ID account, you are getting a session token you can use to access things like your email, teams and other apps. Check out new capabilities like Credential Guard in Windows enforced by device policies in Intune, Token Protection enforcement in Microsoft Entra, and Token theft detections in Microsoft Sentinel and Defender XDR.

Alex Weinert, from the Microsoft Entra team, explains what tokens are, how token theft works, and how to defend yourself from these attacks.

► QUICK LINKS: 00:00 - Token theft attacks 01:39 - Token basics 02:59 - Token theft demo 03:41 - How to use token protection 05:22 - Additional Token theft defenses 06:25 - How to detect and shut down attacks 08:01 - Wrap up

► Link References

Get started at https://aka.ms/TokenTheftDefense

► Unfamiliar with Microsoft Mechanics? 

As Microsoft's official video series for IT, you can watch and share valuable content and demos of current and upcoming tech from the people who build it at Microsoft.

• Subscribe to our YouTube: https://www.youtube.com/c/MicrosoftMechanicsSeries

• Talk with other IT Pros, join us on the Microsoft Tech Community: https://techcommunity.microsoft.com/t5/microsoft-mechanics-blog/bg-p/MicrosoftMechanicsBlog

• Watch or listen from anywhere, subscribe to our podcast: https://microsoftmechanics.libsyn.com/podcast

► Keep getting this insider knowledge, join us on social:

• Follow us on Twitter: https://twitter.com/MSFTMechanics 

• Share knowledge on LinkedIn: https://www.linkedin.com/company/microsoft-mechanics/

• Enjoy us on Instagram: https://www.instagram.com/msftmechanics/

• Loosen up with us on TikTok: https://www.tiktok.com/@msftmechanics

Check out Microsoft 365 Copilot Wave Two updates, featuring Business Chat and the new Copilot Pages for enhanced collaboration, advancements in Excel data analysis, AI-driven file comparisons in OneDrive, and easy-to-create Copilot agents for automating business processes. If you are in IT, we’ll show you improved integrations with our security and compliance stack.

Mary Pasch, Principal Product Manager, joins Jeremy Chapman to walk through the updates, including what it means for Microsoft 365 admins.

► QUICK LINKS: 00:00 - Microsoft 365 Copilot Wave Two 00:45 - How Copilot is evolving 01:32 - BizChat and Copilot Pages 02:58 - Copilot in Excel 04:41 - Copilot using Python in Excel 06:05 - Compare and contrast documents 07:18 - Create Copilot agents from BizChat 08:44 - Create Copilot agents from SharePoint 10:12 - .copilot files 10:44 - Enterprise-grade data protection 13:54 - Wrap up

► Link References

Check out new Copilot experiences at https://aka.ms/CopilotWave2

Access advanced enterprise data protections at http://microsoft.com/copilot

► Unfamiliar with Microsoft Mechanics? 

As Microsoft's official video series for IT, you can watch and share valuable content and demos of current and upcoming tech from the people who build it at Microsoft.

• Subscribe to our YouTube: https://www.youtube.com/c/MicrosoftMechanicsSeries

• Talk with other IT Pros, join us on the Microsoft Tech Community: https://techcommunity.microsoft.com/t5/microsoft-mechanics-blog/bg-p/MicrosoftMechanicsBlog

• Watch or listen from anywhere, subscribe to our podcast: https://microsoftmechanics.libsyn.com/podcast

► Keep getting this insider knowledge, join us on social:

• Follow us on Twitter: https://twitter.com/MSFTMechanics 

• Share knowledge on LinkedIn: https://www.linkedin.com/company/microsoft-mechanics/

• Enjoy us on Instagram: https://www.instagram.com/msftmechanics/

• Loosen up with us on TikTok: https://www.tiktok.com/@msftmechanics

Use Copilot agents to enhance Microsoft 365 Copilot for your own unique needs to help turn information into insights. Tailored experiences work with external data, while adding unique skills to automate everyday repeatable tasks. Using the Copilot extensibility stack, you can create your own agent experiences connected to knowledge beyond Microsoft 365 and perform actions on your behalf.

Enhance the experience with Copilot extensibility stack options:

-Connect to relevant information sources, including those outside Microsoft 365, and use APIs to read and write data in near real-time.

-Extend the Microsoft 365 Graph indexer to include additional sites or services you specify.

-Create custom Copilot agents for specific scenarios, enabling automation of tasks through defined triggers and workflows.

► QUICK LINKS: 00:00 - Copilot extensibility stack 01:00 - Plug into information sources 01:24 - Extend the Microsoft 365 Graph indexer 01:42 - Custom Copilot agents 02:00 - Enhance your Microsoft 365 Copilot experience 03:02 - Wrap up

► Unfamiliar with Microsoft Mechanics? 

As Microsoft's official video series for IT, you can watch and share valuable content and demos of current and upcoming tech from the people who build it at Microsoft.

• Subscribe to our YouTube: https://www.youtube.com/c/MicrosoftMechanicsSeries

• Talk with other IT Pros, join us on the Microsoft Tech Community: https://techcommunity.microsoft.com/t5/microsoft-mechanics-blog/bg-p/MicrosoftMechanicsBlog

• Watch or listen from anywhere, subscribe to our podcast: https://microsoftmechanics.libsyn.com/podcast

► Keep getting this insider knowledge, join us on social:

• Follow us on Twitter: https://twitter.com/MSFTMechanics 

• Share knowledge on LinkedIn: https://www.linkedin.com/company/microsoft-mechanics/

• Enjoy us on Instagram: https://www.instagram.com/msftmechanics/

• Loosen up with us on TikTok: https://www.tiktok.com/@msftmechanics

Manage your data access effectively while using Microsoft 365 Copilot. Navigate the SharePoint admin center to adjust site privacy settings, ensuring only authorized members can access sensitive content. Set up test accounts to identify potential oversharing and take corrective actions. By refining permissions, protect valuable information and enhance the relevance of AI-generated responses.

Jeremy Chapman, Director of Microsoft 365, shares how to find and control oversharing, so you can confidently utilize Microsoft 365 Copilot for your small business needs.

► QUICK LINKS: 00:00 - Prepare data for search 01:22 - Search hygiene 02:04 - Test to see who has access 02:33 - How to set up a test account 03:32 - Search for items 05:08 - Information retrieval process 05:45 - Shared items by invitation link 06:19 - Oversharing 07:33 - How to reduce oversharing 08:35 - Check permissions 11:07 - Confirm permissions are in place 11:52 - Wrap up

► Link References

Get to the SharePoint admin center from Microsoft 365’s admin center at https://admin.microsoft.com

► Unfamiliar with Microsoft Mechanics? 

As Microsoft's official video series for IT, you can watch and share valuable content and demos of current and upcoming tech from the people who build it at Microsoft.

• Subscribe to our YouTube: https://www.youtube.com/c/MicrosoftMechanicsSeries

• Talk with other IT Pros, join us on the Microsoft Tech Community: https://techcommunity.microsoft.com/t5/microsoft-mechanics-blog/bg-p/MicrosoftMechanicsBlog

• Watch or listen from anywhere, subscribe to our podcast: https://microsoftmechanics.libsyn.com/podcast

► Keep getting this insider knowledge, join us on social:

• Follow us on Twitter: https://twitter.com/MSFTMechanics 

• Share knowledge on LinkedIn: https://www.linkedin.com/company/microsoft-mechanics/

• Enjoy us on Instagram: https://www.instagram.com/msftmechanics/

• Loosen up with us on TikTok: https://www.tiktok.com/@msftmechanics