Umbraco Commerce Technical Team Lead @ Umbraco HQ | Co-founder of CODECABIN | Creator of UMB.FYI
Matt Brailsford announces the integration of speech-to-text functionality in Umbraco.AI, enhancing user interaction with new microphone features in Copilot and Tiptap. This capability allows users to dictate content seamlessly, supported by a management API and a dedicated service for developers. Future enhancements may include real-time transcription and text-to-speech features.
Matt Brailsford discusses the integration of Microsoft.Extensions.AI (M.E.AI) and the Microsoft Agent Framework (MAF) in developing AI capabilities for Umbraco. The use of IChatClient and middleware patterns enabled efficient feature development and agent orchestration, allowing for scalable, transferable skills while maintaining a cohesive architecture.