Tag Archives: microsoft
Navigating the Generative AI Landscape with Azure AI Services: Insights from Customer Round Table
Introduction
The adoption of Generative AI (GenAI) technologies is accelerating, driven by the transformative potential they offer across various sectors. Recently, we hosted a customer round table conference at Microsoft Build, focusing on the journeys and adoption of GenAI using Azure AI services. Industry leaders from diverse fields shared their experiences, challenges, and strategies, providing invaluable insights into the practical application of Generative AI.
Azure AI Services: A Pillar in Generative AI Use Cases
Azure AI services play a crucial role in enabling businesses to leverage Generative AI effectively. These services provide the necessary infrastructure and tools to build, deploy, and scale AI applications. With services and features like the Azure OpenAI, Assistants API and Co-pilot Studio, Azure AI empowers organizations to create interactive and responsive AI solutions tailored to their specific needs. Security and privacy are also integral components of Azure AI, ensuring that AI deployments are robust and compliant with industry standards. Below are some of the insights from customers across different industries.
Scaling and Maturing in Generative AI: Insights from Consulting
A consulting firm highlighted their success in building the AI applications and the pivotal role of upskilling and developing repeatable blueprints. These strategies not only accelerated their learning curve but also supported their advancement to a mature stage in their Large Language Models (LLMs) adoption. The firm now successfully scales their Generative AI applications to more than 150,000 users, showcasing the robust capability of Azure AI to handle large-scale user bases efficiently.
Challenges in Keeping Pace: An IT Company’s Story
An IT company discussed the challenges of keeping up with rapid advancements in Generative AI technology. They are currently enabling Generative AI co-pilots for developers but find it difficult to optimize these tools within their organizational framework. This reflects a common challenge across the industry: integrating cutting-edge technology in a way that complements existing workflows and systems. Azure AI and Azure Machine Learning offer pre-built models and services that can be easily integrated into existing applications. These services provide APIs and connectors that simplify the incorporation of AI and ML into current workflows.
Story Integrating Generative AI capabilities into traditional Software Development
Multiple customers expressed interest in understanding how Generative AI capabilities can be integrated into traditional software development life cycles and programming languages. There is a keen interest in exploring potential use cases that could revolutionize operations and customer service across the industries.
Operational Efficiency and DevOps: Device Manufacturer’s Experience
A device manufacturer shared their journey of embedding LLM applications within their DevOps workflows. They discussed the nuances of LLMOps and how it differs from traditional operations, highlighting the operational efficiencies gained through Generative AI integration.
Hospitality Industry Exploration
A hospitality company was eager to learn and explore embedding Generative AI into their business operations to enhance customer experience and streamline service delivery. This reflects a broader trend of industries seeking to leverage AI to add value to their customer interactions and internal processes.
Health Insurance Innovations
A health insurance provider discussed automating claims and Electronic Medical Records (EMR), which could significantly reduce processing times and errors. At Microsoft, we are dedicated to helping customers and partners leverage AI in healthcare by bridging data, AI, and trust. Our goal is to accelerate digital transformation through trusted, secure, and scalable platforms and tools that enable data management, analysis, sharing, and the development, deployment, and monitoring of AI solutions.
Multi-Agent Scenarios in Manufacturing and Office Supplies
AutoGen is a framework for simplifying the orchestration, optimization, and automation of LLM workflows. It offers customizable and conversable agents that leverage the strongest capabilities of the most advanced LLMs, like GPT-4, while addressing their limitations by integrating with humans and tools and having conversations between multiple agents via automated chat. Manufacturing and office supplies customers explored multi-agent scenarios using the framework, potentially enhancing customer interaction and operational automation.
AI COE in Oil and Gas
The AI Center of Excellence (COE) team from an Oil and Gas company has been instrumental in showcasing the transformative power of AI. They have shared valuable insights into their long-standing AI journey, emphasizing a well-established execution rhythm that has become a cornerstone of their operations. This rhythm allows for the continuous improvement and integration of AI technologies, ensuring they remain at the forefront of innovation.
Conclusion
The round table provided a panoramic view of how various industries are navigating their Generative AI adoption journeys. From operational integration to scaling user bases and addressing security concerns, the insights shared underscore the dynamic nature of AI technology and its impact across sectors.
Nick Brady, a seasoned program manager from the Azure OpenAI team, shared his expertise with customers on building AI products designed to accelerate AI development. He detailed the strategic approach and best practices employed by his team, focusing on creating scalable, secure, and user-friendly AI solutions. Kranthi Manchikanti and Marc Nehme from Azure specialized AI Tech strategy team also provided valuable guidance on overcoming common challenges and maximizing the potential of AI technologies in various industries. As Azure continues to evolve its AI services, these dialogues are invaluable for shaping a more informed, efficient, and innovative adoption path for businesses worldwide.
This conference has set the stage for ongoing collaboration and innovation in the Generative AI space, promising exciting developments ahead for Azure AI users and the broader tech community.
Microsoft Tech Community – Latest Blogs –Read More
combine information from 2 tabs in 1 file based on common information (EAN)
I could not download the info needed in 1 file so I have downloaded 2 files.
i combined the 2 in 1 file 2 tabs.
1 file has amongst other info: EAN and article name.
file 2 has among other, EAN and stock qtt
how can I now import the stock qtt from tab 2 in tab 1 based on the EAN
so: if EAN = 1234567891011 the stock should be …..
quess can be doe by formule
I could not download the info needed in 1 file so I have downloaded 2 files. i combined the 2 in 1 file 2 tabs.1 file has amongst other info: EAN and article name.file 2 has among other, EAN and stock qtthow can I now import the stock qtt from tab 2 in tab 1 based on the EANso: if EAN = 1234567891011 the stock should be …..quess can be doe by formule Read More
Managed Metadata in new MS List in SharePoint
Just noticed the new change to the SharePoint lists moving to MS List. Only some of my lists were updated and some were not so I attempted to recreate a simple list with 1 managed metadata column and a couple of people columns.
The first thing I noticed what that I couldn’t paste into the Managed Metadata column in grid edit mode. The hover over suggests that these fields can only be edited in the popup form.
Quite a limiting feature if you ask me.
Just noticed the new change to the SharePoint lists moving to MS List. Only some of my lists were updated and some were not so I attempted to recreate a simple list with 1 managed metadata column and a couple of people columns. The first thing I noticed what that I couldn’t paste into the Managed Metadata column in grid edit mode. The hover over suggests that these fields can only be edited in the popup form. Quite a limiting feature if you ask me. Read More
Il mio OneDrive è bloccato su iPhone e iPad.
Il mio OneDrive è bloccato su iPhone e su Ipad, non su computer. Microsoft non mi invia il codice necessario per resettare la password di accesso. Su OneDrive ho 244 giga di file
Il mio OneDrive è bloccato su iPhone e su Ipad, non su computer. Microsoft non mi invia il codice necessario per resettare la password di accesso. Su OneDrive ho 244 giga di file Read More
Value filters on multiple value columns in a Pivot Table
Greetings,
I know how to utilize the ‘Value Filters’ functionality in order to filter Pivot Table data. Is there a way to filter on the values in 2 separate columns? I need my Pivot table results to show rows that have a counts >1K AND an Index comparison value <1.00. Currently, I can only do one filter or the other, but not both – is there a way to do this?
Thank you!
Greetings, I know how to utilize the ‘Value Filters’ functionality in order to filter Pivot Table data. Is there a way to filter on the values in 2 separate columns? I need my Pivot table results to show rows that have a counts >1K AND an Index comparison value <1.00. Currently, I can only do one filter or the other, but not both – is there a way to do this? Thank you! Read More
Attachment confusion – .pdf/.crdownload
I’ve got a quandary with one user who is attaching a .pdf to an email, using the “Attach File” menu, but when the file is attached and sent/delivered, the attachment has been renamed with a .crdownload postpended (i.e., changing the file’s type). So, email now has “somefile.pdf.crdownload” attached rather than the original file of “somefile.pdf”.
Any idea what’s causing this oddity? The attached file was recently downloaded from another system, but clearly shows the filename as ending in .pdf. The impact is that recipients get the, perhaps unknown filetype, unless the .crdownload has been previously associated with an application (Acrobat Reader in our case).
Thanks for any guidance or suggestions!
Edited to clarify that this is Windows 10 environment with installed MS 365 apps.
I’ve got a quandary with one user who is attaching a .pdf to an email, using the “Attach File” menu, but when the file is attached and sent/delivered, the attachment has been renamed with a .crdownload postpended (i.e., changing the file’s type). So, email now has “somefile.pdf.crdownload” attached rather than the original file of “somefile.pdf”.Any idea what’s causing this oddity? The attached file was recently downloaded from another system, but clearly shows the filename as ending in .pdf. The impact is that recipients get the, perhaps unknown filetype, unless the .crdownload has been previously associated with an application (Acrobat Reader in our case). Thanks for any guidance or suggestions! Edited to clarify that this is Windows 10 environment with installed MS 365 apps. Read More
Announcing Windows Server Preview Build 26236
Announcing Windows Server Preview Build 26236
Hello Windows Server Insiders!
Today we are pleased to release a new build of the next Windows Server Long-Term Servicing Channel (LTSC) Preview that contains both the Desktop Experience and Server Core installation options for Datacenter and Standard editions, Annual Channel for Container Host and Azure Edition (for VM evaluation only). Branding has been updated for the upcoming release, Windows Server 2025, in this preview – when reporting issues please refer to Windows Server 2025 preview. If you signed up for Server Flighting, you should receive this new build automatically.
What’s New
Delegated Managed Service Accounts (dMSA)
A new account type known as delegated Managed Service Account (dMSA) is now available that allows migration from a traditional service account to a machine account with managed and fully randomized keys, while disabling original service account passwords.
Authentication for dMSA is linked to the device identity, which means that only specified machine identities mapped in AD can access the account. Using dMSA helps to prevent harvesting credentials using a compromised account (kerberoasting), which is a common issue with traditional service accounts.
To learn more about dMSA, visit https://learn.microsoft.com/en-us/windows-server/security/delegated-managed-service-accounts/delegated-managed-service-accounts-overview.
Windows Server Flighting is here!!
If you signed up for Server Flighting, you should receive this new build automatically later today. For more information, see Welcome to Windows Insider flighting on Windows Server – Microsoft Community Hub.
The new Feedback Hub app is now available for Server Desktop users!
The app should automatically update with the latest version, but if it does not, simply Check for updates in the app’s settings tab.
Known Issues
[RESOLVED] Secure-boot Gen2 VMs created using ISO media may not boot: Some users may encounter boot issues when creating secure-boot Gen 2 VMs. Disabling secure-boot allows the Gen2 VM to boot successfully. This will be addressed in a future release.
Upgrade does not complete: Some users may experience an issue when upgrading where the download process does not progress beyond 0%. If you encounter this issue, please upgrade to this newer build using the ISO media download option. Download Windows Server Insider Preview (microsoft.com)
Access denied error when using Diskpart –> Clean Image on Winpe.vhdx VMs created using WinPE: Create bootable media | Microsoft Learn. We are working to resolve this issue and expect to have it fixed in the next preview release.
Download Windows Server Insider Preview (microsoft.com)
Flighting: The label for this flight may incorrectly reference Windows 11. However, when selected, the package installed is the Windows Server update. Please ignore the label and proceed with installing your flight. This issue will be addressed in a future release.
Setup: Some users may experience overlapping rectangle voids following mouse clicks during “OOBE” setup. This is a graphics rendering issue and will not prevent setup from completing. This issue will be addressed in a future release.
WinPE – Powershell Scripts: Applying the WinPE-Powershell optional component does not properly install Powershell in WinPE. As a result, Powershell cmdlets will fail. Customers who are dependent on Powershell in WinPE should not use this build.
If you are validating upgrades from Windows Server 2019 or 2022, we do not recommend that you use this build as intermittent upgrade failures have been identified for this build.
This build has an issue where archiving eventlogs with “wevetutil al” command causes the Windows Event Log service to crash, and the archive operation to fail. The service must be restarted by executing “Start-Service EventLog” from an administrative command line prompt.
If you have Secure Launch/DRTM code path enabled, we do not recommend that you install this build.
Available Downloads
Downloads to certain countries may not be available. See Microsoft suspends new sales in Russia – Microsoft On the Issues
Windows Server Long-Term Servicing Channel Preview in ISO format in 18 languages, and in VHDX format in English only.
Windows Server Datacenter Azure Edition Preview in ISO and VHDX format, English only.
Microsoft Server Languages and Optional Features Preview
Keys: Keys are valid for preview builds only
Server Standard: MFY9F-XBN2F-TYFMP-CCV49-RMYVH
Datacenter: 2KNJJ-33Y9H-2GXGX-KMQWH-G6H67
Azure Edition does not accept a key
Symbols: available on the public symbol server – see Using the Microsoft Symbol Server.
Expiration: This Windows Server Preview will expire September 15, 2024.
How to Download
Registered Insiders may navigate directly to the Windows Server Insider Preview download page. If you have not yet registered as an Insider, see GETTING STARTED WITH SERVER on the Windows Insiders for Business portal.
We value your feedback!
The most important part of the release cycle is to hear what’s working and what needs to be improved, so your feedback is extremely valued. Beginning with Insider build 26063, please use the new Feedback Hub app for Windows Server if you are running a Desktop version of Server. If you are using a Core edition, or if you are unable to use the Feedback Hub app, you can use your registered Windows 10 or Windows 11 Insider device and use the Feedback Hub application. In the app, choose the Windows Server category and then the appropriate subcategory for your feedback. In the title of the Feedback, please indicate the build number you are providing feedback on as shown below to ensure that your issue is attributed to the right version:
[Server #####] Title of my feedback
See Give Feedback on Windows Server via Feedback Hub for specifics. The Windows Server Insiders space on the Microsoft Tech Communities supports preview builds of the next version of Windows Server. Use the forum to collaborate, share and learn from experts. For versions that have been released to general availability in market, try the Windows Server for IT Pro forum or contact Support for Business.
Diagnostic and Usage Information
Microsoft collects this information over the internet to help keep Windows secure and up to date, troubleshoot problems, and make product improvements. Microsoft server operating systems can be configured to turn diagnostic data off, send Required diagnostic data, or send Optional diagnostic data. During previews, Microsoft asks that you change the default setting to Optional to provide the best automatic feedback and help us improve the final product.
Administrators can change the level of information collection through Settings. For details, see http://aka.ms/winserverdata. Also see the Microsoft Privacy Statement.
Terms of Use
This is pre-release software – it is provided for use “as-is” and is not supported in production environments. Users are responsible for installing any updates that may be made available from Windows Update. All pre-release software made available to you via the Windows Server Insider program is governed by the Insider Terms of Use.
Announcing Windows Server Preview Build 26236
Hello Windows Server Insiders!
Today we are pleased to release a new build of the next Windows Server Long-Term Servicing Channel (LTSC) Preview that contains both the Desktop Experience and Server Core installation options for Datacenter and Standard editions, Annual Channel for Container Host and Azure Edition (for VM evaluation only). Branding has been updated for the upcoming release, Windows Server 2025, in this preview – when reporting issues please refer to Windows Server 2025 preview. If you signed up for Server Flighting, you should receive this new build automatically.
What’s New
Delegated Managed Service Accounts (dMSA)
A new account type known as delegated Managed Service Account (dMSA) is now available that allows migration from a traditional service account to a machine account with managed and fully randomized keys, while disabling original service account passwords.
Authentication for dMSA is linked to the device identity, which means that only specified machine identities mapped in AD can access the account. Using dMSA helps to prevent harvesting credentials using a compromised account (kerberoasting), which is a common issue with traditional service accounts.
To learn more about dMSA, visit https://learn.microsoft.com/en-us/windows-server/security/delegated-managed-service-accounts/delegated-managed-service-accounts-overview.
Windows Server Flighting is here!!
If you signed up for Server Flighting, you should receive this new build automatically later today. For more information, see Welcome to Windows Insider flighting on Windows Server – Microsoft Community Hub.
The new Feedback Hub app is now available for Server Desktop users!
The app should automatically update with the latest version, but if it does not, simply Check for updates in the app’s settings tab.
Known Issues
[RESOLVED] Secure-boot Gen2 VMs created using ISO media may not boot: Some users may encounter boot issues when creating secure-boot Gen 2 VMs. Disabling secure-boot allows the Gen2 VM to boot successfully. This will be addressed in a future release.
Upgrade does not complete: Some users may experience an issue when upgrading where the download process does not progress beyond 0%. If you encounter this issue, please upgrade to this newer build using the ISO media download option. Download Windows Server Insider Preview (microsoft.com)
Access denied error when using Diskpart –> Clean Image on Winpe.vhdx VMs created using WinPE: Create bootable media | Microsoft Learn. We are working to resolve this issue and expect to have it fixed in the next preview release.
Download Windows Server Insider Preview (microsoft.com)
Flighting: The label for this flight may incorrectly reference Windows 11. However, when selected, the package installed is the Windows Server update. Please ignore the label and proceed with installing your flight. This issue will be addressed in a future release.
Setup: Some users may experience overlapping rectangle voids following mouse clicks during “OOBE” setup. This is a graphics rendering issue and will not prevent setup from completing. This issue will be addressed in a future release.
WinPE – Powershell Scripts: Applying the WinPE-Powershell optional component does not properly install Powershell in WinPE. As a result, Powershell cmdlets will fail. Customers who are dependent on Powershell in WinPE should not use this build.
If you are validating upgrades from Windows Server 2019 or 2022, we do not recommend that you use this build as intermittent upgrade failures have been identified for this build.
This build has an issue where archiving eventlogs with “wevetutil al” command causes the Windows Event Log service to crash, and the archive operation to fail. The service must be restarted by executing “Start-Service EventLog” from an administrative command line prompt.
If you have Secure Launch/DRTM code path enabled, we do not recommend that you install this build.
Available Downloads
Downloads to certain countries may not be available. See Microsoft suspends new sales in Russia – Microsoft On the Issues
Windows Server Long-Term Servicing Channel Preview in ISO format in 18 languages, and in VHDX format in English only.
Windows Server Datacenter Azure Edition Preview in ISO and VHDX format, English only.
Microsoft Server Languages and Optional Features Preview
Keys: Keys are valid for preview builds only
Server Standard: MFY9F-XBN2F-TYFMP-CCV49-RMYVH
Datacenter: 2KNJJ-33Y9H-2GXGX-KMQWH-G6H67
Azure Edition does not accept a key
Symbols: available on the public symbol server – see Using the Microsoft Symbol Server.
Expiration: This Windows Server Preview will expire September 15, 2024.
How to Download
Registered Insiders may navigate directly to the Windows Server Insider Preview download page. If you have not yet registered as an Insider, see GETTING STARTED WITH SERVER on the Windows Insiders for Business portal.
We value your feedback!
The most important part of the release cycle is to hear what’s working and what needs to be improved, so your feedback is extremely valued. Beginning with Insider build 26063, please use the new Feedback Hub app for Windows Server if you are running a Desktop version of Server. If you are using a Core edition, or if you are unable to use the Feedback Hub app, you can use your registered Windows 10 or Windows 11 Insider device and use the Feedback Hub application. In the app, choose the Windows Server category and then the appropriate subcategory for your feedback. In the title of the Feedback, please indicate the build number you are providing feedback on as shown below to ensure that your issue is attributed to the right version:
[Server #####] Title of my feedback
See Give Feedback on Windows Server via Feedback Hub for specifics. The Windows Server Insiders space on the Microsoft Tech Communities supports preview builds of the next version of Windows Server. Use the forum to collaborate, share and learn from experts. For versions that have been released to general availability in market, try the Windows Server for IT Pro forum or contact Support for Business.
Diagnostic and Usage Information
Microsoft collects this information over the internet to help keep Windows secure and up to date, troubleshoot problems, and make product improvements. Microsoft server operating systems can be configured to turn diagnostic data off, send Required diagnostic data, or send Optional diagnostic data. During previews, Microsoft asks that you change the default setting to Optional to provide the best automatic feedback and help us improve the final product.
Administrators can change the level of information collection through Settings. For details, see http://aka.ms/winserverdata. Also see the Microsoft Privacy Statement.
Terms of Use
This is pre-release software – it is provided for use “as-is” and is not supported in production environments. Users are responsible for installing any updates that may be made available from Windows Update. All pre-release software made available to you via the Windows Server Insider program is governed by the Insider Terms of Use. Read More
Keeping your AI out of trouble
One thing is true for most AI Applications – it’s easy to get yourself in trouble if you’re not careful. AI is all about probability, and the probability of it being incorrect, or behaving unexpectedly for a new input is practically never zero. In the classic chatbot days, this often meant getting an answer about something you’re not asking about, or the good old “I did not understand” default answer we all “love” to see when we’re having an issue. But with Generative AI, mistakes are much more nuanced, and may take the appearance of plain misinformation and, even worse, harmful content!
In this article, we’ll cover some of the guidelines you can adopt to minimize risk on AI Apps. Each section is composed of a set of actions you can take, followed by good and bad examples to illustrate their role in keeping your users – and you! – safe from unexpected AI behavior.
1. User interface guidelines
Starting with UI tips – these are simple changes to the way your end-users engage with your AI application that can go a long way in preventing misuse.
Guideline
Description
Reasons
Include disclaimer text
In order to interact with the AI, end-users should acknowledge the rules and limitations of the tool. A good disclaimer should mention:
The information provided may be generated by AI
The information provided may be incorrect
The user is responsible for verifying the correctness of information against sources provided
Any additional industry specific disclaimers
Users expect to see correct information on the platforms you provide them. The concept of a tool that can provide incorrect information is new and needs to be explicitly called out.
Visually separate Generated and Retrieved content into sections
Generated content is the output of the language model, and as such can be incorrect
Retrieved content is directly extracted from trusted sources, and can be expected to be correct, but possibly not relevant
This distinction should be clear to the end user. The generated content can be grounded on retrieved content, but you should always provide an original source the user can read directly.
In addition, you may want to refrain from answering a question when no content was retrieved.
Once you establish some content must be verified by the user, you need to define a clear boundary of what information needs verification, and what can be trusted without doubt.
Providing both pieces of information side by side makes it easy for the user to check the information at a glance, without leaving the app.
Having that separation in the application also allows you to override the generated content. Even if the AI says something, you can choose not to display it through app logic if there are no sources to support it.
Add a feature to report issues and provide feedback
Users should be able to provide feedback whenever they face issues or receive unexpected responses.
If you decide to let users include chat history with their feedback, make sure to get confirmation that no personal or sensitive data was shared.
Feedback forms provide a simple way for users to tell you if the app is meeting expectations.
Establish user accountability
Inform the user that the content they submit may be subject to review when harmful content is detected.
Having users be accountable for exploiting the tool may dissuade them from repeatedly attempting to do so.
Good examples
Let’s start with the original ChatGPT interface – Notice all elements are present:
Disclaimer text at the bottom
Per-message feedback option
Clearly distinct Retrieval and Generation sections
Terms and Conditions – though hidden under the question mark on the bottom right.
All these elements are crucial to ensure the user is aware how things can go wrong, and sets the right expectations for how to use the tool.
Microsoft Copilot for M365 has its disclaimer and all links right below the logo. Straight to the point!
Don’t worry about writing a huge disclaimer that contains everything – you can link the full terms and keep a clean UI.
Bad examples
Common mistakes when setting up a UI include:
Not having the required disclaimers, sources or highlighting
Overstating the chatbot’s usefulness – e.g. “can help with anything about [topic]”
While some of these safeguards may seem like they are understating the chatbot’s usefulness, they are indispensable to setting the right expectations given the inherent limitations of the technology.
2. System message guidelines
Next, we have system message guidelines. These are instructions that are not visible to the user, but guide the chatbot to answer questions with the right focus or style. Keep in mind that these can be somewhat overridden by user prompts, and as such only prevent accidental or simple misuse.
Guideline
Description
Reasons
Define a clear scope of what the chatbot should assist with
The assistant should not attempt to help with all requests. Establish a clear boundary as to what conversations it should engage in.
For all other topics, it should politely decline to engage.
Failing to specify a scope will make the bot behave as a generic utility, like out-of-the-box ChatGPT. Users may take advantage of that fact to misuse the application or API.
Do not personify the chatbot
The chatbot should present itself as a tool to help the user navigate content, rather than a person.
Behaving as an employee or extension of the company should also be avoided.
When users make improper use a personified chatbot, it may give the impression of manipulation/gullibility, rather than simple misuse.
Good example
“You are a search engine for Contoso Technology. Your role is to assist customers in locating the right information from publicly available sources like the website. Politely decline to engage in conversations about any topic outside of Contoso Technology”
Bad example
“You are Contoso’s AI Assistant. You are a highly skilled customer service agent that can help users of the website with all their questions.”
3. Evaluation guidelines
Next, we have evaluation guidelines. These tools will help quantitatively measure the correctness of responses – and the possibility of manipulating the app into generating harmful content.
Guideline
Description
Reasons
Evaluate the chatbot’s accuracy, and other metrics for quality of information
Define a set of “critical” questions your chatbot should be able to answer reliably.
Regularly submit this dataset for inference and either manually or automatically evaluate its accuracy. Prefer a combination of manual and automatic validations to ensure best results.
As chatbots evolve to meet your customer’s expectations, it’s common to lose track of answers which it supposedly already knows. Updating the prompt or data sources may negatively impact those responses, and these regressions need to be properly tracked.
Evaluate the chatbot’s ability to avoid generating harmful content
Define a set of “red-team” requests that attempt to break the chatbot, force it to generate harmful content, or leave its scope.
As with accuracy, establish a regular re-submission of this dataset for inference.
Unfortunately, chatbots can always be misused by an ill-intended user. Keep track of the most common “jailbreaking” patterns and test your bot’s behavior against them.
Azure OpenAI comes with built-in content safety, but it’s not foolproof. Make sure you objectively measure harmful content generation.
Good examples
Leveraging Azure AI Studio to evaluate Groundedness, Relevance, Coherence, Fluency and Similarity. More information can be found in the docs!
Using Prompt Shields for Jailbreak and Harmful Content detection.
Bad examples
Trying to capture exact matches when evaluating accuracy.
Not considering evaluation as part of the release cycle.
4. Data privacy guidelines
Finally, we cover some data privacy guidelines. Data privacy is about how you receive, process, persist and discard end-user information through your applications. Be aware that this is an overview and does not cover every aspect of data privacy, but is a good place to start considering privacy concerns.
Guideline
Description
Reasons
Don’t audit all model inputs and outputs unless absolutely necessary
There is typically no need to log all user interactions. Even when instructed not to, users may submit personal information which is then at risk of exposure.
Debugging and monitoring tools should focus on response status codes and token counts, rather than actual text content.
Persisting messages often poses a more severe data privacy risk than simply not doing so.
Microsoft only ever persists messages which are suspected of breaking terms and conditions. They may be then viewed by Microsoft for the sole purpose of evaluating improper use. Review with your Data Privacy team if you require this feature to be turned off.
Good examples
Capturing HTTP response codes and error messages for debugging.
Logging token usage related metrics to Azure Application Insights.
Capturing user intent for continuous improvement.
Expiring user conversation logs and metrics once they are no longer relevant for the purpose of providing the experience, as disclosed in its Privacy Statement
Bad examples
Capturing verbatim prompt / completion pairs.
Persisting user information for longer than necessary.
Failing to adhere to the Privacy Statement.
Wrap up
Remember, AI misuse will happen in your applications. Your objective is to safeguard your legitimate users so they know what the applications can and cannot do, while giving ill-intended users an experience that gives less the impression of a failed / fragile tool, and more like a robust toolset being used incorrectly.
We hope this cheat sheet provides a good overview of the tools available in Azure to help bring safety and responsibility to the use of AI. Do you have other tips or tools to safeguard AI Applications? Let us know in the comments!
Microsoft Tech Community – Latest Blogs –Read More
Partner Blog | Join us on July 10 for MCAPS Start for Partners
Earlier this year, we shared that we are evolving the partner event formerly called Microsoft Inspire to align with our flagship customer event, Microsoft Ignite. For the first time ever, this year’s Microsoft Ignite event will have partners join key customers and leading industry executives for an in-person experience in Chicago, Illinois on November 18-22, 2024. Participants will also be able to join digitally.
In preparation for Ignite and the start of our fiscal year, we are inviting our partners to join us for a digital event starting July 10, 2024, called MCAPS Start for Partners. I’m pleased to share more details about this partner invitation in this blog.
Each fiscal year at Microsoft begins with an event called MCAPS Start, designed for sellers in the global Microsoft Customer and Partner Solutions (MCAPS) organization. Partners are essential to our overall market strategy and can amplify sales efforts in ways we could never achieve alone. This year, we’re expanding our annual meeting with Microsoft sellers to include a partner-focused digital readiness event that we are calling MCAPS Start for Partners. By involving our partners in our go-to-market strategy from the beginning of the fiscal year, we can create synergy and drive collective success.
We invite you to save the date and join us virtually on July 10, 2024, to hear about how we are empowering customers and partners through AI transformation, our strategic investments, new priorities, and key program changes, as well as to celebrate the Microsoft Partner of the Year Award winners.
Continue reading here
Microsoft Tech Community – Latest Blogs –Read More
New MS Teams Update Process
Hi,
I have a question about new MS Teams update process.
I have installed the new MS Teams on few computers in the test environment using teamsbootstrapper.exe (https://learn.microsoft.com/en-us/microsoftteams/new-teams-bulk-install-client)
The app installed correctly for all users.
I noticed that every user on the computer can update the application and when that happens, the application is updated for all users on that computer, not just for the user who ran the update.
Since, the users don’t have administrative rights, I’m wondering what process is involved to elevate their permissions to be able to update the application?
I can’t seem to find any documentation about how that update process for new MS Teams work or in general how MSIX applications update process works.
Any clarification on this would be appreciated.
Thanks
Hi,I have a question about new MS Teams update process. I have installed the new MS Teams on few computers in the test environment using teamsbootstrapper.exe (https://learn.microsoft.com/en-us/microsoftteams/new-teams-bulk-install-client) The app installed correctly for all users. I noticed that every user on the computer can update the application and when that happens, the application is updated for all users on that computer, not just for the user who ran the update.Since, the users don’t have administrative rights, I’m wondering what process is involved to elevate their permissions to be able to update the application? I can’t seem to find any documentation about how that update process for new MS Teams work or in general how MSIX applications update process works. Any clarification on this would be appreciated. Thanks Read More
Quick Way to Convert OST to PST Format
Want to Convert OST to PST? Download and intstall Advik OST to PST Converter. This software will help you to convert OST to PST format. The software will maintain folder hieraechy and email attributes as well. The software support OST file created from MS Outlook 2016, 2013, 2019.
Steps to Convert OST to PST file
Run Advik OST to PST Converter.Click Select Files and add OST file.Select mailbox folders and click Next.Select PST as saving option.Click convert button.
Done! This is how you can convert OST to PST Without Outlook.
Want to Convert OST to PST? Download and intstall Advik OST to PST Converter. This software will help you to convert OST to PST format. The software will maintain folder hieraechy and email attributes as well. The software support OST file created from MS Outlook 2016, 2013, 2019. Steps to Convert OST to PST fileRun Advik OST to PST Converter.Click Select Files and add OST file.Select mailbox folders and click Next.Select PST as saving option.Click convert button.Done! This is how you can convert OST to PST Without Outlook. Read More
Cisco Meraki Nonprofit Discount
Hi everyone!
My name is Celeste and I work for Telecom4Good, a nonprofit that provides discounted technologies for other nonprofits. I just wanted to share with everyone that we are Cisco Meraki’s largest nonprofit partner and they are currently having their year-end sale. Typically by working with us, we save nonprofits 50% but with the year-end sale, we negotiate with Cisco to provide even more of a discount.
We have worked with nonprofits such as ASPCA, different Goodwill Locations, and Samaritan’s Purse. If you have time feel free to check out our Cisco Meraki Nonprofit Discounts. We also offer free remote training to employees so you aren’t left confused about what to do.
Feel free to ask any questions we would love to help! P.S. This isn’t related to fundraising I just had to add a label. I am just sharing information about how we can help.
Hi everyone!My name is Celeste and I work for Telecom4Good, a nonprofit that provides discounted technologies for other nonprofits. I just wanted to share with everyone that we are Cisco Meraki’s largest nonprofit partner and they are currently having their year-end sale. Typically by working with us, we save nonprofits 50% but with the year-end sale, we negotiate with Cisco to provide even more of a discount. We have worked with nonprofits such as ASPCA, different Goodwill Locations, and Samaritan’s Purse. If you have time feel free to check out our Cisco Meraki Nonprofit Discounts. We also offer free remote training to employees so you aren’t left confused about what to do. Feel free to ask any questions we would love to help! P.S. This isn’t related to fundraising I just had to add a label. I am just sharing information about how we can help. Read More
Edge no longer autofill’s username and password after installing update KB5039312.
After installing update KB5039312, edge quit autofill of username and password. Every web site I use I have to manually enter username and password. Very annoying
After installing update KB5039312, edge quit autofill of username and password. Every web site I use I have to manually enter username and password. Very annoying Read More
The use of audit logs for Copilot in an educational setting
Microsoft’s decision to offer “commercial data protection” will, I am sure, be welcomed by schools. However, it raises an issue related to auditing the use of Copilot, which may not be a feature of the business/commercial sector.
It will become important that schools are able to access the questions their students submit to Copilot and the answers it produces. This is part of the normal auditing process of classroom teachers, who are interested in any errors/misconceptions that their students develop as a result of using their teaching resources, which will include Copilot.
My question, then, is to inquire whether the audit logs for Copilot will include access the questions submitted to Copilot and the answers it produces.
Microsoft’s decision to offer “commercial data protection” will, I am sure, be welcomed by schools. However, it raises an issue related to auditing the use of Copilot, which may not be a feature of the business/commercial sector. It will become important that schools are able to access the questions their students submit to Copilot and the answers it produces. This is part of the normal auditing process of classroom teachers, who are interested in any errors/misconceptions that their students develop as a result of using their teaching resources, which will include Copilot. My question, then, is to inquire whether the audit logs for Copilot will include access the questions submitted to Copilot and the answers it produces. Read More
User can’t access Private Teams Channels files
Hello,
I have a user who is a member of all private team channels (all on separate SharePoint sites). However, they are unable to access files to certain private teams channels.
They receive this error message every time (see below). Clicking on ‘Open in SharePoint’ opens a web page and shows Access Denied.
I’ve tried the following:
– re-adding the user a member
– adding the user as an owner
– clearing Teams cache
– reset Teams
– reinstalled Teams
– signed out of account
– using different browsers
– using private/incognito mode
None of these have worked, and I’ve raised a ticket with Microsoft support, but they have been unhelpful, insisting that it’s a permission issue. Even though, I did a remote session with them and showed that the user is a member of all private teams channels.
Any advice/solutions would be great 🙂
Hello, I have a user who is a member of all private team channels (all on separate SharePoint sites). However, they are unable to access files to certain private teams channels. They receive this error message every time (see below). Clicking on ‘Open in SharePoint’ opens a web page and shows Access Denied. I’ve tried the following:- re-adding the user a member – adding the user as an owner- clearing Teams cache- reset Teams- reinstalled Teams- signed out of account- using different browsers- using private/incognito mode None of these have worked, and I’ve raised a ticket with Microsoft support, but they have been unhelpful, insisting that it’s a permission issue. Even though, I did a remote session with them and showed that the user is a member of all private teams channels. Any advice/solutions would be great 🙂 Read More
Best Practices
Hello All:
This question is for those of you who develop in .Net/Visual Studio. When building web facing user interfaces, what are your preferred tools for speeding up development time (and why)?
Thanks in advance for your feedback.
Hello All:This question is for those of you who develop in .Net/Visual Studio. When building web facing user interfaces, what are your preferred tools for speeding up development time (and why)?Thanks in advance for your feedback. Read More
How to Backup Offiice 365 Emails to PST File?
First of all you have to download and install Advik Office 365 Backup Tool. This software is designed to backup Office 365 emails with attachments. You can export Office 365 mailbox to PST , EML, MBOX, and multiple other file formats. The software is capable enough to download emails from mulitiple Outlook 365 accounts.
Steps to backup Office 365 emails to PST file
Launch Advik Office 365 Backup Tool in your PC.Enter credentials to sign in.Select mailbox folders to export.Choose PST as saving option.Click Convert button.
Finished! The software will download or backup Office 365 mailbox to PST in no time.
First of all you have to download and install Advik Office 365 Backup Tool. This software is designed to backup Office 365 emails with attachments. You can export Office 365 mailbox to PST , EML, MBOX, and multiple other file formats. The software is capable enough to download emails from mulitiple Outlook 365 accounts. Steps to backup Office 365 emails to PST fileLaunch Advik Office 365 Backup Tool in your PC.Enter credentials to sign in.Select mailbox folders to export.Choose PST as saving option.Click Convert button.Finished! The software will download or backup Office 365 mailbox to PST in no time. Read More
Add or remove people from your form response notification emails
Allowing only the form owner to receive response notifications has long been a pain point for many users. But that’s no longer a problem! You can now add or remove people or groups from the response notification emails, for forms or quizzes, keeping everyone in the loop! Let’s check how it works together.
Add recipients
To add others, first go to the form’s settings and click “Get email notification of each response”. Then you can proceed to add your desired recipients with a name, email address or a group in your organization.
Selected recipients get notified
When a new response is submitted, all those listed under “Response receipts” will receive an email notification. They can simply click “view results” to access the form’s result page for more details or sync to Excel for always up-to-date information without needing to return to the Forms site.
Remove recipients
If someone has left your organization or you wish to exclude them from notifications, you can effortlessly remove them from the list. Simply access the “…” icon next to the recipients list and remove the individuals by clicking the “trash can” icon.
Visit forms.office.com now to manage your response notification emails! You can also try it out using this template.
Microsoft Tech Community – Latest Blogs –Read More
Copilot is now available in classic Outlook for Windows
Last Ignite we showed our plans for Copilot in Outlook and how the new Outlook for Windows would get the most recent features first.
We also know that our customers still rely on the classic version of Outlook for a lot of their work and to improve their Copilot experience we have been rolling out Copilot features into classic Outlook over the last few months.
For future Copilot features, we will continue to release first in the new Outlook for Windows and web, with Mac and mobile fast following, and classic releasing between 3 and 12 months after the first roll out.
Copilot in classic Outlook for Windows is already available for most customers in Current Channel or Monthly Enterprise Channel.
Available features include:
Summarize by Copilot Imagine sending an email, taking a short break and coming back to a very active thread with multiple replies. You could scroll back to the first response and start reading or Copilot can quickly summarize the thread for you, so you can catch up on what happened in with a few bullet points in minutes. Copilot even points out where it got the information so you can get more details if needed. To access summarize, select the “Summarize” button on the top right of the reading pane after you open a message. This feature is available in build 16.0.17028.10000 in Current Channel and Monthly Enterprise Channel.
Summarize in classic Outlook for Windows
Coaching by Copilot An additional set of eyes on an important email you are writing can help you make sure you are communicating the right ideas. When busy schedules and due dates mix up, coaching by Copilot can be that set of extra eyes and provide suggestions to help you communicate your ideas with the right tone, clarity, and make sure the reader sentiment is the intended. To get coaching, once you have drafted a message, select the Copilot icon in the ribbon and then “Coaching by Copilot”. Available in build 16.0.17231.20182 in Current Channel and Monthly Enterprise Channel.
Coaching by Copilot in classic Outlook for Windows
Draft with Copilot helps you easily draft emails starting from a prompt. To start a draft, select “New Email” or reply to a message, then select the Copilot icon in the ribbon, and choose “Draft with Copilot” – When you enter the prompt you can also adjust the length and tone before it is drafted. Draft with Copilot is available in build 16.0.17425.20174 in Current Channel and Monthly Enterprise Channel.
Tone and length can be adjusted when drafting with Copilot
Once the message is drafted, you can also adjust it with further instructions to Copilot.
Starting in June, Copilot for Microsoft 365 chat experience (Microsoft 365 Roadmap ID 388753) is coming to classic Outlook for Windows. Copilot in Outlook allows you to draft emails, ask questions, summarize multiple email conversations, and connect across your enterprise data including chats, documents, meetings, and emails without leaving Outlook. This feature will start rolling out for classic Outlook for Windows in June for Current Channel and August for Monthly Enterprise Channel, when it’s rolled out it will be pinned by default on the left app bar.
Copilot can be accessed in classic Outlook on the left app bar
Copilot in Outlook requires a Copilot for Microsoft 365 license.
We understand that classic Outlook is an important tool for many people, and we hope to bring more Copilot features into classic Outlook. While each platform has its own dev time, we expect that key Copilot features that come to new Outlook for Windows, web, mobile, and Mac will also come to classic Outlook within a reasonable follow-up timeline depending on the feature.
We always enjoy reading your feedback and comments, please leave us your thoughts in the comments.
Thanks!
Microsoft Tech Community – Latest Blogs –Read More