Category: Microsoft
Category Archives: Microsoft
![[ADO] Work Items custom states](https://techcommunity.microsoft.com/t5/image/serverpage/image-id/608092i1691806B540D0385/image-size/medium?v=v2&px=400)
[ADO] Work Items custom states
Hello.
Wer shifting to ADO as a project management tool (not for software development and delivery, not directly).
I’m creating our own custome process (inheriting from Agile) and was wondering if there is any way for us (my team) to have custom workflow states to be created by default instead of havig to do it manually for each work item type we create.
This is what we would like to have and has we have some several WI types to create would make our lives easier and possibly future proof it in case we need to make changes (add or edit – through delete+add – more WI).
Thank you.
Hello. Wer shifting to ADO as a project management tool (not for software development and delivery, not directly). I’m creating our own custome process (inheriting from Agile) and was wondering if there is any way for us (my team) to have custom workflow states to be created by default instead of havig to do it manually for each work item type we create.This is what we would like to have and has we have some several WI types to create would make our lives easier and possibly future proof it in case we need to make changes (add or edit – through delete+add – more WI). Thank you. Read More
Feature request: (DLP) Add new passport numbering format for Canada
Since May 2023, new versions of the Canada passports have new numbering format.
Before the May 2023 the format was AB123456, and now they’re A123456BC.
pls change this article to include the new numbering format & change Purview to include the regex for the new passport number format -> https://learn.microsoft.com/en-us/purview/sit-defn-canada-passport-number
Most likely & potentially, both formats will be used for another 10 years. After which, the old format passports will likely expire post the max validity allowed for the passports.
Since May 2023, new versions of the Canada passports have new numbering format.Before the May 2023 the format was AB123456, and now they’re A123456BC.pls change this article to include the new numbering format & change Purview to include the regex for the new passport number format -> https://learn.microsoft.com/en-us/purview/sit-defn-canada-passport-numberMost likely & potentially, both formats will be used for another 10 years. After which, the old format passports will likely expire post the max validity allowed for the passports. Read More
Azure Logic App: Replace Single Quotes
Hello,
I’ve been trying to replace single quotes with blank spaces in logic app, but nothing seems to be working. Could someone help me figure out what might be going wrong?
Hello,I’ve been trying to replace single quotes with blank spaces in logic app, but nothing seems to be working. Could someone help me figure out what might be going wrong? Read More
Microsoft graph connection troubles
Hi!
I have been experience problems with microsoft graph api, when I use the service with the c# sdk and execute a request, this one is too slow and when is “complete” throw a request time out error, what is happening ? this situation never happened to me before.
I am just trying to make a get request to my active directory
Hi! I have been experience problems with microsoft graph api, when I use the service with the c# sdk and execute a request, this one is too slow and when is “complete” throw a request time out error, what is happening ? this situation never happened to me before. I am just trying to make a get request to my active directory Read More
The filter function did not appear in the functions list for me. Excel 21 and Excel 365. Is there a
The filter function did not appear in the functions list for me. Excel 21 and Excel 365. Is there a solution please?
The filter function did not appear in the functions list for me. Excel 21 and Excel 365. Is there a solution please? Read More
Copilot Licenses and Evolution of Benefits Packages
Hi all,
If you haven’t already heard the news, Microsoft is making updates to the product licensing in benefits packages: partner.microsoft.com/en-US/blog/article/innovate-with-partner-benefits. This includes Copilot for Modern Work and Biz Apps benefits.
What is changing?
Beginning January 22, 2025, we are adding over 20 in-demand product licenses to our benefits packages. This includes game-changing Microsoft Copilot products, Microsoft Defender for Endpoint, and Microsoft GitHub. These product licenses will be accessible in select partner benefits packages and Training Services Partner Solution Area designations. For information on changes by benefits package type, see our benefits transition walking deck. Additionally, the Microsoft AI Cloud Partner Program benefits guide has been updated to include the upcoming license availability (starting on page 45).
As part of this benefit transition, we are also announcing that Microsoft will no longer sell Microsoft Action Pack, Microsoft Learning Action Pack, or legacy silver / gold benefits starting January 22, 2025. We will continue to offer the three new benefit packages that were released in January 2024: Partner Launch Benefits, Partner Success Core Benefits, and Partner Success Expanded Benefits. These are optional benefits packages and not required to participate in the Training Services Partner (TSP) ecosystem.
Timeline
January 21, 2025: partners will be able to purchase or renew Action Pack or legacy silver / gold benefits through this date. All existing legacy benefits purchased on or before this date will be valid for 12 months from the date of purchase.
January 22, 2025: new product licenses will be added to qualifying benefits packages. Existing Action Pack and legacy silver / gold benefits packages will not receive the new licenses.
Next Steps
Having a benefits package as a TSP is optional, but recommended. Aside from product licensing, partners receive Azure credit greater than the cost of the package. Additionally, Solutions Area partners have access to elevated badging and the customer-facing partner directory (coming soon). Partners may opt to participate in the TSP ecosystem with no benefits package.
Partners looking to receive benefits who have an Action Pack or legacy silver / gold renewal date on or before January 21, 2025, have the ability to:
renew legacy benefits for one more 12-month period
and / or transition to Partner Launch, Partner Success Core, or Partner Success Expanded benefits, available now
and / or meet Solution Area badging requirements in one or more Microsoft Solution Areas
(note: TSPs can simultaneously have all 3 options above)
Partners looking to receive benefits who have an Action Pack or legacy silver / gold renewal data after January 21, 2025, have the ability to:
transition to Partner Launch, Partner Success Core, or Partner Success Expanded benefits, available now
and / or meet Solution Area badging requirements in one or more Microsoft Solution Areas
Resources
Familiarize yourself with the transition walking deck and updated benefits guide
Review the Microsoft AI Cloud Partner Program FAQ
Compare offerings across the Partner Launch, Partner Success Core, and Partner Success Expanded benefit packages
Join the TSP Community Calls for additional information as it becomes available (August 28th call invites are attached)
Ask questions of other TSPs and Microsoft program managers via the Training Services Partner Forum
We will continue to provide updates through our regular communication channels as we work towards January 2025 and beyond. As always, if you have any questions please reach out.
Thanks for your support.
Dan
Hi all,
If you haven’t already heard the news, Microsoft is making updates to the product licensing in benefits packages: partner.microsoft.com/en-US/blog/article/innovate-with-partner-benefits. This includes Copilot for Modern Work and Biz Apps benefits.
What is changing?
Beginning January 22, 2025, we are adding over 20 in-demand product licenses to our benefits packages. This includes game-changing Microsoft Copilot products, Microsoft Defender for Endpoint, and Microsoft GitHub. These product licenses will be accessible in select partner benefits packages and Training Services Partner Solution Area designations. For information on changes by benefits package type, see our benefits transition walking deck. Additionally, the Microsoft AI Cloud Partner Program benefits guide has been updated to include the upcoming license availability (starting on page 45).
As part of this benefit transition, we are also announcing that Microsoft will no longer sell Microsoft Action Pack, Microsoft Learning Action Pack, or legacy silver / gold benefits starting January 22, 2025. We will continue to offer the three new benefit packages that were released in January 2024: Partner Launch Benefits, Partner Success Core Benefits, and Partner Success Expanded Benefits. These are optional benefits packages and not required to participate in the Training Services Partner (TSP) ecosystem.
Timeline
January 21, 2025: partners will be able to purchase or renew Action Pack or legacy silver / gold benefits through this date. All existing legacy benefits purchased on or before this date will be valid for 12 months from the date of purchase.
January 22, 2025: new product licenses will be added to qualifying benefits packages. Existing Action Pack and legacy silver / gold benefits packages will not receive the new licenses.
Next Steps
Having a benefits package as a TSP is optional, but recommended. Aside from product licensing, partners receive Azure credit greater than the cost of the package. Additionally, Solutions Area partners have access to elevated badging and the customer-facing partner directory (coming soon). Partners may opt to participate in the TSP ecosystem with no benefits package.
Partners looking to receive benefits who have an Action Pack or legacy silver / gold renewal date on or before January 21, 2025, have the ability to:
renew legacy benefits for one more 12-month period
and / or transition to Partner Launch, Partner Success Core, or Partner Success Expanded benefits, available now
and / or meet Solution Area badging requirements in one or more Microsoft Solution Areas
(note: TSPs can simultaneously have all 3 options above)
Partners looking to receive benefits who have an Action Pack or legacy silver / gold renewal data after January 21, 2025, have the ability to:
transition to Partner Launch, Partner Success Core, or Partner Success Expanded benefits, available now
and / or meet Solution Area badging requirements in one or more Microsoft Solution Areas
Resources
Familiarize yourself with the transition walking deck and updated benefits guide
Review the Microsoft AI Cloud Partner Program FAQ
Compare offerings across the Partner Launch, Partner Success Core, and Partner Success Expanded benefit packages
Join the TSP Community Calls for additional information as it becomes available (August 28th call invites are attached)
Ask questions of other TSPs and Microsoft program managers via the Training Services Partner Forum
We will continue to provide updates through our regular communication channels as we work towards January 2025 and beyond. As always, if you have any questions please reach out.
Thanks for your support.
Dan
Read More
Intune roadmap for Apple Intelligence feature configuration
Hello,
Does anyone know when Intune device and app management features will be extended to manage Apple Intelligence? I understand 18.1 will be released coming Fall but couldn’t find any reference of “Apple Intelligence” in Intune roadmap >> https://www.microsoft.com/en-us/microsoft-365/roadmap?filters=Microsoft%20Intune%2CiOS
Hello, Does anyone know when Intune device and app management features will be extended to manage Apple Intelligence? I understand 18.1 will be released coming Fall but couldn’t find any reference of “Apple Intelligence” in Intune roadmap >> https://www.microsoft.com/en-us/microsoft-365/roadmap?filters=Microsoft%20Intune%2CiOS Read More
Exploring the latest AI features in Clipchamp
Hi, Microsoft 365 Insiders,
We’re excited to introduce two new AI-powered features in Clipchamp: noise suppression and image background removal! These tools will help you enhance your video content by improving sound clarity and removing distracting backgrounds effortlessly. Whether you’re recording in a noisy environment or want to create a clean, professional look, these features are here to help.
Check out our latest blog by the Clipchamp team: Exploring the latest AI features in Clipchamp
Thanks!
Perry Sjogren
Microsoft 365 Insider Community Manager
Become a Microsoft 365 Insider and gain exclusive access to new features and help shape the future of Microsoft 365. Join Now: Windows | Mac | iOS | Android
Hi, Microsoft 365 Insiders,
We’re excited to introduce two new AI-powered features in Clipchamp: noise suppression and image background removal! These tools will help you enhance your video content by improving sound clarity and removing distracting backgrounds effortlessly. Whether you’re recording in a noisy environment or want to create a clean, professional look, these features are here to help.
Check out our latest blog by the Clipchamp team: Exploring the latest AI features in Clipchamp
Thanks!
Perry Sjogren
Microsoft 365 Insider Community Manager
Become a Microsoft 365 Insider and gain exclusive access to new features and help shape the future of Microsoft 365. Join Now: Windows | Mac | iOS | Android Read More
Your insider build ran into a problem
It’s a green screen issue
Issue name: CRITICAL PROCESS DIED
Your insider build ran into an issue ….
Problem: After using for 10 Mins or so, the screen freezes …and all of a sudden the green screen pops up showing the above message once collecting information, it restarts and freezes on the Dell logo, and nothing much happens after that. I tried restarting couple of times and rarely does the page pop up to show automatic repair( your pc did not start correctly). I have updated all my security updates, Nvidia display drivers, nor there is any virus. It’s been a week since this issue occurs.
Please help on what to do next! Thanks
It’s a green screen issueIssue name: CRITICAL PROCESS DIEDYour insider build ran into an issue ….Problem: After using for 10 Mins or so, the screen freezes …and all of a sudden the green screen pops up showing the above message once collecting information, it restarts and freezes on the Dell logo, and nothing much happens after that. I tried restarting couple of times and rarely does the page pop up to show automatic repair( your pc did not start correctly). I have updated all my security updates, Nvidia display drivers, nor there is any virus. It’s been a week since this issue occurs.Please help on what to do next! Thanks Read More
Intune Management Extension msi not installing
Hi,
We’re a newly setup intune hybrid join environment. All our computers are showing in Intune and compliant, however a large chunk are not actually properly setup. They do not roll out apps nor do they run scripts.
On a test machine with the problem I’ve determined that Intune Management Extension isn’t actually installed. I’ve followed various online blogs to track down logs, etc.
There appears to be something missing or not running on these computers that means IME can’t install. If I manually run the MSI in the “C:WindowsSystem32configsystemprofileAppDataLocalmdm” directory with no quiet install I can see it eventually fails with the message “There is a problem with this Windows Installer package. A program required for this install to complete could not be run. Contact your support personnel or package vendor”.
I ran with command line and got a verbose log file generated which states at the end “Installation success or error status: 1603.”
I can’t find any useful help online. Does anyone have suggestions as to what might be blocking the install?
Thanks!
Hi, We’re a newly setup intune hybrid join environment. All our computers are showing in Intune and compliant, however a large chunk are not actually properly setup. They do not roll out apps nor do they run scripts. On a test machine with the problem I’ve determined that Intune Management Extension isn’t actually installed. I’ve followed various online blogs to track down logs, etc. There appears to be something missing or not running on these computers that means IME can’t install. If I manually run the MSI in the “C:WindowsSystem32configsystemprofileAppDataLocalmdm” directory with no quiet install I can see it eventually fails with the message “There is a problem with this Windows Installer package. A program required for this install to complete could not be run. Contact your support personnel or package vendor”. I ran with command line and got a verbose log file generated which states at the end “Installation success or error status: 1603.” I can’t find any useful help online. Does anyone have suggestions as to what might be blocking the install? Thanks! Read More
Is there any way to integrate Excel to the Current Affairs Data
We do have number of online students who want to have data “specially current affair posts title and published date with link in the excel sheet” How it can be done automatically? We have a date filter on our current affairs page ( https://compass.rauias.com/current-affairs-upsc/ ) is there any way same data can go to excel sheet automatically? And it can be filtered the same way?
To go one step up, we also can add news from various sources automatically in the excel (of course only title and published date with a link) if there is a way to do so.
Looking for a Quick Solution.
We do have number of online students who want to have data “specially current affair posts title and published date with link in the excel sheet” How it can be done automatically? We have a date filter on our current affairs page ( https://compass.rauias.com/current-affairs-upsc/ ) is there any way same data can go to excel sheet automatically? And it can be filtered the same way? To go one step up, we also can add news from various sources automatically in the excel (of course only title and published date with a link) if there is a way to do so. Looking for a Quick Solution. Read More
How to generate a direct download link from the shared OneDrive link
Dear Experts and Supporters
I’m a developer working on an issue related to downloading files from OneDrive.
Everything was running fine until a few days ago when I reopened my app
Here are my lines
// shared OneDrive link example
// https://1drv.ms/u/s!Atj71Lw5QEdsrQnTRHMj-fjGc49N?e=hOB5gO
if (string.IsNullOrWhiteSpace(sharingURL))
return string.Empty;
var base64Value = Convert.ToBase64String(Encoding.UTF8.GetBytes(sharingURL));
var encodedUrl = “u!” + base64Value.TrimEnd(‘=’).Replace(‘/’, ‘_’).Replace(‘+’, ‘-‘);
var directlyUrl = $”https://api.onedrive.com/v1.0/shares/{encodedUrl}/root/content”;
And now when I cannot download from OneDrive, I have debugged and realized that there was a 401 Unauthorized exception
But the file has been shared for Everyone with Edit permissions.
I thought Microsoft had changed something about the shared link recently and the current way to get the direct download link as it is now is not possible.
The shared link I see it’s longer than before and different in format (no s!, no ?e=)
So please kindly help me to solve this case.
Thanks in advance!
Henry Tien (email address removed for privacy reasons)
Dear Experts and Supporters I’m a developer working on an issue related to downloading files from OneDrive.Everything was running fine until a few days ago when I reopened my app Here are my lines // shared OneDrive link example
// https://1drv.ms/u/s!Atj71Lw5QEdsrQnTRHMj-fjGc49N?e=hOB5gO
if (string.IsNullOrWhiteSpace(sharingURL))
return string.Empty;
var base64Value = Convert.ToBase64String(Encoding.UTF8.GetBytes(sharingURL));
var encodedUrl = “u!” + base64Value.TrimEnd(‘=’).Replace(‘/’, ‘_’).Replace(‘+’, ‘-‘);
var directlyUrl = $”https://api.onedrive.com/v1.0/shares/{encodedUrl}/root/content”; And now when I cannot download from OneDrive, I have debugged and realized that there was a 401 Unauthorized exceptionBut the file has been shared for Everyone with Edit permissions. I thought Microsoft had changed something about the shared link recently and the current way to get the direct download link as it is now is not possible.The shared link I see it’s longer than before and different in format (no s!, no ?e=) So please kindly help me to solve this case. Thanks in advance!Henry Tien (email address removed for privacy reasons) Read More
Sunburst Chart – Subcategories
I’ve been tasked with a work project that involves creating a diagram outlining all of our workplace’s features and benefits in one place. The idea is that the features are in the middle with the benefits moving to the outside.
I have used a sunburst chart to visually demonstrate the early drafts of this model, however I am unable to find a way to add sub features.
Below is a simple demonstration of what I would like using every day meals. The types of food are in the middle, with the benefits on the outside.
This is all well and good, but consider there are two very different types of Pizza – a high quality restaurant pizza, and a store bought frozen pizza. Both come under pizza, however have different benefits.
Is there a way, I can add the different categories of pizza into the same wedge? I still want pizza as the overall category, and it is essential that all the benefits remain in the same layer.
This is the current table.
And below is what I hoped would work – and if the above information wasn’t clear, what I want the end product to look like.
I know this is not what the graph was intended for however I’m not a graphic designer and the chart is so effective at showing a large amount of information! In my work example, There are currently 100s of rows and 6/7 columns. It needs to be condensed to about 4
Thanks in advance for your help!
I’ve been tasked with a work project that involves creating a diagram outlining all of our workplace’s features and benefits in one place. The idea is that the features are in the middle with the benefits moving to the outside. I have used a sunburst chart to visually demonstrate the early drafts of this model, however I am unable to find a way to add sub features. Below is a simple demonstration of what I would like using every day meals. The types of food are in the middle, with the benefits on the outside. This is all well and good, but consider there are two very different types of Pizza – a high quality restaurant pizza, and a store bought frozen pizza. Both come under pizza, however have different benefits. Is there a way, I can add the different categories of pizza into the same wedge? I still want pizza as the overall category, and it is essential that all the benefits remain in the same layer. This is the current table. And below is what I hoped would work – and if the above information wasn’t clear, what I want the end product to look like. I know this is not what the graph was intended for however I’m not a graphic designer and the chart is so effective at showing a large amount of information! In my work example, There are currently 100s of rows and 6/7 columns. It needs to be condensed to about 4 Thanks in advance for your help! Read More
Samsung Motion Photos on OneDrive
The photos from my Samsung S23 Ultra are automatically synced to OneDrive. Several sources claim that Samsung Motion Photos can be viewed on the OneDrive.com website, but I am not able to view anything other than the final (key) frame. Other sources claim that Samsung Motion Photos stored in OneDrive can be viewed in the MS Photos app on Windows. Photos does indeed seem to recognize motion photos, but clicking on the provided “MOTION” button does not play the 3 second video. Instead the screen goes dark for 3 seconds and then redisplays the final (key) frame. Am I doing something wrong? Have OneDrive.com or MS Photos been downgraded to remove this functionality? How can I best view (or, even better edit) my motion photos on a PC running Windows 10?
The photos from my Samsung S23 Ultra are automatically synced to OneDrive. Several sources claim that Samsung Motion Photos can be viewed on the OneDrive.com website, but I am not able to view anything other than the final (key) frame. Other sources claim that Samsung Motion Photos stored in OneDrive can be viewed in the MS Photos app on Windows. Photos does indeed seem to recognize motion photos, but clicking on the provided “MOTION” button does not play the 3 second video. Instead the screen goes dark for 3 seconds and then redisplays the final (key) frame. Am I doing something wrong? Have OneDrive.com or MS Photos been downgraded to remove this functionality? How can I best view (or, even better edit) my motion photos on a PC running Windows 10? Read More
I’m trying to autofill information to different tabs from a master list
Hello,
Please assist, I have a master listing with 24 columns. This is the main tab on my doc.
What I am trying to accomplish is to have the information autofill into 1 of the other tabs based on a specific criteria. (Location column)
NameLocationIn SalesforceDate of First encounterProgramStaff DOB
The other tabs are for the various locations (1 of 3), what I am trying to do is have the entire row copy to the associated sheet based on location entry.
Is there a way to do this without having to copy/paste each row?
Thank you
Hello,Please assist, I have a master listing with 24 columns. This is the main tab on my doc. What I am trying to accomplish is to have the information autofill into 1 of the other tabs based on a specific criteria. (Location column) NameLocationIn SalesforceDate of First encounterProgramStaff DOB The other tabs are for the various locations (1 of 3), what I am trying to do is have the entire row copy to the associated sheet based on location entry. Is there a way to do this without having to copy/paste each row? Thank you Read More
Can you please fix the text in microsoft booking (French)
So my company is using microsoft booking, everything is very professional, it’s starting to work nicely, but can you please fix the text since I can’t do it inside the booking itself.
I know it’s in french, but there is obviously no backslash in that word. It feels unprofessional and people are complaining.
We should see ”N’importe quel employé”
and not ”N’importe quel employé”
So my company is using microsoft booking, everything is very professional, it’s starting to work nicely, but can you please fix the text since I can’t do it inside the booking itself. I know it’s in french, but there is obviously no backslash in that word. It feels unprofessional and people are complaining. We should see ”N’importe quel employé” and not ”N’importe quel employé” Read More
How do I get a refund from Google Pay wrong transaction?
Call Google Pay India Support number: 0811-6941368″”” Customers can reach the Customer Care number toll free at 1-800-419-0157. (Available 24/7) Option 2 – In-app support: Customers have an option to initiate chat support for all Complaints.
Call Google Pay India Support number: 0811-6941368″”” Customers can reach the Customer Care number toll free at 1-800-419-0157. (Available 24/7) Option 2 – In-app support: Customers have an option to initiate chat support for all Complaints. Read More
DataSource Error when connecting to Dataverse from Excel
Hi,
I’m trying to connect to Dataverse tables from Excel via Get Data > From Power Platform > From Dataverse. I was able to sign in and access my environments. However, as I tried to expand the environment folder to access the tables, I got the following error: “The parameterized query expects ‘@tds_client_correlation_id’, which is not supplied.”
In Power BI, I followed the same steps using the same credentials and it worked just fine.
This is particularly odd because it was working well as of a few days ago (I even wrote a VBA script to automate data streaming and processing).
Would appreciate your help!
New Hugging Face Models on Azure AI: Multilingual, SLM and BioMed- July 2024 Update
In May, we announced a deepened partnership with Hugging Face and we continue to add more leading-edge Hugging Face models to the Azure AI model catalog on a monthly basis. We have 1550+ models in the Hugging Face collection and we added 20+ models in July including highly-ranked multilingual models, tuned for Asian languages like Mandarin, Japanese, Indonesian, Thai, Malay, Vietnamese. This blog posts kicks off a monthly roundup of the most recently added models to this collection, spotlighting notable metrics or features that may be relevant to your specific application development requirements.
What’s New in July 2024
We added 20+ models to the Hugging Face collection in the Azure AI model catalog in July. These included multilingual models (focus on Chinese, Dutch, Arabic, South-East Asian), embedding models, text generation (SLM and LLM) and models with a domain-specific focus (e.g., biomedical). The table below summarizes additions by task and notable features. Click model name to view related model cards on Azure AI for more details. In the next section, we’ll put the spotlight on a couple of models or model families that may be of particular interest to developers exploring SLMs or multilingual applications.
Model Name · Inference Task
Notable Features
01
01-ai/Yi-1.5-34B ﹒ Text Generation
Top-ranked bilingual language model (with English, Chinese)
02
01-ai/Yi-34B-Chat ﹒ Text Generation
03
BramVanroy/GEITje-7B-ultra ﹒ Text Generation
Bilingual (with English, Dutch)
04
BAAI/bge-m3﹒ Sentence Similarity
Multi-lingual, Multi-functional RAG
05
stanford-crfm/BioMedLM ﹒ Text Generation
Biomedical, MedQA (not for prod)
06
BioMistral/BioMistral-7B ﹒ Text Generation
Biomedical, MedQA (from Mistral)
07
m42-health/Llama3-Med42-70B ﹒ Text Generation
Clinical, MedQA (not for prod)
08
m42-health/Llama3-Med42-8B ﹒ Text Generation
Clinical, MedQA (not for prod)
09
shenzhi-wang/Llama3.1-8B-Chinese-Chat
Bilingual (with English, Chinese)
10
HuggingFaceTB/SmolLM-1.7B ﹒ Text Generation
SLM, high-quality training corpus
11
AI-MO/NuminaMath-7B-TIR ﹒ Text Generation
1st progress prize – AI Math Olympiad
12
google-t5/t5-base ﹒Translation
Reframe NLP Tasks with one format
13
jbochi/madlad400-3b-mt ﹒ Translation
Multilingual (450 lang), uses T5 arch.
14
teknium/OpenHermes-2.5-Mistral-7B ﹒ Text Generation
Tackle complex conversation topics
15
Intel/neural-chat-7b-v3-1﹒ Text Generation
SlimOrca data, Intel Gaudi fine-tuned
16
hfl/chinese-llama-2-7b ﹒ Text Generation
Optimized for Chinese vocab
17
shibing624/mengzi-t5-base-chinese-correction ﹒ T2TG
T5 for Chinese Spelling Correction
18
GeneZC/MiniChat-1.5-3B ﹒ Text Generation
Fine-tuned Llama2-7B (outperforms)
19
sail/Sailor-0.5B ﹒ Text Generation
Tuned for SEA (South-East Asian lang) Indonesian, Thai, Malay, Vietnamese-
20
sail/Sailor-1.8B-Chat ﹒ Text Generation
21
FreedomIntelligence/AceGPT-v1.5-13B ﹒ Text Generation
AceGPT family – Arabic lang domain
Spotlight On: Multilingual Models
Multilingual models tap into the power of Large Language Models, but with support for queries created in multiple languages (beyond just English). This extends your application reach to new audiences and unlocks your ability to drive region-focused domain-specific solutions. Let’s look at some notable additions from the list above in more detail.
1. Yi Series by 01.AI
The information below is summarized from these model creator resources:
Model Website · Technical Report · Yi Series Models (GitHub) · Cookbook
The Yi series of models are large language models trained from scratch by 01-AI to support bilingual (English, Chinese) text generation tasks, and are considered one of the strongest LLMs for language understanding, commonsense reasoning, reading comprehension and more. The model comes in three sizes – 5B (for personal use), 9B (for coding and math) and 34B (for personal, academic and commercial use) with both base and fine-tuned (chat) model options. We added the 01-ai/Yi-34B-Chat model to the catalog in July – here’s a look at how it performs against comparable LLMs on popular benchmarks.
The base model ranked first among all existing open-source models in both English and Chinese benchmarks. The chat model outperformed other LLMs (except GPT-4-Turbo) on the AlpacaEval Leaderboard in January 2024. The model performance was evaluated with zero-shot and few-shot prompting – ranking highly on most benchmarks, making it a proficient model for bilingual conversational use.
The Yi-1.5 series of models is an upgraded version of Yi with all those capabilities and a much stronger performance in coding, math, reasoning and instruction-following capabilities thanks to being continuously pre-trained on a high-quality corpus (500B tokens) and fine-tune on 3M diverse samples. The 01-ai/Yi-1.5-34B model was added to the Azure AI catalog in July. Based on the provided data, the model achieved parity with, or outperformed, comparable models across multiple popular benchmarks.
2. Sailor: Open Language Models for South-East Asia
The information below is summarized from these model creator resources:
Model Website · Technical Report · Sailor Language Models
Sailor is a suite of Open Language Models tailored for South-East Asia (SEA) built from the Qwen 1.5 model which performs well for these languages. The models are designed to understand and generate text for the diverse languages dominating the SEA region.
The base models are fine-tuned with open-source datasets to get instruction-tuned Sailor-chat model variants. In July, we added the sail/Sailor-0.5B base model and the sail/Sailor-1.8B-Chat chat model to the Hugging Face collection in the Azure AI model catalog.
Sailor is continually pretrained on 200B-400B tokens over 7 languages (Indonesian, Vietnamese, Thai, Malay, Lao, English and Chinese) using well-known publicly-available corpus with aggressive de-duplication and data cleaning to create a high-quality dataset. The models are then evaluated 4 core tasks – using these well-known benchmarks.
Question Answering: XQuAD (Thai, Vietnamese) and TydiQA (Indonesian).
Commonsense Reasoning: XCOPA (Indonesian, Thai, Vietnamese).
Reading Comprehension: Belebele (Indonesian, Thai, Vietnamese).
Examination: M3Exam (Javanese, Thai, Vietnamese).
The results shown below are taken from their website, with the highlighted row reflected the base model we just added to the catalog. The evaluation reports the 3-shot Exact Match (EM) for prompts provided in the local languages. Baseline models outperforming Sailor models are highlighted in green – with results showing this family’s proficiency in SEA languages across all four task categories. Note: Sailor models are licensed for research and commercial use – you should see the Qwen 1.5 license for exceptions.
Get Started Using Hugging Face Models on Azure
Getting started with using Hugging Face models in Azure involves three steps:
Pick the right model from the catalog: Explore the Hugging Face Collection.
Deploy the model to Azure: use Azure AI Studio or Python SDK or Azure CLI.
Run a test inference: use Python Samples or Create your own test sample.
Samples are available for core tasks – for instance this sample shown above walks you through the end-to-end process for a text generation task with streaming support. Simply replace the default model with a different Hugging Face model from the Azure AI catalog, and run.
Request a Hugging Face Model for the Azure catalog
Want to see a different Hugging Face hub model on the Azure AI catalog? Request it by visiting that model’s page on the Hugging Face hub. Click the “Azure ML” option under the Deploy dropdown (top right on page). If that model is not currently in our catalog (e.g., SmolLM-135M) you will see the “Request to add” option as shown. If it was already added to the catalog (e.g., SmolLM-1.7B) you will instead get a `Go to model in AzureML` option.
Get Involved
As we announced in May 2024, we will deepen Hugging Face hub and Azure AI platform integrations with model discoverability, custom deployment, and fine-tuning in focus. Here are a few actions you can take today to help us improve this developer experience.
Want to join a private preview program for these features? Complete this form.
Want to try inference using these models, code-first? Explore the Python samples.
Want to explore the Hugging Face models in Azure? Browse the Model catalog.
Want to learn more about the Azure AI catalog & usage? Read the Documentation.
Microsoft Tech Community – Latest Blogs –Read More
Manage your Generative AI APIs with Azure API Management and Azure Open AI
This is for you who have started with Generative AI APIs and you’re looking to take those APIs into production. At high-level, there are things to consider like load balancing error management and cost management. We’ll mention those in this article and guide you to an Azure Sample where you can get started deploying an enterprise-ready solution.
Scenario: you want to take your generative AI to production.
So, you’re starting to use Azure Open AI, you like what you see, and you see how you can add this AI functionality to several of the apps in your company.
However, you have a big operation with many customers and many different apps and enterprise grade requirements on security and you know you must tackle all that before you can adopt generative AI to your business.
Problems we must address
You write up a list of problems that you need to address to fully implement generative AI:
– Load balancing and circuit breaker: With many customers, it’s key that you can distribute the load across multiple instances. Also, error management is super important, to ensure that if one instance fails, the others can take over. In the cloud a common approach to error management is Circuit breaker helps by stopping the requests to the failing instance and redirecting them to the healthy ones.
– Monitoring and metrics: You want to monitor the usage of the AI model, how many requests are coming in, how many are failing, and how many are successful. Also, how many tokens are being used and how many are left. What about caching the responses to reduce the load on the AI model and save costs and improve performance.
– Security: You want to secure the AI model; you don’t want anyone to access it. You have perhaps started by using API keys but for enterprise scenarios, you want to use managed identity.
You ask yourself; can a cloud service handle the above problems? It looks like Azure APIM management has an interesting approach to the above problem. In fact, there’s an Azure sample that seems to implement the above, let’s dive in to see how:
Resources
Here’s some great resource to get you started and also learn more about the features implemented in the Azure Sample.
– Azure sample – APIM + Generative AI
– Azure API Management – Overview and key concepts | Microsoft Learn
– Azure API Management policy reference – azure-openai-token-limit | Microsoft Learn
– Azure API Management policy reference – azure-openai-emit-token-metric | Microsoft Learn
– Azure API Management backends | Microsoft Learn
– Use managed identities in Azure API Management | Microsoft Learn
Introducing: enterprise grade sample using APIM + Generative AI
In this sample, we get a chat app (frontend and backend) and a set of cloud resources that can be deployed to Azure using Azure Developer CLI, azd. Below is the user interface of the app included in the sample:
Architecture view of the sample
Ok, so first we get a chat window, great, that’s a good start, but let’s learn more about the architecture, how the sample is implemented:
The easiest way to describe how the architecture works is considering an incoming web request and what happens to it. In our case, we have a POST request with a prompt.
Request is hitting the API, and the API considers what to do with it:
Authentication, first it checks whether you’re allowed by checking the subscriberID you provided in your request
Routing. Next the API checks the policies to determines whether this request is within token limits (and the request is logged), thereafter it’s sent to the loadBalancer, where the load balancer determines which backend to send it to (each backend has 1:1 association with an Azure Open AI endpoint )
There’s an alternate scenario here where if a backend responds with error within a certain time interval and a certain type of error the request is routed to a healthy resource
Creating a response, the assigned Azure Open AI endpoint responds, and the user sees the response rendered in the chat app.
Above is the happy path, if an endpoint throws errors for some reason with a certain frequency and/or error code the circuit breaker logic is triggered, and the request is routed to a healthy endpoint. Another reason for not getting a chat response back is if the token limits have been hit, i.e. rate limiting (you’ve for example made too many requests in a short time span).
Also note how a semantic cache could be made to respond instead if a response and prompt is similar to what’s already in the cache.
How to get started
Ensure you have a terminal up and running and that you Azure Developer CLI, azd installed. Then run the following steps:
Clone the repo (or start in codespaces)
git clone https://github.com/Azure-Samples/genai-gateway-apim.git
Login to Azure,
azd auth login
Run app, at this point, you have your cloud resources deployed. To test these out, run the app locally (you need to have Node.js installed), at repo directory, run the below commands in a terminal:
cd src
npm install
npm start
This will start the app on http://localhost:3000 and the API is available at http:localhost:1337.
What next
Our suggestion is that you go and check out the Azure Sample – APIM + Gen AI Try deploying it and see how it works.
Let us know if you have any questions or feedback.
Microsoft Tech Community – Latest Blogs –Read More
