Introduction

Azure CycleCloud Workspace for Slurm (CCWS) is a new Infrastructure as a Service (IaaS) solution which allows the users to purpose build the environment for their distributed AI training and HPC simulation needs. This offering is available through Azure marketplace to simplify and streamline the creation plus management of Slurm clusters on Azure. Users can easily create and configure pre-defined Slurm clusters with Azure CycleCloud, without requiring any prior knowledge of the cloud or Slurm giving a full control of the infrastructure to the user. Slurm clusters will be pre-configured with PMix v4, Pyxis and enroot to support containerized AI Slurm jobs and users can bring their own libraries or customize the cluster with the choice of their software and libraries to suit their needs.  Users can access the provisioned login node (or scheduler node) using SSH or Visual Studio Code to perform common tasks like submitting and managing Slurm jobs. This blog will outline the steps to fine-tune a diffusion model from Hugging Face using CCWS. 

Deploy Azure CycleCloud Workspace for Slurm 

To deploy Azure CCWS from Azure Marketplace follow the steps mentioned here. 

Our provisioned environment for CCWS comprises of the following

(1) One Login node of F4sv2 and one Scheduler Node of D4asv4 SKU with Slurm 23.11.7. 

(2) Up to 8 on-demand GPU nodes of NDasrA100v4 SKU in gpu partition. 

(3) Up to 16 on-demand HPC nodes of HBv3 SKU in hpc partition

(4) Up to 10 on-demand HTC nodes of NCA100v4 in htc partition. 

(5) 1 TB shared NFS.

Note: For Steps (1) to (4) above it is important to request for quota from the Azure portal before CCWS is deployed. 

Once CCWS is deployed, SSH into the scheduler node. We can query on the mounted storage using 

df -h

This cluster has 1 TB of shared NFS available on all the nodes. 

Prepare the environment

Once CCWS is deployed SSH into the login node.

(1) Install the conda environment and the tools required on the Shared NFS. In our environment, the shared NFS is mounted as /shared.

First we will get the miniconda installation. 

$ wget https://repo.anaconda.com/miniconda/Miniconda3-latest-Linux-x86_64.sh

 Install miniconda on /shared

$ bash Miniconda3-latest-Linux-x86_64.sh

(2) Once conda is done, install Python 3.8. Note, this code may have library conflicts if newer versions of Python are chosen. 

$ conda install python=3.8

(3) Clone the hugging face repository and install the required libraries.

$ git clone https://github.com/huggingface/diffusers
$cd diffusers
$ pip install .

(4) Move to the examples folder and install the packages as per the requirements.txt file

Prepare the Slurm Submission Script 

Below is the slurm submission script which has been used to initiate a multi-gpu training job. The provisioned GPU is a NDasrA100v4 SKU which has 8 GPUs

The job can be submitted using sbatch and can be queried using squeue. Azure CCWS will take few minutes (6-7) to provision a GPU node once job is submitted post which the job starts running immediately. 

Querying sinfo will list us the nodes which are allocated for our job and also the nodes available. It is important to note that the users are only charged for the nodes which are in ‘alloc’ state and not those in ‘idle’.

The NODELIST provides a list of the nodes, and the user can ssh into them from the login node using the nodenames listed in the table below

ssh ccw-gpu-1
nvidia-smi

Inferencing on the model

Once fine tuning is complete, the model can be tested for inferencing. We test this using a simple python script but there are several avenues available to inference. 

The above script infers the Yoda character to our prompt input “yoda” using the fine-tuned model. 

Conclusion

This blog has outlined the steps to fine-tune a diffusion model from Hugging Face using Azure CycleCloud Workspace for Slurm. The environment is secure, fully customizable and allows the user to bring their own code, software packages, select their choice of virtual machines including high-performant storage choices (such as the Azure Managed Lustre) and the ability to deploy in their own Virtual Network. The operating system images (Ubuntu 20.04 in this case) can be fetched from the Azure marketplace and are preconfigured with Infiniband drivers, MPI libraries, NCCL communicators, CUDA toolkit making the cluster ready-to-use within minutes. Importantly, the GPU VMs are on-demand (auto-scaled) only charging the user for the duration of the usage. 

​Microsoft Tech Community – Latest Blogs –Read More 

एयरटेल पेमेंट बैंक से कैसे बात करें? ग्राहक सेवा 0886//-1111//-624 +पर कॉल करें और रद्दीकरण का अनुरोध करें, वे आपसे कारण पूछेंगे और फिर आपका पेटीएम 24 horse दिनों के बाद आपको अपना रिफंड मिल जाएगा

​एयरटेल पेमेंट बैंक से कैसे बात करें? ग्राहक सेवा 0886//-1111//-624 +पर कॉल करें और रद्दीकरण का अनुरोध करें, वे आपसे कारण पूछेंगे और फिर आपका पेटीएम 24 horse दिनों के बाद आपको अपना रिफंड मिल जाएगा  Read More

​

Unfortunately, you released the Canary 27723 build, which is causing me a lot of problems. After completing its installation, I can hear the startup screen sound (login screen sound) in the background, but I have a dark screen (as if the screen matrix was unplugged). To find a solution, I entered safe mode and ran the computer through scanhealth, restorehealth and scannow. Additionally, I used the NVIDIA cleanup application. After such actions, I managed to start the computer with the screen in normal mode and log into the system. Unfortunately, a few minutes later, my laptop started as if selecting some components, because it flickered with the image quality resolution, after which my screen turns off and the keyboard backlight turns off. The backlight turns on again after about 30 seconds, but the screen remains dark.
I will add that this situation does not occur on the previous version 27718.

The problem occurred to me a few times (several attempts) and only each time I restored the version to 27718 it solves it. In turn, trying to run the new, installed build 27723 unfortunately ends with the system loading each time, a black laptop screen and only the sound of the system login window playing in the speakers.
The problem concerns MSI GT72 6QE Dominator pro with NVIDIA 980M card

​Unfortunately, you released the Canary 27723 build, which is causing me a lot of problems. After completing its installation, I can hear the startup screen sound (login screen sound) in the background, but I have a dark screen (as if the screen matrix was unplugged). To find a solution, I entered safe mode and ran the computer through scanhealth, restorehealth and scannow. Additionally, I used the NVIDIA cleanup application. After such actions, I managed to start the computer with the screen in normal mode and log into the system. Unfortunately, a few minutes later, my laptop started as if selecting some components, because it flickered with the image quality resolution, after which my screen turns off and the keyboard backlight turns off. The backlight turns on again after about 30 seconds, but the screen remains dark.I will add that this situation does not occur on the previous version 27718.The problem occurred to me a few times (several attempts) and only each time I restored the version to 27718 it solves it. In turn, trying to run the new, installed build 27723 unfortunately ends with the system loading each time, a black laptop screen and only the sound of the system login window playing in the speakers.The problem concerns MSI GT72 6QE Dominator pro with NVIDIA 980M card  Read More

​

Hello, I need help.

I am using this API:
https://graph.microsoft.com/v1.0/me/messages/{id}/attachments

Where I get the message ID is from here:

But the response always fails, and I’m sure it has something to do with the validity or format of the message ID. Is there any way I can find the correct format of the message ID? Or is there any way I can find other ways to find the message ID in the UI of Outlook web?

​Hello, I need help.I am using this API:https://graph.microsoft.com/v1.0/me/messages/{id}/attachments Where I get the message ID is from here:But the response always fails, and I’m sure it has something to do with the validity or format of the message ID. Is there any way I can find the correct format of the message ID? Or is there any way I can find other ways to find the message ID in the UI of Outlook web?    Read More

​

Toobit Exchange Referral ID “l8xQZs” | Get 30% Off On Trading Fees for Lifetime + Up to $5,000 Bonus

Unlock remarkable savings with Toobit Exchange by using the Referral ID “l8xQZs.” This exclusive offer provides you with a 30% discount on trading fees for a lifetime and a sign-up bonus of up to $5,000 for new users.

Toobit Exchange is celebrated for its user-friendly interface and a wide array of trading options, catering to both beginners and experienced traders. By applying this referral ID during registration, you’ll gain access to significant savings and exciting bonuses that enhance your trading experience.

Here are the key benefits of using Toobit Exchange Referral ID “l8xQZs”:

Exchange Toobit Exchange

Referral IDl8xQZsTrading Fee Discount30%BonusUp to $5,000Discount DurationLifetimeDate2024-25

To get started, simply sign up on Toobit Exchange using the Referral ID “l8xQZs.” You will immediately enjoy a 30% reduction on all trading fees, allowing you to maximize your profits with every trade. In addition, you’ll be eligible for a bonus of up to $5,000, giving your trading account a substantial boost right from the beginning.

Whether you’re new to cryptocurrency trading or a seasoned pro, Toobit Exchange offers a perfect combination of competitive fees and generous bonuses. Don’t miss out on this incredible opportunity—register today using the Referral ID “l8xQZs” and experience 30% off on trading fees for life along with up to $5,000 in bonuses!

​Toobit Exchange Referral ID “l8xQZs” | Get 30% Off On Trading Fees for Lifetime + Up to $5,000 BonusUnlock remarkable savings with Toobit Exchange by using the Referral ID “l8xQZs.” This exclusive offer provides you with a 30% discount on trading fees for a lifetime and a sign-up bonus of up to $5,000 for new users.Toobit Exchange is celebrated for its user-friendly interface and a wide array of trading options, catering to both beginners and experienced traders. By applying this referral ID during registration, you’ll gain access to significant savings and exciting bonuses that enhance your trading experience.Here are the key benefits of using Toobit Exchange Referral ID “l8xQZs”:Exchange Toobit ExchangeReferral IDl8xQZsTrading Fee Discount30%BonusUp to $5,000Discount DurationLifetimeDate2024-25To get started, simply sign up on Toobit Exchange using the Referral ID “l8xQZs.” You will immediately enjoy a 30% reduction on all trading fees, allowing you to maximize your profits with every trade. In addition, you’ll be eligible for a bonus of up to $5,000, giving your trading account a substantial boost right from the beginning.Whether you’re new to cryptocurrency trading or a seasoned pro, Toobit Exchange offers a perfect combination of competitive fees and generous bonuses. Don’t miss out on this incredible opportunity—register today using the Referral ID “l8xQZs” and experience 30% off on trading fees for life along with up to $5,000 in bonuses!  Read More

​

Hello, 

I am currently working with 20 other colleagues on different excel files and I am wondering if I can create a macro that export my data to their files and then another macro that import their data to my file. 

To be more specific:

On my file I complete columns from A to F, H and I and my colleagues should complete column G, J and K. 

I update my file daily with new leads and, when I export, I do not want to overwrite data on their file, just to ad more rows to the existing ones. And when I make the import to my file, I want to return information on red columns from those 20 excel files. 

Thank you in advance for help!

Here is an example. 

​Hello,  I am currently working with 20 other colleagues on different excel files and I am wondering if I can create a macro that export my data to their files and then another macro that import their data to my file. To be more specific:On my file I complete columns from A to F, H and I and my colleagues should complete column G, J and K. I update my file daily with new leads and, when I export, I do not want to overwrite data on their file, just to ad more rows to the existing ones. And when I make the import to my file, I want to return information on red columns from those 20 excel files. Thank you in advance for help! Here is an example.     Read More

​

Led by California Conference for Equality and Justice adult education team, our relationship-centered trainings introduce the core concepts of Restorative Justice as foundational practices in establishing equitable and just cultures.

What is Restorative Justice?
Restorative Justice is centering relationships in all we do, including when harm happens. Community Building Circles are dialogue-based spaces to build empathy, strengthen community, prevent conflict, and prepare for using Restorative Justice as a way to hold people accountable. This work is rooted in a culture shift away from incarceration & carceral thinking, disposability of human beings, three strikes laws/zero-tolerance policies, racist formal and informal policing, and disproportionately punitive disciplinary models.

Training Summary:
We explore the following dialogue skills that affirm positive relationships and provide interventions to shift relationships towards accountability and self-directed actions: Affective Statements, Restorative Questions, Active Listening, and Motivational Interviewing. This training includes skill-building experiences and opportunities for self-reflective work to empower us to respond to challenges with others through a relationship-centered lens.

For more information visit:

https://www.cacej.org/trainings/restorative-dialogue-training-5jehe

Training: Restorative Dialogue

Dates: Wednesday, November 6, 2024, 9:00 AM – 12:00 PM

Location: CCEJ, 3605 Long Beach Blvd, Suite 100, Long Beach 90807

Registration Fee: $110

Registration Link: https://www.surveymonkey.com/r/RestorativeDialogue2024

​Led by California Conference for Equality and Justice adult education team, our relationship-centered trainings introduce the core concepts of Restorative Justice as foundational practices in establishing equitable and just cultures. What is Restorative Justice?Restorative Justice is centering relationships in all we do, including when harm happens. Community Building Circles are dialogue-based spaces to build empathy, strengthen community, prevent conflict, and prepare for using Restorative Justice as a way to hold people accountable. This work is rooted in a culture shift away from incarceration & carceral thinking, disposability of human beings, three strikes laws/zero-tolerance policies, racist formal and informal policing, and disproportionately punitive disciplinary models. Training Summary:We explore the following dialogue skills that affirm positive relationships and provide interventions to shift relationships towards accountability and self-directed actions: Affective Statements, Restorative Questions, Active Listening, and Motivational Interviewing. This training includes skill-building experiences and opportunities for self-reflective work to empower us to respond to challenges with others through a relationship-centered lens. For more information visit:https://www.cacej.org/trainings/restorative-dialogue-training-5jehe Training: Restorative DialogueDates: Wednesday, November 6, 2024, 9:00 AM – 12:00 PMLocation: CCEJ, 3605 Long Beach Blvd, Suite 100, Long Beach 90807Registration Fee: $110Registration Link: https://www.surveymonkey.com/r/RestorativeDialogue2024  Read More

​

Hello:

I am trying to create policy that would require a specific tag with only certain values (for example, tag deployment that can only be prod/non-prod) and having trouble to do it. 

Can someone please help? 

Looks like I can do a policy where I can choose during assignment (in parameters) what exact value I want to see (see json below), but I want to deny anything (deployment, adjustments and etc.) if the tag value not in my list…

{
“mode”: “Indexed”,
“policyRule”: {
“if”: {
“not”: {
“field”: “[concat(‘tags[‘, parameters(‘tagName’), ‘]’)]”,
“equals”: “[parameters(‘tagValue’)]”
}
},
“then”: {
“effect”: “deny”
}
},
“parameters”: {
“tagName”: {
“type”: “String”,
“metadata”: {
“displayName”: “Tag Name1”,
“description”: “Name of the tag, such as ‘environment'”
}
},
“tagValue”: {
“type”: “String”,
“metadata”: {
“displayName”: “Tag Value1”,
“description”: “Value of the tag, such as ‘production'”
},
“allowedValues”: [
“prod”,
“non-prod”
]
}
}
}

Thank you!

​Hello: I am trying to create policy that would require a specific tag with only certain values (for example, tag deployment that can only be prod/non-prod) and having trouble to do it.  Can someone please help?  Looks like I can do a policy where I can choose during assignment (in parameters) what exact value I want to see (see json below), but I want to deny anything (deployment, adjustments and etc.) if the tag value not in my list… {“mode”: “Indexed”,”policyRule”: {“if”: {“not”: {“field”: “[concat(‘tags[‘, parameters(‘tagName’), ‘]’)]”,”equals”: “[parameters(‘tagValue’)]”}},”then”: {“effect”: “deny”}},”parameters”: {“tagName”: {“type”: “String”,”metadata”: {“displayName”: “Tag Name1″,”description”: “Name of the tag, such as ‘environment'”}},”tagValue”: {“type”: “String”,”metadata”: {“displayName”: “Tag Value1″,”description”: “Value of the tag, such as ‘production'”},”allowedValues”: [“prod”,”non-prod”]}}} Thank you!  Read More

​

Hi,

I’m wanting to create a formula for creating an automatic statement as to whether a report has been submitted on time or not. The report due date doesn’t change, it’s always due on 28 October for the current year. I’m guessing there will be a lot of IF statements as I’m wanting it to say:
No – Submitted * day(s) late              {Based on how many days it was submitted after 28 October}
Yes – Submitted on due date
Yes – Submitted * day(s) early            {Based on how many days it was submitted before 28 October}

Mock example below

​Hi,I’m wanting to create a formula for creating an automatic statement as to whether a report has been submitted on time or not. The report due date doesn’t change, it’s always due on 28 October for the current year. I’m guessing there will be a lot of IF statements as I’m wanting it to say:No – Submitted * day(s) late              {Based on how many days it was submitted after 28 October}Yes – Submitted on due dateYes – Submitted * day(s) early            {Based on how many days it was submitted before 28 October}Mock example below   Read More

​

I have a reference table, “Office” and like to get the total personnel based on the selection of offices in the “Allocations” table where I have the data validation configured to select multiple offices.

For example, if I selected “Austin” and “Tampa” in the cell of “Allocation” column, I will get the total personnel of 55 from the Office table. Please advise how to do this. Thanks in advance!!

Office# of PersonnelAustin15Dallas21Las Vegas16Tampa40San Jose28Total120

AllocationsTotal PersonnelAustin, Dallas, Las Vegas52Austin, Tampa55

​I have a reference table, “Office” and like to get the total personnel based on the selection of offices in the “Allocations” table where I have the data validation configured to select multiple offices. For example, if I selected “Austin” and “Tampa” in the cell of “Allocation” column, I will get the total personnel of 55 from the Office table. Please advise how to do this. Thanks in advance!! Office# of PersonnelAustin15Dallas21Las Vegas16Tampa40San Jose28Total120 AllocationsTotal PersonnelAustin, Dallas, Las Vegas52Austin, Tampa55  Read More

​