Cloud Resource Provisioning

To simplify the cloud environment setup, we give end users an Azure template (with a button to have a simplified experience) so they can provision resources easily. From a high level point of view, it’s a JSON file that Azure knows how to parse, and you specify the corresponding resources in the JSON file and Azure will validate and provision it for you.

The JSON file is located here, and developers can paste it to the Azure Template Manager to run the template with updates they want to have.

The template contains a lot Azure specific terms, and more details can be found here for Azure Templates.

The JSON (ARM Template - Azure Resource Manager Template) file has been built from Bicep language which is a domain-specific language (DSL) that uses declarative syntax to deploy Azure resources.

The Bicep files are here and has been translated with deploy.json file

Here is the simplest steps for deploying Feathr resources in your Azure Subscription and configure resources.

Step 1. Launch Cloud Shell

Open Azure Cloud Shell with Powershell environment.

Step 2. Invoke Deployment Script

Invoke Deployment Script from GitHub Repo with parameter for Azure Region.
Available regions can be checked with this command

    Get-AzLocation | select displayname,location

    iwr https://raw.githubusercontent.com/linkedin/feathr/main/docs/how-to-guides/deployFeathr.ps1 -outfile ./deployFeathr.ps1; ./deployFeathr.ps1 -AzureRegion '{Assign Your Region}'  

With this command, deployFeathr.ps1 retrieves your Azure User Object Id then create Azure deployment with ARM template which have been built by bicep files.

Deployment may take up to 10 mins.
After deploying Azure resources for Feathr, need to install additional Python libraries for Synapse notebook environment.

Step 3. Manage Python libraries Packages for Apache Spark in Azure Synapse Analytics

To working with Feathr libraries in Azure Synapse notebook environment, we need to add additional Python library package with requirements.txt file.

Please check the instruction (Manage packages from Synapse Studio or Azure portal) and follow the step.