How to copy data in Azure using AzCopy

Data is the key to almost all solutions. Obviously, at some point, we will need to move it. And this is when AzCopy  will come to the rescue. In this short post/video I will share how you can securely copy a Zip file (aka. data), from one location (blob storage, AWS) to a blob storage in an Azure subscription (the same subscription or a different one).

What is AzCopy 

AzCopy is a command-line utility that you can use to copy blobs or files to or from a storage account. It can run on Windows, Mac, and Linux. And... It's already available pre-install inside Cloud Shell!

How it works

AzCopy can do many things but let's focus on the "copy" feature. To copy a file from a location to another one here the command to execute:

azcopy copy https://url-source https://url-destination

It looks simple, right? And it is. To keep it secure AzCopy can use Shared Access Signature (SAS) tokens. To get those in Azure, you can execute a command (ex: az storage container generate-sas) or use the Azure Portal. 

Once you are in the Azure portal open the account storage of your source or destination (you will have to do both).

From the option on the left search for Shared access signature or just sas and click on it. Select the type of options you need. A best practice is to allow the minimum requirements. If you know you are only moving files then unchecked the File, Queue, and Table. Same things for the resources types, permissions, and expiry date/time.  Once you are done click the Generate SAS and connection string button.

Use those URLs with the SAS token in your command, and voila!

Video demo

How about Az CLI and PowerShell

If you prefer copying or moving your files using native commands in Azure PowerShell and Az CLI it's also possible here a previous post about that: How to copy files between Azure subscription from Windows, Linux, OS X, or the cloud. There is also a video for this one https://youtu.be/cE8qwnSk9qs

References:

• AzCopy: https://aka.ms/azcopy 
• Az CLI Generate SAS token

~Frank

Reading Notes #460

Cloud

• Let’s compare the cloud shells offered by AWS, Microsoft Azure, and Google Cloud Platform (Richard Seroter) - It's always interesting to read those comparison posts...

• ARM Template deployment, the what-if option for your Azure Deployments (Olivier Miossec) - The what-if feature is awesome, this post explains why and shows how to use it.

• State of the Azure SDK 2021 (Azure SDK Team) - So much good news! A ton of updates already done (do you know all of them?) And a very promising roadmap.

• Use Postman with the Microsoft Graph API - Microsoft Graph - Very complete docs about how to do your rest query using a dev tool.

Programming

• How to Add a Serverless Database to your React Projects (Michael Bagley) - This is a nice tutorial with all the code snippets to get started and try this type of project.

• If You Code on Windows, You Deserve a Better Windows Terminal (Matthew MacDonald) - Lovely. A nice post about why the new Windows Terminal is awesome.

• The New .NET Multi-platform App UI (David Ortinau) - I'm more and more excited by Maoi. The simple experience that it promises is very appealing.

Podcast

• #188 – Fame, Focus, and Billions of Pageviews with Evan Britton of Famous Birthdays (Indie Hackers) - A nice story where people focus on the users, worked super hard (and continue to do it), and had amazing success.

• How to Stop Being Complacent (Influencer Entrepreneurs with Jenny Melrose) - A nice episode to "kick our butt" and get back on track. Yes, 2020 indeed brought tons of new challenges at all and every level. However. we must try to make this year better.

• Who Owns Open-Source Software? (Coding Blocks) - Great discussion. Most of us, at some point, have to ask ourselves those questions (at least I know I did). It was very interesting listening to this episode and follow their thoughts.

• 631 - How to Explain a Gap in Your Résumé (Modern Mentor) - I have gaps in my resumé and I always been very comfortable about it. When I saw the title of this episode I thought maybe I should be concerned... Happy to know I was right!

Miscellaneous

• Coaching sessions: here’s what I talk about with junior developers (Dominique St-Amand) - An interesting post for all more junior will found answers and more experienced will have ideas about how to help others.

Books

Beyond the Trees: A Journey Alone Across Canada's Arctic

Author: Adam Shoalts

Nice adventure. I wish I could see all those images, animals, and horizon. I had a good time reading this odyssey. And for the record, as a canoeist/ kayaker I was impressed by the upriver challenge.

~Frank

How to Manage Azure Resources

What ever you are on running on Linux, Mac or Windows that you are on the road or in the comfort of your office there is many different ways to manage your Azure resources. In this video I will show you five ways to do it and explain the pros and cons of each:

1. Azure Portal
2. Azure PowerShell
3. Azure CLI
4. Azure Mobile App
5. Azure Cloud Shell

There is also an excellent Microsoft Learn module that will teach you how to use the Azure portal efficiently.

References

• Azure Portal: https://portal.azure.com
• Learn Module: https://c5m.ca/azFun-portal
• Azure PowerShell: https://c5m.ca/azPS
• Azure CLI: https://c5m.ca/azCLI
• Azure Mobile App: https://c5m.ca/azMobileApp
• Azure Cloud Shell: https://shell..azure.com

Reading Notes #401

Cloud

• Run Azure Cloud Shell in Windows Admin Center (Thomas Maurer) - Nice tutorial and demo video to enable Cloud Shell.
• Serverless HTTP With Durable Functions ( Jeremy Likness) - Great post that shows, with code examples, the new functionalities for the Durable Functions.

Programming

• ASP.NET Core 3.0 MVC Secure Authentication | Okta Developer (Lee Brandt) - Nice tutorial to add authentication to an existing .Net Core App.
• Custom Terminals and User Interface (UI) in Windows Terminal (Jeremy Likness) - Learn how to get and customize your Windows Terminal in this quick post.
• GitHub Actions for Azure is now generally available (Usha Narayanabhatta) - Fantastic news..and perfect timing... At least for me!
• GitHub Learning Path (Premier Developer) - Nice source of info to get started or... Get better.
• What is Blazor? A Tutorial on Building Web Apps with Authentication (Andrea Chiarelli) - Great article that describes in detail how to create a simple blazor app with authentification.

Miscellaneous

• Easily move WSL distributions between Windows 10 machines with import and export! (Scott Hanselman) - First I was Whaaat!? Very simple yet useful feature no need now do redo all your customization on all your computer...just export and import.

Reading Notes #379

Cloud

• 
  An experiment - The Azure Cloud Shell at the command line with AZ SHELL (Scott Hanselman) - Oooooh I love it! I will right now check what are my option and install/ configure one.
• 
  Auto blogging Jekyll with Logic Apps, ACI Containers and .NET Core (Shayne Boyer) - Great post that explains how we could use Docker in any flow with logic apps. This time it generates blog post.
• 
  Kubernetes vs Docker: How to Choose (Eric Boersma) - Interesting post that answers to a trending question.
• 
  Reading Azure Cosmos DB Data In Azure Functions (Jason Roberts) - Nice post that share code snippets for different situations.
• 
  The Urlist — An application study in Serverless and Azure (Burke Holland) - The tool looks awesome, and this post explains how it was build and gives the reasons why some choice has been made.

Programming

• 
  REST API Design Best Practices for Parameters and Query String Usage (Kay Plößer) - This is a nice post That explains some of the best practices... Now let's get back to the design table of our last API and see what is missing.
• 
  5 Reasons to Containerize Production Windows Apps on Docker Enterprise - Docker Blog (David Friedlander) - If you thought that modernizing your app is mostly impossible, this post is the light at the end of the tunnel, showing you one possibility.
• 
  Docker from the beginning — part III (Chris Noring) - Third of this docker series. I like how it is not only a happy path but the learning path with the fails and victories.
• 
  Introducing the Try .NET Global Tool - interactive in-browser documentation and workshop creator (Scott Hanselman) - That look like a very useful tool...

~

Reading Notes #349

Cloud

• Deploying an ARM template with Atlas (Louis DeJardin) - Wow! That tool looks very interesting. I'll definitely give it a try.
• What's new in PowerShell in Azure Cloud Shell | Blog | Microsoft Azure (Danny Maertens) - The cloud shell is a great tool, always there and accessible.

Programming

• How To Add A “Try In Play-With-Docker” Button To Your Github Project (Oren Yomtov) - Wow! I didn't know this project, but I'll definitely try it... And sooner than later trust me!
• Why I Use NodeJS for Basically Everything I Do. (Kieran Maher) - Interesting post, where the author shares with us the reason why he uses nodejs in all different situation.

Miscellaneous

• Installing Azure Data Studio (Steve Jones ) - A quick review of the tool. Personally, I love it, but I don't spend as much time in it as I use too when working with MSMS.
• What does Stack Overflow want to be when it grows up? (Jeff Atwood) - Very interesting article about Stack Overflow. We all use it and this is why it's so interesting to know where it comes from and where it goes.

~ Enjoy!