Showing posts with label Azure Data Factory. Show all posts
Showing posts with label Azure Data Factory. Show all posts

Monday, June 12, 2023

Tales From The Field Weekly Wrap Up for the Week of 06-05-2023 Live 360, the Missing Week, & the Pain in the Back

 Hello Dear Reader! Let's address the missing week.  Last week I was really behind due to the move.  We did not have a Monday video and despite my best efforts a blog did not get out.  It is in the draft's, partially written, and my goal is to try to publish it soon. However, other things are taking precedence.

For example, we moved A LOT of stuff. We had a full crew of able bodied kiddos, all recent High School graduates or current college students, and me.  I did my best to keep up with them.  But they are the heroes of the day.

26 foot truck started off empty at the old house and suddenly, and by suddenly I mean realizing that this new couch while cool was so heavy that it took 7 of us to lift it and get it on the truck and I-will-never-do-that-again had a realiztion that next time we would have movers or just sell the couch with the house because the idea of moving that thing can F@%& ALL THE WAY OFF.... Ahem..... as I was saying.... suddenly we were unpacking all of the large items at the new house. 

Thankfully the unpacking process went faster than the loading process, and by faster I mean we are also selling the bed's with the house; so that does it the house, the couch, and the beds, because we are not going up those stairs with everything again NO THAT IDEA CAN F...... Ahem....

Clearly the next move, movers will be employed.  Hopefully, that will not be for quite a bit of time.  There's still a lot of clean up to do.  There is a lot of things to do with the new house as well.  

Pictures to hang, er, re-hang in a more centered way that reflects less the mad-dash to occupy a house but rather the long term goal to live with artwork being less slightly off-kilter.

The next day we all appeared very sore and tired.  Everyone needed coffee before we could leave the house.  As a treat I took everyone to breakfast at the Walt Disney World's Steakhouse 71 inside of the Contemporary Resort

I booked this as a last minute thing.  I wanted to thank everyone for all the hard work.  You can see the amazing cast of family and friends as we awaited our table that morning.  The food was AMAZING.  Seriously, seriously, good.  Normally I take pictures.  That's my thing.  We were all so famished we ate with reckless abandon.  I had Walt's Prime Rib Hash with an over easy egg, we had an order of the Seasonal Pancakes for the table for all to split.  They were blueberry with lemon and they were divine. I had a bite of Sue's filet off the Steak and Eggs.  The whole family came away full, happy, and resolving to make it back to Steakhouse 71 for another breakfast and of course steaks!


When Sue and I took the truck back, we had a beautiful site in store.  It had rained on the way there and was starting to become intermittent.  As I hoped in her car to ride back home we looked up and saw a full end to end rainbow.  What a beautiful site, as we drove it actually became a double end to end rainbow and the end seemed to be at the area surrounding our new home.  Not a bad start.

That was last week. This weekend everything started out pretty good.  We were going to clean Saturday and then had plans for Sunday.  Late Saturday I did something wrong and the pain in my back started.  I was down for the majority of Saturday and Sunday as well.  Thankfully I had a muscle relaxer left over from a neck issue.  I remembered that and took it Sunday night before bed.  I'm doing much better today, but other than a really nice family dinner on Sunday.  Not a lot to write about.

This past week the Tales from the Field crew was busy cranking out videos for this week and next week, as well as coordinating some really cool content drops with the Microsoft Fabric PG for later this month.  

Alright, let's get over to that content!

WEDNESDAY 06-07-2023

On Wednesday we released Microsoft Fabric, VS Code, Notebooks, & Spark! Set it up, connect to a Workspace, EDIT, & Upload!! One of the big questions people have is how do I integrate my existing tools with Microsoft Fabric.


In this video I showed how to connect VS Code to your Microsoft Fabric workspace, how to download, modify, and upload a notebook.  If this interests you, I'd love to hear from you!

TUESDAY 06-06-2023

On Tuesday we had our Azure Data Community Round Table!  We started started talking about the weekend and how we wake up feeling sore for a variety of reasons and that Josh Luedeman (Twitter | @JoshLuedeman) has lost 40lbs!!!  WAY TO GO JOSH!!


As always the star of the show is the content:

Neeraj

Introducing the end-to-end scenarios in Microsoft Fabric  by Ravs Kaur Twitter @Ravskkaur

Bradley

Parameter Sensitive Plan Optimization, Why?  by Derek Wilson Twitter @thesqlsith

Andres

Announcing our improved experiment tracking tools in Azure Machine Learning by Ami Patel  

Josh

Azure SQL DB Private Link / Private Endpoint - Connectivity Troubleshooting  by Sergio Fonseca Twitter @FonsecaSergio  

Neeraj

AI and Xmind : How to Create A Mind Map with ChatGPT - Xmind: The Most Popular Mind Mapping App on The Planet.  by Jay Twitter @xmind

Bradley

What’s New in SSDT 17.6: Ledger, Performance, Copilot by Subhojit Basak Twitter @subho4594

Andres

Understanding ChatGPT Plugins: Benefits, Risks, and Future Developments  by Mary Newhauser  


Josh

What is Data Factory in Microsoft Fabric  by Reza Rad Twitter @rad_reza

Neeraj

Thought Leadership: What It Is and How to Master It in 2023  by Margarita Loktionova Twitter @semrush

Bradley

CREATE AND VERIFY MICROSOFT FABRIC CAPACITY  by Dharmendra Keshari Twitter @Sachit_Keshari


Andres

Build Intelligent Applications using ChatGPT & Azure Cosmos DB  by Mark Brown Twitter @markjbrown

Josh

Deploy and run a Azure OpenAI/ChatGPT application on AKS via Bicep  by Paolo Salvatori  


WRAP IT UP

Ok Dear Reader, we've got a video coming your way today.  Neeraj Jhaveri(@Twitter |@Neeraj_Jhaveri) is bringing you Microsoft Fabric Decision Trees, Deciding Which Service to USE!! today!

Tomorrow is our weekly Azue Data Community Round Table featuring content from the community!  If you want to add your content to the list we cover sound off in the comments below.

Wednesday we will have another MS Tech Bits and I hope we will see or interact with you sometime this week.

As always Dear Reader, Thank you for stopping by.


Thanks,


Brad

Monday, April 17, 2023

Tales From The Field Weekly Wrap Up for the Week of 04-10-2023, Taylor Swift, & The Disney 10 Miler

 Hello Dear Reader!  Last week was a really busy week with an even busier weekend.  We will get to the show recap's in a moment but first let's dive into the weekend.

Months ago my wife & youngest son worked together to get Taylor Swift tickets for this past weekend.  I've enjoyed quite a few songs of Taylor's, but live music isn't really my thing.  My wife loves it.  She had a career working in radio and she was the planner & show runner for many many live music concerts.  She "makes" me go with her.  

To be honest I always have a great time, but it is not something I seek out for myself.  So when Sue & William were excitingly explaining to me over dinner how they were able to secure 3 tickets my first thought was they were taking my sister Julie or my youngest daughter Serenity (both of whom would have fought me..... and probably won... to get these tickets).  It was not Julie or Serenity.  It was me.

Don't get me wrong, I was happy to suggest they offer up the ticket to someone else.  Heck, I got us a really great hotel room at the Tampa Edition.  It had a Michelin star chef.  An amazing bar, a welcome cocktail with a lavender spritz and their gin brewed specifically for the hotel, not to mention a Rum bar, and to top it all off an in house spa.

My offer was that they could go to the show, I would go to the spa and get a massage, go to one of the restaurants and eat some food, go to the bar and get some drinks, then head to the pool where they had a pool side bar, take a nap, wake up, go grab some more drinks, and wait for them to get back so they could tell me all about it.

As you can tell from the pictures my offer was refused.  We had a great time.  There were songs we sang along to, that we danced to, and it was a spectacle.  It cannot be said that Ms. Swift puts on one helluva show.  She performed for 3 hours straight and sang 44 songs from 9 different albums and 2 surprisesongs.

On Saturday morning we woke up, had a really nice brunch at The Pearl and made our way back to Orlando so I could pick
up my race packet for the Run Disney 10 Miler.  I will be honest Dear Reader, I forgot I signed up for this race until the week before.

I have picked my running back up post injury, but had not been training on longer races.  Normally my long Disney Races are half marathon's, 13.1 miles or 21 K, this was a 10 mile run or roughly 16K.

Those 3.1 Miles or extra 5 K's make a difference.  Seriously.  That is normally the part of that race where I hit a wall.  Not literally.  In running when you hit a wall is a condition of sudden fatigue and loss of energy which is caused by the depletion of glycogen stores in the liver and muscles.  It makes that the most difficult portion of the race.

By not hitting that wall I was never truly fatigued during the race.  I was able to keep my run-walk-run-walk method going and averaged 8 minutes per kilometer and finished in 2 hours and 11 minutes. 

At home we my lovely wife was home busily preparing for my Mother-In-Law's 77th birthday!!  I love my Mother-In-Law Judy.  She is an incredible woman.  My brother's-In-Law, my nieces, and one of my nephews made it over.  However the star of the show was my baby grand-niece.  No pictures, but she is the most beautiful and adorable little girl.  She is six months old and in a very fun phase where she is not yet walking, but alert, attentive, and very opinionative.  You knew what she liked and didn't like!  The party was great and seeing family was the cherry on the cake.  

Like I said, busy weekend.  Now let's recap last week!!

WEDNESDAY 4-12-2023

On Wednesday we dropped the demo heavy companion to last weeks video SQL Server Internals: HEAPS VS. CLUSTERED INDEXES!

This was a really fun video to make, and I'm hard at work on this weeks content which will be a fun video about Azure SQL and how it utilizes space.


TUESDAY 4-11-2023
Tuesday was a great show.  We started off the Community Round Table with a side conversation about being a parent and giving the magic of wonder to our children.  Josh Luedeman (Twitter | @JoshLuedeman) reminisced about Castle Greyskull with me from our childhood.  Neeraj Jhaveri (Twitter | @Neeraj_Jhaveri) talked about when he gave his kids the gift of iPhones!  Andres Padilla (Twitter | @nodestreamio) talked about an AMAZING Christmas where his father hung his the Star Wars ships he received from the ceiling like they were flying!



We also covered AMAZING Azure Data Community content from the creators.  Here's the content in order of appearance:

Neeraj 

Bradley 
Using Azure Data Factory to read and process REST API datasets by Rayis Imayev Twitter  @RayisImayev 

Andres 

Josh 

Neeraj 


Bradley 
EightKB Topics  by Andrew Pruski Twitter  @dbafromthecold 

Andres 
Understanding Chaos Engineering by John Engel-Kemnetz Twitter @jkemnetz 


Josh 
Armchair Architects: Data Mesh Architecture by David Blank-Edelman Twitter @otterbook  

Neeraj 
Introducing Microsoft 365 Copilot – your copilot for work  by Jared Spataro Twitter @jared_spataro 

Bradley 
How to work with ChatGPT in Visual Studio Code  by Daniel Calbimonte via SQL Server Central Twitter  @dcalbimonte  @SQLServerCentrl 

Andres 

Josh 


WRAP IT UP
As we wrap things up a quick programming note.  We will be dropping an MS Tech Bits video TODAY on Cost Management by Neeraj & Andres!  Make sure to check that out when it goes live.

Tomorrow we have our Community Round Table show Live at 1 PM EST.  On Wednesday I will be with you for an MS Tech Bits on Azure SQL Database Shrinking Operations for Data & Log Files. 

We hope you have a wonderful week and make some time to hang out with us Dear Reader, if you did anything fun this weekend I'd love to hear from you!

As always Dear Reader, Thank you for stopping by.


Thanks,

Brad 



Tuesday, April 4, 2023

Tales From The Field Weekly Wrap Up for the Week of 03-27-2023 & MegaCON

Zach's 1st MegaCon 2011
 Hello Dear Reader!  This past week is a blur.  It was a tough week at work.  That sentence is an understatement, but its really all I can say at this point.  Monday sent me for a tail spin.  I was fresh off a weekend relaxing with my wife, planning events with my friends, and thinking things were pretty well set.  Life has a way of suprising you.

We powered through last week, had our Community Round Table, and dropped our new content.  Internally at Tales from the Field we did some Camtasia training, explored some new technology, and started some planning for the next 3 months.  I'm excited about those things.  Before I knew it the weekend was upon us.

12 Years Later MegaCon 2023

I'm really tough to shop for, I hear that a lot around Christmas time.  I don't mean to be difficult, but if I want something I tend to buy it.  Books, collectibles, comics, whiskey, gin, ....I digress.  This year my wife did something exceptionally cool for me.  She bought me things to give me experiences, one of those was ticket's to MegaCON in Orlando.  She bought me floor passes & and extra pass to share.  

I shared mine with my oldest son Zachary.  My first MegaCon ever was with Zachary when he was 7 years old.  When it comes to comic book conventions I've only ever been to two and he was with me at both of them.  He enjoyed this so much, I think this is a must do again next year!

One of the things I've always loved it the effort people put into their costumes, how generous they are with their time, and a willingness to celebrate with others.  That was as true when he was a little kiddo dressed in a Superman t-shirt as it was this year when he was dressed as Eren Yeager this year.

I hope you had a good weekend out there Dear Reader!  On to the wrap up.


WEDNESDAY 03-29-2023

On Wednesday we dropped our MS Tech Bits, Turn SQL to KQL IN SECONDS with Azure Data Explorer.  This video is based off the demo I did with Patrick LeBlanc (Twitter | @PatrickDBA) in our Session at SQLBits (Twitter | @SQLBits).

I love Azure Data Explorer, it is an incredibly powerful service for digesting log data and querying massive data sets and returning results in seconds.  It has so many capabilities and possibilities.  BUT... I don't know KQL and I don't know if I want to learn another language.  Fear not as I show in this video you can use the EXPLAIN statement to translate SQL to KQL that you can then run against your data sets.

I'm hoping this leads to peopel realizing that the bar for entry to this service is low, if you know SQL then you know KQL!


TUESDAY 03-28-2023

On Tuesday I once again teamed up with Josh Luedeman (Twitter | @JoshLuedeman), Andres Padilla (Twitter | @nodestreamio), & Neeraj Jhaveri (Twitter | @neeraj_jhaveri) to review the AMAZING community content that you all produced!  If you missed that make sure to check it out.


The true star of the show is the content produced by the Community.  Here is the content in order that it was covered on the show:

Neeraj

Multi-Column Distribution for Dedicated SQL pools is now GA! by Mariya Ali Twitter @mariyaali

Bradley

How to use an Annotation in Azure Data Factory or Azure Synapse Analytics Data Integration Pipeline?  by Alpa Buddhabhatti Twitter  @AlpaB7

Andres

How to set up a Python virtual environment on Windows by Abhinav Saraswat 

Josh

Announcing the Release of Azure Data Studio 1.4.2  by Erin Stellato Twitter @erinstellato

Neeraj

Working with the GPT-4 and ChatGPT models on Azure by Derek Legenzoff Twitter @DerekLegenzoff

Bradley

What is Visual ChatGPT?   by  Andy Sansom 

Andres

Spark Monitoring  by Dustin Vannoy Twitter @dustinvannoy

Josh

Turn your database into an API in minutes with Data API builder for Azure Databases  by Jasmine Greenway Twitter @paladique

Neeraj

The Importance of SQL Saturdays  by Angela Tidwell Twitter @AngelaTidwell

Bradley

KQL Series – ingesting data with Azure Data Factory by Hamish Watson Twitter   @TheHybridDBA

Andres

Eliminate these 11 phrases that ‘make people question your credibility,’ says public speaking expert  by Christina Helena Twitter @christinahelena

Josh

Azure Podcast - Episode 455 - Azure ML in the Real World  by Azure Podcast Twitter @AzurePodcast


WRAP IT UP

This week we have our Community Round Table on Tuesday where we will once again feature content from you the Azure Data Community!  We will be live at 1 pm EST, but you can always catch us after the broadcast on our YouTube Channel.

Wednesday we will have a video discussing the internals of Heaps, Clustererd Indexes, & Non-Clustered Indexes!

Time to say goodbye until next week.  Hope you have a great week and as always Dear Reader, Thank you for stopping by.


Thanks,


Brad



Monday, February 6, 2023

Tales From The Field Weekly Wrap Up for the Week of 01-31-2023

 Hello Dear Reader!  After a weekend with a lot of activities, it was a down week here at Casa Balls.  Woke up and walked a lot.  I'm still not back to running.  A groin pull is not something I've had a lot of experience with, yet it entered my life in December and I cannot wait for it to leave.

I miss running, last year I ran 755.1 kilometers.  Right now I can walk, as long as my pace is not too quick, and I can ride a bike.  The key is really to get out in the morning, take in some sunshine, and get the blood flowing.  

If I can do that I find that helps put me in the proper headspace to be productive during the day.  One of my favorite things as of late it take pictures.

In the morning I set out and take pictures as I walk around the neighborhood.  Even when I did "run", it was actually interval running.  The reason I note that is I tend to take pictures when I'm in the walking portion of my interval run.  With the exception of my phone, I do not carry a camera on me.  I still  manage to get some really great pictures of the day.  

So this weekend was a lot of walking, cooking, and hanging out.  I hope you had a great weekend, and made it out to enjoy some time outside or inside amongst family and friend. On to the re-cap!


Tuesday 1-31-2023

On Tuesday we had Andrew Nathan (Twitter | @AndrewNathan05) Principal Engineering Manager from the Azure FastTrack Core team was our special guest.  We discussed the Zero Trust Security imitative by Microsoft that all customers should consider when building their architecture.  We also discussed International Travel Tips ahead of SQLBits!  SQLBits is the largest Microsoft focused Data Community conference in Europe.  This year it is Hybrid which means Dear Reader, if you cannot make it in person you could still attend this fantastic conference.




We played our hosting show, I was the host this week!  Want to know who won?  Check out the video above to enjoy the show and find out!


Wednesday 2-1-2023

NEW THIS YEAR! We will be dropping weekly technical content every Wednesday, our MS Tech Bits.  This week it was my turn to produce a video.  I was working with a friend and they wanted to know how to troubleshoot deadlocks they were experiencing.  The first step in that process is understanding what is a deadlock and how to find them when they occur.  So I made this video How to Monitor Deadlocks in Azure SQL Managed Instance to help.


This is a fun little video where I walk you through the process.  Also there is a bit of an easter egg in this vide.  If the shirt I'm wearing on the video looks familiar that's because I wore this in another blog post, and it means a lot to me.

Thursday 2-2-2023

On Thursday we had our Community Round Table.  This is one of my favorite shows every week because we get to give a shout out to the great content producers in the community.  People writing blogs, producing videos, or even GitHub repositories that help people get things done.  It's just amazing.


Here's a list of the content featured on the Round Table in order of appearance:

Neeraj

International Travel Tips: 26 Things to Know Before Going Overseas by Clark Howard Twitter @ClarkHoward

Bradley

Network, Develop & Share @ SQLBits 2023 | Data Exposed Exclusive   By Rie Irish & Simon Sabin Twitter @IrishSQL & @simon_sabin & @SQLBits

Andres

How to integrate Azure Databricks with Azure Machine Learning for running Big Data Machine Learning jobs?   by Pieter Sterkens

Josh

Introducing 'Managed AirFlow' in Azure Data Factory  by Avishek Narain Twitter @narainabishek

Neeraj

12 Tips to Prepare for an International Trip by BenĂ©t J. Wilson Twitter @benetwilson

Bradley

Tempdb Performance Improvements in SQL Server 2022 are Dramatic by Monica Rathbun Twitter @SQLEspresso

Andres

Unleashing the power of AI with Azure OpenAI: A simple guide to get started.  by Meer Alam Twitter @alamMeer

Josh

Beginner's Guide to Azure Data Factory by Catherine Wilhelmsen Twitter @cathrinew

Neeraj

International Travel to and from the United States   | CDC by The CDC Twitter @CDCgov

Bradley

Ready to be a Kusto Detective with Azure Data Explorer? By Patrick Leblanc & Guy In A Cube Twitter @PatrickDBA & @GuyInACube

Andres

MLflow 2.0 and Azure Machine Learning by Facundo Santiago Twitter @santiagofacundo

Josh

When to have Multiple Data Lakes   by James Serra Twitter @jamesserra


WRAP IT UP

And now we draw the blog to a close.  We have a great line up this week!  Make sure to tune in Tuesday at 1 pm EST for a very special guest.  Wednesday we have our second MS Tech Bit coming up with my co-hosts Andres Padilla and Neeraj Jhaveri covering Tips and Tricks for Migrating Azure Data Lake Gen 1 to Gen 2.

On Thursday we will wrap up our week with our Community Round Table also at 1 pm EST.  I hope you all have a wonderful week, and as always Dear Reader.  Thank you for stopping by.


Thanks,


Brad