Monday, October 17, 2022

Tales From The Field Weekly Wrap Up for the Week of 10-10-2020

 Hello Dear Reader! We had a big week on Tales From The Field!  We've got some great stuff planned for you this week, but before we get to the Live shows tomorrow 10/18 & 10/20, I wanted to do a quick recap of last week.  

Ignite is always an exciting time, announcements are in the air, and we have truly arrived at what I like to call Fall Conference season.  This is a lot like pumpkin spice season, but technology flavored. ...it still has a lot to do with Starbucks as we are all in line to get coffee.


Ignite returned to an in-person gathering at the Washington State Convention Center for the first time since 2019 when it was in Orlando.  I always love when it is in-person.  Hopefully, we have more in person with a streaming component next year.  It is really impowering to allow the millions at home who cannot attend in person to attend remotely. 

All right enough talk, let's get to the shows!


TUESDAY 10/11 SHOW

Last week was Microsoft Ignite and we kicked off our show with TWO big guests.  We had Niko Negebauer Sr. PM from the Azure SQL Managed Instance Product Group, (Twitter | @NikoNeugebauer) join us on the show!    For years Niko was a Microsoft MVP, contributing to the community as a chapter leader, Presidente of the TUGA in Portugal, a PROLIFIC & amazing blogger.  Presenter at many international conferences, and user groups.


We also had Anna Hoffman, (Twitter| @AnalyticAnna) Sr. PM from the Azure SQL Data Platform join us!  Anna is a Data Scientist, The Host of Data Exposed, the co-host of Something Old Something New which is a series about the math behind data science & how it applies to Azure ML, presenter at International conferences, one of the most recognizable faces in the world of Azure Data. 

I was the host!  Neeraj won!!  We discussed our favorite Ignite experiences and Niko flipped the scripted and asked us questions.  Check it out at the link above.


THURSDAY SHOW


On the Thursday show we had the Community Round table and covered Community & Ignite content all in on location.  Here's a summary of what we covered on the show:

Josh

a.10 for 10: My 10 Favorite SQLPerformance Posts  by Aaron Bertrand Twitter @AaronBertrand

Bradley

a. On the Floor of Microsoft Ignite: Day 1 Announcement Thoughts by Joey D’Antoni Twitter @jdanton

Neeraj

a. Microsoft Ignite 2022: What to Expect from This Year’s Event by Joe Kuehne Twitter @BizTechMagazine

Andrés 

a. Azure IoT Edge Integration with Nvidia Deepstream by Emmanuel Bertrand Twitter @emmanuel_B_V

Josh

a. The Dangers of Dynamic SQL and How to Avoid Them by Rob Farley Twitter @rob_farley

Bradley

a. Microsoft Ignite 2022 – Azure Data Platform Update by Wolfgang Strasser Twitter @wstrasser

Neeraj

a. Ignite 2022- New Features and Updates for Ignite 2022 by  David Allen Twitter @onmsft @davidpaj1978

Andrés 

a. High Performance Real Time Object Detection on Nvidia Jetson Tx2 by Prof. Lee Stott Twitter  @lee_stott

Josh 

        a. Stop Using Production Data for Development by Thomas LaRock Twitter @SQLRockstar

Bradley

a. Azure SQL and Azure SQL Managed Instance - Backup retention polices Loading …  by Paloma Garcia Martin Twitter @PalomaGarcia40

Neeraj

a. Introducing-rankx-in-dax by Marco Russo Twitter @marcorus

Andrés 

a. Microsoft Ignite Big Book of News 

Josh

a. New PowerBI Implementation Guidance by Melissa Coates Twitter @SQLChick

Neeraj

a. Incremental Refresh and Hybrid tables in Power BI: Load Changes Only by Reza Rad Twitter @Rad_Reza

Bradley

a. Introducing assessment tooling for Oracle database migration to Azure SQL and PostgreSQL- Preview  by Neel Ball 


WRAP IT UP & SHOUT OUT 

We love our Sr. Escalation Engineers at Microsoft.  These folks are our hero's and our firefighters.  When you have a big issue, you call and put in a ticket.  These are the folks that come in when that ticket is escalated.  One of the blogs that we featured was by Paloma Garcia Martin and she was so kind to give us another Shout Out on their team blog last week!  

Speaking of, what a GREAT TEAM BLOG!!  It is the Azure Database Support Blog and you should go and check it out!


More guests and more great content to come this week, hope to see you there!  And as always, thank you for stopping by.


Thanks,


Brad

Friday, October 7, 2022

Tales From The Field Weekly Wrap Up

 Hello Dear Reader!

It's been a while.  I've been busy working with a few colleagues on our show Tales from the Field.  This has been a learning experience.  

I've had to brush off some old skills on graphic design, bone up on some new skills namely how to run a YouTube channel & Video Editing!


This week we had two amazing shows.  First up was our Tuesday show where the Hosting Duties are on the line!

Let me quickly back up, the Tuesday show is a bit of a game.  We have a Host.  The Host pick's the topic.  The Host then awards points or deducts points based on how we do.  

Sometimes we also have a guest.  Our guest this week was Bradley Schacht Principal Program Manager from the Azure Synapse Analytics Product Group.

"But Balls", you say.  "What's a Product Group?"

GREAT QUESTION Dear Reader!! At Microsoft teams that produce products are in our Engineering Organization, and they produce a product for example SQL Server, Azure Synapse, Azure Data Factory.  Each of those teams are called Product Groups.  So when I say, "Someone is a member of <insert product here> Product Group", that means they work on the team that builds or shapes the future of that product.

These are the people you want to know.  Bradley joined the Tuesday show and as the guest he also gets to award points.  Whoever has the most points, wins the hosting duties, and will be the host for the next show and they will pick the topic.

So on Tuesday Hosting Duties were on the line and I WON!!  Here's a link to the show below.



This is exciting because next week is Microsoft Ignite, don't forget to sign up it's free!!  So I get to host next week, pick the topic.  Plus we have TWO special guests.  Anna Hoffman, host of Data Exposed, & Niko Neugebauer from the Azure SQL Managed Instance Product Group!

On Thursday we had Hope Foley guest host for my buddy Josh Luedeman.  Josh was out with a bad case of Pizza is better than Ninja's..... best explained by this clip from the Tuesday show.




Back to Thursday.  We had Hope Foley & special guest Lonnye Bower for the Community Round Table!



Sooo much great community content from the round table.  Here's a list of that content!

Hope 

Bradley 

Neeraj 

Andres  

Hope 
a. PolyBase 2022 and Cosmos DB (Core API)  by Kevin Feasel @feaselkl 

Bradley 

Neeraj 
a. Metadata Management by Dr Victoria Holt @victoria_holt 

Andres 
a. External Apache Hive metastore, Azure Databricks, Azure SQL  by Benjamin Perkins @csharpguitar 

Hope  

Bradley 
a. Rounding out the lakehouse with the GOLD layer in Azure Synapse By GuyInACube, Patrick Leblanc, Stijn Wynatts @Guyinacube @patrickdba @sqlstijn 

Neeraj 

Andres 
a. Conference DevOpsDays Tampa Bay – 2022  by Chris Ayers Twitter @chris-l-ayers 

WRAP IT UP


That's it for me Dear Reader.  Good to speak to you again!  As always, thank you for stopping by.


Thanks,

Brad

Monday, December 7, 2020

Data Architecture Blog Post: CI CD in Azure Synapse Analytics Part 1

Hello Dear Reader! It's been a while. I've got a new blog post over on the Microsoft Data Architecture Blog on using Azure Synapse Analytics titled,  CI CD in Azure Synapse Analytics Part 1 .  I'm not sure how many numbers will be in this series. I have at least 2 planned. We will see after that. So head over and read up my friends!  
As always. Thank you for stopping by. 

 Thanks, 

 Brad.

Wednesday, January 16, 2019

Butter in My Coffee and Low Carb Tortillas: Keto Day 2


Hello Dear Reader, just a quick check in, I had originally planned to blog yesterday.  However, screen shots of apps made for a terrible looking blog.

Fortunately I found that Lose It! has an option where you can email a daily report in .csv format to yourself.  After a few edits to add some health data, I can use Power BI to make a nice way to track and chart my process.


So on Day 1 there was no work out, but I did clean the garage so I would have room to work in some weights and an exercise bike.

While the majority of my goals are running I'm only running 3 days a week and giving myself two days of rest between weeks.  I want to start with light activity, but I would like to remain active or exercise daily.

KETO/BULLET PROOF COFFEE 

My first day, not charted below, I was way to high on protein and not high enough on fat.  One of the things that helped me with that is a Keto coffee, sometimes refereed to as Bullet Proof coffee.  Bullet Proof is a brand that popularized this type of coffee.  If you want to go with them, feel free.  They are fantastic.  However, if you are on a budget or looking to save some money here's what I normally do.


  • Use a good drip coffee brand like Starbucks - brew 12 fl oz
  • 1 Tablespoon butter.  Non-salted.  Real cream butter, don't cheap out here go for the good stuff.  I recommend Kerry Gold.  You can find this for about $3 at any grocery store.
  • MCT Oil.  If this is your first time use 1 teaspoon.  This ingredient is important.  I use a gluten free version, here's the bottle I buy.  I use about 1 tablespoon now, work up to it.  This bottle will last me well over a month.
  • I add two packets of Splenda 



You feel the energy kick right away.  I find this helps increase my focus as well as my energy.  It's about 225 calories.  As I get going this will be all I have for breakfast eventually.  Some people put heavy cream in their coffee to add more fat.  I don't tend to do this, as I use those calories other places during my day.

LOW CARB TORTILLAS

I was planning the evening meal for the family when I was genuinely surprised to find low carb tortillas at my local Publix.

It was Taco Tuesday last night.  This would have meant Dad eat's a bowl of meet, cheese, onion, avocado, and cilantro; while the family eats regular tacos.  Part of keto that I've never enjoyed is the having to watch people eat something while you go without.  This opens up a whole new world of possibilities.

Enchiladas, tacos, quesadillas, toasting them to make chips with olive oil, sandwich wraps, or breakfast burritos the mind boggles at the possibility.  Part of what makes them low carb is the fiber. 

That's right FIBER IS OUR FRIEND.  You subtract carbohydrates from fiber to get net carbs.  Net Carbs are the number you are counting for keto.

*Update*

Peter Schott had asked me which tortillas I was using.  I've added a picture above.  Here are the details.

LaTortilla Factory Low Carb Whole Weat Tortillas.  LaTortilla offers a whole wheat and flour low carb tortilla.  I prefer the whole wheat because they are 3 g of net carbs vs. the flour which are 4g of net carb. 

The flavor is good, they toast well in a pan.  This morning I had a scrambled egg, cheese, and avocado spread (my own recipe) for breakfast.  At this point i wish i had taken a picture, I'll have to remember to do that next time.

If you do not have a Publix where these are stocked, it looks like you can also buy them on Walmart.com and Amazon.com.  Normally at Publix and 8 pack is less than $4.  Third party companies look to be selling these and charging upwards of $10 per.  There may be better options if you cannot find them at your local store. 

I say all this because I would normally post links for purchase.  Looking at a price of $10.95 to $14.95 when I'm paying less than $4 seems like highway robbery, so I shall let you search for yourself. 

Thanks for the question Peter!




DAY 2 BY THE NUMBERS

I've stayed below my calorie count regardless of exercise or move bonus for the last two days.  Even though I'm exercising I'd rather not over eat. Day 2 brought the first work outs, stretching followed by a 2.05 mile run.

Lots of work to do on my pace, but to quote the old Chinese proverb "the journey of a thousand miles begins with a single step".  The journey has begun.

UNTIL NEXT TIME
Alright Dear Reader, that's it for my morning.  If you are trying to find your way to the gym, good luck and stay safe!

As always Thank You for stopping by.

Thanks,

Brad



Monday, January 14, 2019

My New Year Challenge: The Kessel Run and Keto

The Kessel Run Medal for 2019
Hello Dear Reader, it's been a while since we talked.  Part of the new year is setting goals.  I plan to blog more.  I also plan on trying to get in better shape and lose some weight.  Weight loss has been a constant issue with me since my thirties, now in my forties, and I imagine it will chase me for the remainder of my life.  This year I'm going to try using the Keto diet and some training.

I've signed up for a few moderate to long distance running races, and I need to get moving.  I've run in the past, but then I hit a lull and the weight catches up with me.

The big goal is the Kessel Run & the Star Wars Challenge that will come with the completion of a virtual half marathon, a 10 K, and a half marathon at beautiful Walt Disney World.  There's still time to join if you are interested!

These are some lofty goals as I have not run since September, I have not been dieting, and I came to the realization squeezing my beer no longer counts as bicep curls.  There will be cheat days.  There will be days that I fall off the wagon.  To hold myself more accountable, I'm going to attempt to blog about this every day until April 8th, 2019, the day after the race.  If my buddy, Gareth Swanepoel (@GarethSwan), and I get our act together it may be until Monday April 15th.

THE APPS

So I'm out of shape, overweight, and I've got a lot to accomplish.  To do this I'll be using a few apps to track my process and progress.  I've been using Lose It! for almost 2 years now.  Meals, recipes, calorie tracking, and weight loss & gain will be tracked using Lose It!

For my initial run training I'll be using C25K, I've found this app really helps me when I first start going.  Once I can hit two and a half to three miles on my own I'm going to start using Seconds ProSeconds Pro is a great interval timer that allows you to do Tabata like works outs.  I used this once before and it really helped me step up my pace once I was in better shape.

The method was suggested by a friend of mine.  The method is for the first minute jog 30 seconds, job faster 15 seconds, and sprint for 15 seconds.  Then for the following minute walk.  I look forward to working up to using this again, it helped me move from 3 miles in a run up to 6 miles.  I would like to be at that point before the race in April.

The built in Apple Health Activity App on my Apple watch will track the calories I burn per day and while I exercise.  Those calories will feed straight into Lose It!.

ASTHMA

I had originally written this post and neglected to add that I'm an asthmatic.  I have allergy and athletic induced asthma.  I've had this since I was a young teen.  As I've grown older this has made me particularly susceptible for bronchial and lung infections.

Fifteen minutes before I run I will use my rescue inhaler.  I wish I didn't need this, but I do.  I wish this went away when I get in really good shape.  It does get better, but it is still there.  This is just me trying to say, if you have asthma don't let that stop you.  I have had my inhaler with me when I played football, wrestled, played soccer, or played any other sport for my entire life.

The biggest issue I will face will be not pushing myself so hard that I pull a muscle, at this point I can handle my asthma.

THE KETO DIET

I blame my good friend Jorge Segarra (@SQLChicken) for this.  The Keto Diet entered my life almost 2 years ago this coming September. Click on the link above for more detail on the Keto Diet, my quick 10,000 feet overview is it is a low carb diet where you flip the food pyramid on it's head and fat is the most important nutrient for our body.

One of the really amazing side effects of Keto is that the hunger feeling you have known your entire life goes away.  Seriously.  You feel like you have a lot more energy.  While you can find many different opinions on this, the evidence I have is based on my own experience.

I went Keto before a half marathon last year and I did not need anything but water, and lots of icy hot, until the race was over.  My pace was 3 hours and 34 minutes.  I didn't carbo load anything, I didn't use power gels, or snacks along the way. As a matter of fact I did the opposite, you have to be at the race by 5 AM.  My 4 AM breakfast was two eggs over easy, two sausage patties, three slices of bacon, cheese, all topped with homemade ranch dressing.  After 3 hours and 34 minutes of exertion almost 6 hours after my breakfast I was finally hungry again.  During the race I focused on staying hydrated, re-applying sun block, and the occasional use of my inhaler. 

If I can do that again I'll be happy.


THE DATES & THE RACES

I've signed up for a couple along the way, so here are the dates:



THANK YOU & WHAT CAN YOU EXPECT

Along the way I'm going to attempt to do a daily update with a screen shot of my meals and weight tracking in the Lose It! app, updates on the activities I'm doing screen shots of pace and calories burned, recipes, or products if I find some good stuff along the way.

83 days to go until race day.

Whether you are hear for a moment, or along for the ride Thank you as always for being here Dear Reader.  I hope you have some goals for the new year as well, and I'd love to hear from you if you have one.

As always Thanks for stopping by!

Thanks,

Brad




Friday, February 16, 2018

Black Panther is Going to Change Superhero Movies

Hello Dear Reader!  Sorry it has been so long, I've been blogging over on the MSDN site about technology.  I'll have a Twitter Sentiment update for Black Panther later today with an update on Tuesday for the holiday weekend.

Since the early 2000's a trend of Superhero movies began, comic book geeks cheered but many in the industry couldn't wait for it to be over.  They viewed it as a trend.  You need only search on Bing or Google using the term "super hero movie saturation" to find headline after headline of Actors, Directors, or Industry Trades predicting their demise like that of a Hollywood villain standing over his captive foe.

Every year we see more and super-hero themed movies entering the market.  Naturally, after living through so many economic bubbles may predict that this is a bubble that will pass.  This regulates comic books from an artistic medium to the simplistic story of good vs. evil.  Even comic book websites have gotten in on the fun.  The Comic Book Reporter had a headline last month that said Hollywood Is Nearing Its Superhero Saturation Point.  In it author Narayan Liu expresses the final point, "cinema will change as it has always changed.  In the 60's and 70's the fad was spaghetti westerns, then space dramas...For now, superhero films reign supreme, but eventually that will come to and end sooner or later."


HERE'S WHY THEY ARE WRONG

Stories about people with powers and abilities far beyond those of mortal man are tales as old as time itself.  The representations used to be God's, then myths, now they are heroes.  Stories of Superhero's for the sake of Superhero's fail.  The best movies are those that seek to tell a story, and whose characters are empowered in a way we have not seen before.  Batman The Dark Knight was a success that has lead to the only Oscar Win in a major category, Heath Ledger for the Joker.  However, taking the "dark" theme and using it over and over again lead to decline of Warner Bro's DC Superhero franchise.  Justice League never came close to making back its lofty $300 million dollar budget in Domestic box office receipts.

To cast off mythical stories of empowerment as purely "Superhero" is the equivalent of asking "How do I cook", and at seeing the silverware saying "I've seen enough".  The formula that works for superhero movies is the same that works for all other genres, good stories equal good movies.

There are so many more stories being told in this medium than what we have seen thus far and now we stand at the edge of a new revolution.


HOW BLACK PANTHER CHANGES EVERYTHING

Marvel CEO Issac "Ike" Perlmutter made headlines when an internal email leaked on "why he doesn't believe in female superheroes".  Wonder Woman changed the typical sentiment of a strong female protagonist leading a movie not being able to reach a massive audience.  It was profitable, very profitable.

One thing Hollywood does well is capitalize on a trend.  Wonder Woman is going to have a highly anticipated sequel.  Captain Marvel, staring Brie Larson, is currently filming and news that Marvel is finally going to make a, long over due, Black Widow movie, staring Scarlett Johansson, has moved to development stages.

Part of Marvel's move also comes after Perlmutter's comment and the move on Disney's part to have Kevin Feige report directly to Disney Studios chief Alan Horn.

So what does this have to do with Black Panther?  Everything.  Minority superheros are a long missing block from comic books as a whole and almost all together from this landscape.

Robert Kirkman's AMC Series Secret History of Comics covered in-depth the rise and fall of Milestone Comics.  Milestone was an African-American-owned comic book imprint from the 1990's that brought characters Hardware, Icon, Static, Blood Syndicate, and many more were characters synonymous with the comic book revolution of the 90's.

This isn't even bringing forward the story of Marvel's own Blue Marvel, Dr. Adam Brashear.  His story tells the tale, written in the Adam: Legend of the Blue Marvel in 2009, telling the tale of America's greatest superhero asked to retire when his costume is torn during a fight that leads to the discovery that he is a black man in 1960's America.

Comic books stories are the modern tales of empowering people.  There are many minority characters in DC, Marvel, Image, and Top Cow that have not yet been told.  The success of Black Panther, I'm predicting a $185 million opening  with a final gross of over one billion dollars world wide, will inspire more stories.

The stories we have not yet heard are the voices of those who deserve to be empowered and have not.

WAKANDA FOREVER

No spoilers here, but a few words on the movie itself.  The cast is incredible, and their talent is on full display.  I saw the movie in IMAX 3D, and it is breath taking.  The background visuals, the architecture, the landscape are all breathtaking.

The villain has real depth, and though there is no doubt who our hero is he is conflicted as well.  The conflict is so understandable, so sympathetic that it touches on philosophical context and modern social parallels.  By sparing the current generation pain, can that then create a monster that future generations will have to endure?  What should the role of a national super power be in the world?

We touch on the subjects of immigration, accepting refugees, hiding behind walls, or building bridges.  In all the modernism one though was not lost on me.  The way that generations have idealized Camelot, is Wakanda the new Camelot?  A technological marvel, a nation at peace within its boarders, and a place where those who have never felt truly represented rule with mercy and grace.

Look on social media and you may see #BlackPantherSoLit trending.  Look at the empowerment of those attending.  If you only look at superhero movies and see the costumes and not the story this is your chance to look around you.  Look outside of the theater, see what this means to people, and watch over the next few years to how this inspires the world.


WRAP IT UP

What are you doing still reading this?  Go see Black Panther already!!

As always, Thank you for stopping by.

Thanks,

Brad


Friday, August 4, 2017

A Day of Data Science with SQL Server, Azure ML, Spark, Hadoop, and R

Hello Dear Reader!  Next week in Jacksonville, Friday August 11th,  I will be presenting a Day of Data Science: With SQL Server 2016/2017, Azure ML, Spark, Hadoop, & R.  We will also be working in some Power BI, and may even be building something like what you see on the page.  Here's the abstract.


The world of data is changing.  It used to be enough to collect data and report off of it.  ‘Business’ people would make ‘business’ decisions based off of reports, historical experience, and their gut. ‘Business’ people may go into meetings and say things like, “We will change our business and stop doing A.  We used to do A, and we got profit!  Now we do A, and profit is down.  Therefore we stop doing A, and now we will do B!”  They may have data to back up their decision, they may not have data.  Sometimes they got it wrong, sometime they got it right.  One day someone figured out that they could use math and science to calculate the odds of making a good decision.  In Las Vegas they call it gambling, in the business world we call it Data Science.  Data Science is not some mysterious solution that fixes everything.  It is the process of using a series of calculations to make many micro-informed-decision.  This leads to informed decision making.  Those calculations are what we would call models, and they store the algorithm that we will use to calculate our odds.  There are many different ways to create, store, and utilize models.  In this pre-con we will discuss some of the architectures and ways this can be accomplished.  We will then focus on the newest advanced analytics capabilities in SQL Server and in R to discuss on premise architectures.  Including the advantages to storing data and models in SQL Server as well as how to use Predictive and Prescriptive analytics.  We will then end the day shifting our focus to the cloud with an end to end Lab focusing on Azure ML, Spark, Hadoop, Power BI, and Modern Applications.
*Note to participate in the Lab you will need access to Microsoft Azure and an Azure account.

What does the agenda look like?

8:30 AM – Speaker & Course Introductions
8:45 AM – Data Science concepts
9:45 AM – Begin Introduction to R – Using Baseball Analytics
10:00 AM – Break
10:10 AM – Continue Introduction To R
11:00 AM – R and SQL Server 2016/2017
12:00 PM – Lunch
1:00 PM – Azure ML Overview
2:00 PM – Begin Hands on Lab Walk Through
4:30 PM – End of Class

Will I live blog it like last year?  Only time will tell Dear Reader, only time will tell.

As always Thanks for stopping by, and I hope to see you there!!

Thanks,

Brad

Monday, July 10, 2017

Spider-Man Homecoming Twitter Sentiment

Hello Dear Reader!  This past Thursday night I took my son Zachary to see Spider-Man Homecoming, it was an amazing movie with a fantastic cast.  Both of us are BIG comic book guys, and we enjoyed it immensely.  As a matter of fact we both enjoyed it so much that I couldn’t help but wonder how the rest of the world felt!  You’ve probably seen different ways to view Twitter sentiment analysis, but I wanted to do this today using Azure Logic Apps to create a real-time Power BI Dashboard, with a live data source using Azure SQL Database.  We’ll how we did this in detail in a later blog post, but first let’s look at the data!

Want to read a little more?  Head over to our, Josh Luedeman (@Twitter) and myself, blog over at MSDN!  Click here for the Deeper Insights Blog.

Wednesday, March 1, 2017

Microsoft: 1 Year in, how's it going?


Hello Dear Reader, one year ago today it was leap year, February 29th 2016. So I'm a year older, the big four zero.... 40.  A little wiser?  Maybe.

Despite my New Year's resolution to get fatter and work out less, I've lost 21 pounds and I'm working out 3-5 times a week.  CURSE YOU NEW YEARS RESOLUTIONS!!!  YOU NEVER COME TRUE!!!!

Also I left my old job as a Data Platform Lead, ie 'Executive Manager', and went back into the field as a Premier Services for Developer Consultant.  Oh and I did this by going to work for Microsoft.

That's right Microsoft.

"So Balls", you say "Is this Micro-soft that makes the ultra-micro-soft pillow cases? or is this the REAL Microsoft?"

Good question Dear Reader!  Yes this is the real deal.  I really work for Microsoft, also I feel the need to smile whenever I say that.

WAS THIS THE RIGHT DECISION?
I don't want to make this seem like being an executive or a manager were a bad experience.  They were not.  I love the people who were on my team at Pragmatic Works.  Some have left, some have stayed, and others joined Microsoft.  I love the people I worked with, and I still do.

I would relish the chance to Manage again, but it would have to be the right scenario.  I was asked to manage teams many times in my career before PW.  I refused.  It wasn't that I didn't want to.  I knew that if I had to lead the team I was a part of, I would have to fire the slackers who were my friends get rid of some people that I knew and hire new people.  PW was the first place where I was working with a dedicated and talented group that was amazing from top to bottom.

Adam Jorgensen (@WAdamJ), who has probably changed his twitter handle.....again...... the second I linked to it in a blog post, was a FANTASTIC boss, mentor, and friend.  There are a few habits I picked up from Adam that continue to help me.

My first year I felt like I was spinning my wheels.  I was more efficient, but I was still doing some of the same things and didn't know a better way to do it.  Adam asked me how many books I read on SQL when that was my field.  I stopped to count and he said, "A lot right?  The number doesn't matter.  It's the concept.  You read a lot, studied more, and experimented to become an expert right?".  He was right*.    He then asked me, "How many books have you read on management?"  I was floored.  But I also didn't know what to read.

Adam created a spreadsheet that had a lot of book recommendations.  He gave it to me in a spreadsheet and prioritized what he felt the most important books where.  Some I loved, some I make everyone read, and others... were terrible.

I learned, I grew.  I liked it.  I also realized what kind of management books I enjoyed and that lead me to more books, more ideas, more new concepts.

Moving from a Consultant to a Manager was like moving from a wide receiver or running back to a Football Coach.  You don't play on the field.  You put people in place to play positions, you can even put a talented lead consultant in the field, your quarterback, by you don't do the work.  That's not your job.

You do the opposition research now.  What does the field look like?  What is the goal?  How do we develop the right tools so our team can win?

Going back to being a position player was a little scary.  I never gave up being technical, but I didn't know if I would enjoy it like I used to.
 
*By the way Adam likes it when you agree with him try to do that.  But don't tell him that's why you are doing that, for some reason he doesn't like that.

SO HOW DO YOU LIKE IT?

I love it.  I love this job.  I sometimes pinch myself.  I've called my friend Jorge Segarra (@SQLChicken) sometimes just to thank him.  My thank you generally starts something like this, "Dear Sir, Thank You for you kindness, generous patience, and pure grit for the number of times you called me, asked me to join you, and for all the times I said NO.  Thank you for not giving up on me."

I could go on and on, but let's start to break down what is so great.  I didn't number these, because it's hard.  I tried.  I picked my top five.  There were more.  I ordered, re-ordered, and then said the heck with it.  So here they are.  The Corporate Culture, Freedom, My Managers, Health Benefits & Corporate Giving, and The Ability to Grow as a Professional.

The Corporate Culture.  The company is driven by a Growth Mindset, you've seen these changes.  The quality of products are better.  The collaboration is better.  It's no longer Microsoft vs. the world.  Gone are the days when your Microsoft app works great as long as you use additional Microsoft products X, Y, and Z and woe-be-on-to-you if you used anything non-Microsoft.

This all comes from a growth mindset of our Senior Leadership Team that views different competitive advantages as challenges to get better.  The recognition that a Microsoft product is not always the best answer, and the zeal to learn from competitors and our mistakes to constantly grow.  We aren't just sitting still here.  There is constant progress to be made, it starts with reinventing ourselves with a clear mission dedicated to help others achieve more.    

Freedom.  Freedom is a great and scary thing.  It means that I get to be responsible for me and my time, but it also means I am responsible.  My manager doesn't care if I'm at my desk.  If I'm on the road two weeks in a row I may have an errand to run in the middle of the day.  He's not constantly checking up on me.  He encourages me to be active on social media, trusts that I will perform for my client and job, and allows me to manage that myself.  The expectation is that I'm a responsible professional, and I get treated that way.  It's simple, but pretty darn revolutionary given what I've experienced throughout most of my professional career.  I pick my engagements, I pick my schedule, and I pick where and when I travel.

The Health Care Benefits & Corporate Giving.  I not going to go into the benefits.  Its not that I couldn't talk about some of them, but I don't want to accidentally cross any lines.  I typically discount benefits in negotiations.  Company X will say, take this job because we offer this, and this accounts to us paying this much money.  I've been at plenty of companies with "GREAT HEALTHCARE OPTIONS".  None of them come close to crazy good benefits.  Companies use them as negotiating tools.  I discount them because at the end of the day none of them were much better than the others.  That is until this one.  If you've ever worked at Microsoft you know they are crazy good.  I don't know if the people who have worked at Microsoft their whole careers realize how good they have it.  Personally, I'm extremely satisfied.

The Corporate culture of giving is also amazing.  A couple of times a year the whole company spends lots of free time volunteering, creating, and offering up things for others to purchase just to give the profits to charity.  We have multiple giving campaigns and Microsoft matches what you give up to over $10,000 per employee.  There are whole charities that have great causes from building sustainable housing for those in need, to raising money for cures to diseases and prevention, to disaster relief.  Some of them almost entirely funded internally by Microsoft employees.  This is selflessness at its very best.  There are so many people here doing good you cannot help but be inspired by example or by proxy.  I feel very strongly about this, because Microsoft does not beat their chest and say "Look how great we are!", if you didn't see this from the inside you may not even know it occurs.  This culture has been around since they existed.  This is built into the place.  Watching people do amazing things, and knowing my 'work' helps bring in revenue that in turn is donated to these great causes in some way, shape, or form is inspiring.

The Managers.  I have two managers.  One that I directly report to, but they both have decided to co-own our group.  Remember all the good things I said about my friend Adam.  Take that, wrap it in Microsoft culture, and put almost two decades of experience behind it.  They manage a team of All Stars from App Platform to Data all with a developer focus.  I've worked with some of these folks before, and even managed some of them.

To see them thrive in this environment helps me see places where at PW I could have done better, or how things could have been done for the better.  It is a very interesting learning experience.  I managed Bradley Schacht (@BradleySchacht), Jorge Segarra, Josh Luedeman (@JoshLuedeman), Gareth Swanepoel (@GarethSwan), and others are at Microsoft now.  All thriving.  It is a very cool thing to watch, to see new managers get the chance to work with them.

The really great thing is my Managers realizes this.  We talk often as Managers and I'm asked for feedback and perspective.  When I have it I give it, when they deserve praise I give that as well.  The best feeling is the mutual respect that is given.  Never once have I heard the phrase, "Well things are different here you aren't at <insert former job> you are at Microsoft and we do things this way".  That comes from the corporate culture, and is embodied by how we communicate.  There is always respect and a desire to learn what we can from different experiences.  My managers are really incredible, and it inspires me even for when my next opportunity to lead presents itself.  Dan and Niel, Thank you both!

The Ability to Grow as a Professional.   One of my first conversations with Niel during my on-boarding was about how to find my next job at Microsoft.  I thought, "Well that interview must have not gone as well as I thought this guy already wants to get rid of me!"  The conversation revolved around finding a manager that inspires you.  Finding someone that you want to work with, and making sure that the fit is right.  The best part about the conversation was realizing here I am on my first day, and my manager believes in me so much that he's already trying to help me figure out what will be my next step at Microsoft.  Internally I've watched people I admire transition from CSS to the Tiger Team or to the SQL Server Product Group or from the Product Group to AzureCAT.  The fact is as long as you want to grow as a professional, you have a place to go within Microsoft.  I didn't even mention the massive investments they make to help each of us grow technically, but I'm starting to run a bit long and if you've hung in there I appreciate your time.


WRAP IT UP

Dear Reader, I'm home.  I hope to be here for as long as I can.

As always, Thank You for stopping by.

Thanks,

Brad






Tuesday, February 28, 2017

How Do I Add an R Package to SQL Server from In-Database R?

Hello Dear Reader!  I'm working on some really fun stuff with in-database R using SQL Server 2016.
I needed to add a couple packages to my R engine so I could use them and call them from an R script. I realized I had not added any external packages to my R instance so this was a perfect opportunity to write a blog!  So here is a quick blog on how you add an R Package to SQL Server.  This entire tutorial is if you have internet.  If you need to do this for a server, which probably doesn't have access to internet look at this MSDN article, Install Additional R Packages on SQL Server.


First we need to find our instance default install path for SQL Server.  In this case I'm a comic book geek and my named instances are JARVIS and STARK.  STARK is my 2016 instance so we'll need to find that path.

In this case my path is C:\Program Files\Microsoft SQL Server\MSSQL13.STARK\R_SERVICES\bin\x64 , then I want to hold down SHIFT and right click on the Rgui.exe, then select Run as administrator.



After this opens we need to create a variable to hold the location were we would like the package to be installed.  Then we can install the package we want to use, in this case the plyr package.


lib.SQL <- "C:\\Program Files\\Microsoft SQL Server\\MSSQL13.STARK\\R_SERVICES\\library"
install.packages("plyr", lib=lib.SQL) 

Notice I adjusted the path for my named instance.

After it installs our window should look like this.

Now I can run a simple test script loading the plyr package.

execute sp_execute_external_script
@language=N'R'
,@script =N'
       library(plyr);
       OutputDataSet<-InputDataSet'
,@input_data_1=N'select 1'

WITH RESULT SETS undefined;

If I get this error the package did not load.

Msg 39004, Level 16, State 20, Line 4
A 'R' script error occurred during execution of 'sp_execute_external_script' with HRESULT 0x80004004.
Msg 39019, Level 16, State 1, Line 4
An external script error occurred: 
Error in library(plyr) : there is no package called 'plyr'
Calls: source -> withVisible -> eval -> eval -> library

Error in ScaleR.  Check the output for more information.
Error in eval(expr, envir, enclos) : 
  Error in ScaleR.  Check the output for more information.
Calls: source -> withVisible -> eval -> eval -> .Call
Execution halted
Msg 11536, Level 16, State 1, Line 4
EXECUTE statement failed because its WITH RESULT SETS clause specified 1 result set(s), but the statement only sent 0 result set(s) at run time.

If I the statement compiles, everything is fine and I get a result set.



As always Thanks for stopping by.

Thanks,

Brad







Friday, February 3, 2017

The High Availability Conversation Part 1: Introduction

Hello Dear Reader!  Twitter is a fantastic tool if you use SQL Server.  It is a great way to network, find presentations, interact with experts, and #SQLHelp offers some of the best technical forum conversation on the subject.  I was on Twitter and my friend Kenneth Fisher asked a question.




Kenneth’s question was interesting.  Let’s define a couple terms up front.  HA in this case is High Availability.  It is the capability for a database or data store to maintain availability and connectivity to a Graphical User Interface, Web Service, or some other data consuming application despite a localized outage or failure of the primary system.  

High Availability is different from Disaster Recovery, or DR.  Disaster Recovery is required when a disaster, natural or man-made, prevents the use of resources within a data center and the hardware within to support regular business processes.  In this blog, we will be addressing HA only as that was what Kenneth had asked about.

Asked for further explanation Kenneth didn’t need HA at his environment, more on this in a moment, he was looking for a rounded point of view.  I had a couple replies and then started direct messaging, DM`ing, Kenneth to share my insight.  This is a conversation you must have with the business.

  A keen understanding of how business logic translates into technology workflows requires both IT and business leaders making the right decisions together.  Over this series I’m going to give you a couple examples on when HA was needed.  Some in which HA was not. Later we will discuss different HA technologies and understanding when each one is right for you.  First I will define some key things to cover in a High Availability Conversation between the business and IT. 


THE HIGH AVAILABILITY CONVERSATION


There are three types of conversations: technical, business, and budget.   Business comes first.  Our first goal is to understand what the business is facing.  Some of this you may know in advance.  If so review the information to ensure business and IT communication.
·       Describe the business process –
o   What product or service are we providing?
o   What type of employees participate in the process?
o   What does each employee need to get from the process?
·       Diagram a workflow of how a customer interaction occurs
·       Add the steps that are IT specific
·       Critical days, weeks, months, holidays, or times of the day for the specific business process
·       Understand any current paint points

First make sure you understand the business process surrounding any technical system.  Draw shapes on dry erase boards, connect them to business process, make sure you understand who the business owner is for each technical system. Force self-examination and business awareness.  Add your IT system to the diagram.  Highlight business and IT dependencies.  Talk to teams to understand what happens when a system goes down. 

You can use Viso, PowerPoint, a dry erase board, or whatever you like. Make a visual representation based on the findings from the meeting.  Confirm that everyone can agree on it, or use it to solicit their teams for additional vetting.  You may not get it right on the first run.  That is okay.  This could be an interview process depending on the complexity of your IT environment. There are some standard technical terms that you should use

·       SLA – Service Level Agreement.  This is the expected agreement between the business and IT for overall system availability.  This may represent business hours.  In some cases, Service Providers may have contractual SLA’s.  If your business has an SLA with customers there could be a financial penalty for not meeting the SLA. 
·       RPO – Recovery Point Objective.  This defines the amount of data that can be lost on a system in and not cause impact or harm to the business.  The point at which all data or transactions must be recoverable.  The price of any solution increases with lower RPO’s.
·       RTO – Recovery Time Objective.  This is the amount of time it takes to get a system online in the event of an outage.  The time to recover will vary greatly on size, volume, and type of data discussed.  If you seek to reduce recovery time there are strategies or technical solutions that can be utilized.  The complexity of these solutions can add to the overall cost. 

REFINING HA: USING THE THREE BEARS TECHNIQUE

After the first business meeting the technical team should meet to discuss their options.  I like to
develop three options when working with IT Managers.  This is where we, the technical staff, align a few things.

·       Proposed Technical Solution
·       Cost of Technical Solution
·       Cost to Maintain Technical Solution
·       Migration from the existing platform to the New

There are many ways to address HA.  Some could be solutions using Third party vendor products that you may already utilize, others can be hardware or virtualization options, and other can be database specific.  IT the architecture, size of the corporation, and business need for HA will shape these decisions.

Notice I said three options for IT Managers.  When you meet with the business you should have a cohesive vision.  When I started my IT career finding a manager with IT experience was extremely rare.  It is increasingly becoming more common.  As IT knowledge permeates the business world it will be more common to give the three options to the business for collaboration.  If you are lucky you are in an environment like that today.

For this step you need to take all business requirements and align them to technical justification for a solution.  Producing three options may seem difficult.  Think of this like the old children’s story Goldilocks and the Three Bears.  One of these technical solutions will be too cold, too much latency and not viable for 100% of business scenarios.  One of these solutions will be too hot, this is the spare-no-expense-throw-everything-you’ve-got-at-it-as-close-to-five-9’s-as-possible option.  One will be just right.  It will fit the business needs, not be cost prohibitive, and be maintainable solution.

You’re natural first reaction will be, “Why Three options!  Why not just propose the right one?”.

Valid point Dear Reader.  The reason is simple.  This is a high stakes mental exercise.  The business, jobs, profitability, security of our data, and many other things may rest on our solutions.  What makes a good IT person great?  Their mind.  Our ability to make virtual skyscrapers and complex virtual super highways out of thin air.  There may be a natural reaction to jump at a ‘best’ quick solution.  Take your time, think outside of the box.  You will find if you push yourself to consider multiple options, one may supplant the ‘best’ quick solution.  While too cold and too hot may not work in this situation, they may next time.

We’re done, right?  Wrong. 

If we are changing an existing system, how are we going to get there?  We need to understand if there are production outages windows we must avoid.  For example in Retail or Manufacturing there are normally Brown out and Blackout windows for IT.  Leading up to Black Friday, a United States shopping holiday, most Retail environments have IT Blackouts.  This means no changes can be made in production unless they are to fix an existing bug.  Everything must wait.  Leading up to a Blackout window there is a Brown out window.  During a Brown out no changes can be made to existing server infrastructures, this can limit the ability to allocate more storage from SAN’s, networking equipment, or networking changes in general.

If we are performing an upgrade to use a new HA technology, when will that happen?  How do we migrate?  What are the steps?  Have we coordinated with the application development teams?  They will need to regression test their applications when a migration occurs.  This means changes in the development, QA/UAT, and eventually the production environments.  Additional coordination will require the server and SAN teams.  Depending on the size of your IT organization this may be a large effort or the act of shouting over your cubical wall. 

 THE HA CONVERSATION II: THE SOLUTION & THE RESPONSE

We’ve spoken with the business.  We understand their process.  We drew it up, passed it around, and found a few new things along the way.  We met as an IT team.  We produced tentative solutions.  Took the ideas to Management and now we have a winner.  We’ve coordinated with our counterparts to make sure we knew what a tentative timeline would look like.  Our next step?  Present the solution to the business.
 
After this meeting the goal is to move forward.  To get the project going.  We’ve spent a lot of work
on this, and you want to see it implemented.  Sometimes that happens.  Sometimes it doesn’t.  There are a lot of factors that can go into why something doesn’t happen.  Because they can be legion, and it distracts from our overall topic, I’m going to skip why things do not happen.  It is an intriguing topic that I may blog on later.

When we move forward the goal it to do so in a collaborative way.  A good solution addresses business needs, technical requirements, project timelines, and budget.  There may be changes, there may be wrinkles that occur along the way.  What looked good on paper doesn’t always translate to technical viability.  It is important to maintain the communication amongst key stake holders along the way.

Alright Dear Reader, this has been a good kick off towards our topic.  If you have questions or comments please sound off below!  I look forward to hearing from you.  Next we will review a couple real-life examples of when HA was needed and when it wasn’t.  As always, Thank You for stopping by.

Thanks,


Brad