Seattle is the Cloud Hub - Amazon, Microsoft, Google, Others, and now Apple

Apple’s recent arrival to Seattle as the media and others talking about Seattle as a Cloud Capital.

The Seattle region has emerged as a major cloud computing hub thanks to Amazon Web Services, Microsoft Azure and a wide range of startups focused on cloud infrastructure and services. Much of Google’s cloud infrastructure work happens out of its Seattle-area offices.

In the short run, the new Apple office could intensify the competition for top engineers, but long-term it promises to add to the region’s status as a cloud center.

Influx of tech giants

Apple is the latest in a long list of tech giants from Silicon Valley and elsewhere who have established engineering outposts in the Seattle region. That list includes Google, Facebook, Oracle, HP, and many others, most recently Alibaba.

Talking to a friend who has the challenge to hire Cloud infrastructure engineers who isn’t in the above list he made the following observation.  The typical pattern is engineers start at Microsoft, then move to Amazon, then Google.  His challenge is to catch the engineers while they are making the transition and hire them to his company.  

Take a 22 year old software engineer.  Have them spend 3 years at Microsoft, 3 years at Amazon, and if they were able to make it to 3 years at Google.  They’ll be 31 years old with 9 years experience building Clouds at Microsoft, Amazon, and Google.  That is killer resume, and he/she can go anywhere in the world now.

Name another area you could do that and not move.

Oh and there are handful of people who will be able to put Apple on their resume.  Now that would kill.  Microsoft, Amazon, Google, Apple.

Microsoft puts ex-Amazon VP in charge of Cloud Infrastructure and Operations, including data centers

Last week Microsoft put an ex-Amazon.com VP in charge of Cloud Infrastructure and Operations.  I’ve had e-mail conversations on the changes with lots of people asking questions, but I couldn’t write anything.  Well, now I can blog something because of public disclosure.  Suresh Kumar, VP of Cloud Infrastructure and Operations updated his LinkedIn profile.

Last week Suresh’s linkedin profile only showed Suresh’s Amazon experience even though he had been at Microsoft for months and his job change to Microsoft was not added yet.

 

VP, Worldwide Retail Systems and Retail Services

Amazon

August 2008 – May 2014 (5 years 10 months)Greater Seattle Area

As the Vice President of Worldwide Retail Systems, managed a global team of 500 engineers across seven locations, including four Vice Presidents of Technology and twelve Engineering Directors. Responsible for technology that powers core retail functions such as pricing, promotions, catalog and vendor management for all Amazon properties worldwide. Responsible for all aspects of technology, including program management, software development, testing, support, operations and business analytics. 

As the Retail CTO, responsible for establishing software architecture standards, and maintaining consistency in hiring and leveling of senior engineering talent across all retail divisions. Responsible for setting architecture direction for all Amazon retail subsidiaries and integrating subsidiaries into the Amazon technology stack.

As head of Retail Services, currently managing a team of 2000 associates across nine centers and twenty product imaging studios worldwide, responsible for creating and maintaining all item information, including item images for products sold by Amazon retail.

Now there are these two entries.

Corporate Vice President, Microsoft Cloud Infrastructure and Operations

Microsoft
October 2014 – Present (1 month)Redmond, WA

Responsible for designing, building and operating the infrastructure that power's Microsoft's cloud; the engineering systems required for automating and optimizing the processes associated with the planning and management of the cloud infrastructure.

Corporate Vice President

Microsoft
June 2014 – September 2014 (4 months)Redmond, WA

There are many more details, but the above is all I could find that has been published.  

Will be interesting to see how Suresh does in his role at Microsoft. He has a background that is different than many and I didn’t find any data center experience in his background.

Princeton University

PhD, Engineering
1987 – 1992
1983 – 1987
...
· Ten patents on work related to mobile computers. Three patents on collaborative computing, one on cryptography and one on electronic auctions. Several patent applications on e-commerce are pending.

GE IT obsoletes the low level IT role, goes All-in for Public Cloud

Infoworld has an interview with GE’s COO of IT Chris Drumgoole.  Bottom line GE is shutting down its own data center and Infrastructure of servers, networking, and storage, transitioning to the Public Cloud.  Below is the closing of the article where people are told to go up the stack or else.

InfoWorld: The obvious cultural question that everyone asks about moving toward the cloud is the effect on morale. Is my job being outsourced? Am I going to be a victim? How have you dealt with that?

Drumgoole: It’s a good question. I get asked it any time I speak, especially to our own employees. It’s going to sound like a canned answer, but in our case, it’s true: With our growth rate and the shift that we’re making to software in all of our businesses, there’s no shortage of opportunity to do things up the stack.

The way I answer that question when my own people ask is that the world is your oyster if you’re willing to make the cultural shift. We’ll gladly teach you [to work on things higher up in the stack] -- we want to invest in you. If you want to make that jump as an individual and you can challenge the status quo and be part of that, we have thousands of openings for you to go do stuff.

If you’re not willing to make that shift, then yes, you’re going to have to look at yourself in the mirror and have hard conversations around what your career looks like in IT going forward. We’re lucky enough to be so big and of such scale that we can put the choice on the people and say: It’s on you.

Part of GE’s efforts are to break down silos and change how IT provides a service.  In the past IT organizations were a monopoly who had complete control over how services were delivered.  GE tries to bring back control over Public Cloud efforts by providing security, regulatory, data privacy and other things that business units tend to overlook.

InfoWorld: Another risk factor when you go to public cloud services is reinventing the siloed organization. Different companies give different levels of freedom to individual business units to go out and get their own cloud service. How do you avoid creating silos?

Drumgoole: To the point I made earlier, we really view ourselves to be a service provider to our businesses, so our businesses can buy from us or they can buy from others. The best way to think about it is if you’re my oil and gas division you can come to me, as corporate IT, and buy Amazon in order deploy your applications or you can go to Amazon directly or you can go to Azure directly.

The way we enforce that is we say: OK, if you want to come through me, by definition, you’re going to live and operate in this safe environment. I have already taken care of the things that GE holds dear and our requirements around regulation, security, data privacy and so on. I pre-built and pre-instrumented the environment so that those things are not something you have to worry about. That’s the benefit of coming to me.

If you decide to go on your own, you certainly can. We’re never going to stop you, but understand that now those things are on you and you have to take care of them. I’ll tell you, in practice ... we’ve made that a losing proposition. That’s where scale comes into play. If we ask what it’s going to cost a business unit to go it alone, we truly are cheaper. So no one ever ends up making that decision, ever. We kind of let the market power enforce that as opposed to trying to put a process in place.

99.99% available services, Are Tiers relevant? The Cloud may be more disruptive than misinformed

Uptime Institute has a post in Response to an AFCOM post on Tier Standards.


An abbreviated version of this column was written for Data Center Knowledge in response to an interview with AFCOM Denver Chapter President Hector Diaz, on September 11, 2014.

...

The Tier standards offered by the Uptime Institute can often be confusing at present.

Tiers are summarized as these 4 levels.

  • Tier IV - Fault tolerant site infrastructure
  • Tier III - Concurrently maintainable site infrastructure
  • Tier II - Redundant capacity components site infrastructure (redundant)
  • Tier I - Basic site infrastructure (non-redundant)

So when you want a highly available service you would assume you need a Tier 3 or 4 data center.  But for services like Netflix, eBay, and Google, there are 3-5 data centers running services where a data center can go down and services are still available.  I don’t ever hear these guys talking about they have built Tier 3 or 4 data centers.  Heck, Netflix proudly says they don’t need data centers, using Amazon and Google Cloud Services.

Given 99% or more of start up are using the cloud to build services and following guidance like AWS architecture for high availability services, are Tier ratings of data center relevant?

NewImage

Instead of talking about tiers, highly available cloud services talk about availability zones.

Regions and Availability Zones

Amazon EC2 is hosted in multiple locations world-wide. These locations are composed of regions and Availability Zones. Each region is a separate geographic area. Each region has multiple, isolated locations known as Availability Zones. Amazon EC2 provides you the ability to place resources, such as instances, and data in multiple locations. Resources aren't replicated across regions unless you do so specifically.

Amazon operates state-of-the-art, highly-available data centers. Although rare, failures can occur that affect the availability of instances that are in the same location. If you host all your instances in a single location that is affected by such a failure, none of your instances would be available.

NewImage
 
 

While AFCOM and Uptime Institute debate Tier Standards, the technology community is moving to Availability Zones practices. 

Netflix just survived the unavoidable rebooting of 10% of its cassandra servers in AWS due to Xen maintenance.  And Netflix has survived a variety of data center outages in AWS as well.

A State of Xen - Chaos Monkey & Cassandra

 
On Sept 25th, 2014 AWS notified users about an EC2 Maintenance where “a timely security and operational update” needed to be performed that required rebooting a large number of instances. (around 10%)  On Oct 1st, 2014 AWS sent an updated about the status of the reboot and XSA-108.


While we’d love to claim that we weren’t concerned at all given our resilience strategy, the reality was that we were on high alert given the potential of impact to our services.  We discussed different options, weighed the risks and monitored our services closely.  We observed that our systems handled the reboots extremely well with the resilience measures we had in place.  These types of unforeseen events reinforce regular, controlled chaos and continued to invest in chaos engineering is necessary. In fact, Chaos Monkey was mentioned as a best practice in the latest EC2 Maintenance update.
 

Morning View sets the tone for the day

The other day one of my data center friends came over with his dad who was visiting from San Antonio, Texas.  My cousins were raised in San Antonio and one still lives there.  I’ve gone to a few Longhorn football games with my cousin who was an all american swimmer at UT so I’ve got a chance to experience Texas as local do.

My friends Dad had made his first trip to Seattle and the weather was great this past week.  It rained one day with a bit of drizzle and this morning is a bit of clouds.  

Below is this mornings view from home.  Yes, my friends dad realized he needs to visit his son more often.

Today is a day I can spend chatting with friends on ideas to transform the industry and the cloud.  I think part of what is nice is staring out the window I can dream without worrying about bozos.  oops, HR will get mad at me for calling someone a bozo.  oh, wait there is no HR.  and, there are no bozos in the house/home office.

I’ve put my roots in Redmond, WA.  Been here for 22 years.  After 14 years at Microsoft it was time to leave.  Now I spend more of my time in the Cloud which luckily has Seattle as a hub.  Amazon, Microsoft, Google, HP, and so many more are realizing the Seattle area is a place to be work on the cloud.

NewImage