Mind-shifting to change Data Center approaches

The Data Center industry is full of many people who are convinced their way is the right way and others are wrong.  They have years of hard work to prove their methods are right and work, emphasizing the strength and speed of what they can get done.

TED conference has a talk given by Lewis Pugh on a mind-shifting experience he went through that has a good lesson to learn from.  If you want to jump to the point where I am referencing it is at 6:25 mark.  The video is only 10 min, but quite enjoyable.

Lewis discusses as a lesson to make a true change for the climate requires a different mind-set.

Lewis starts using the same methods he has successfully used in the past.

And then we got up to this small lake underneath the summit of Mt. Everest, and I prepared myself, the same way as I've always prepared myself, for this swim which was going to be so very difficult. I put on my iPod, I listened to some music, I got myself as aggressive as possible -- but controlled aggression -- and then I hurled myself into that water.

I swam as quickly as I could for the first hundred meters, and then I realized very, very quickly, I had a huge problem on my hands. I could barely breathe. I was gasping for air. I then began to choke, and then it quickly led to me vomiting in the water. And it all happened so quickly I then -- I don't know how it happened -- but I went underwater. And luckily, the water was quite shallow, and I was able to push myself off the bottom of the lake and get up and then take another gasp of air. And then I said, carry on. Carry on. Carry on. I carried on for another five or six strokes, and then I had nothing in my body, and I went down to the bottom of the lake. And I don't where I got it from, but I was able to somehow pull myself up and as quickly as possible get to the side of the lake. I've heard it said that drowning is the most peaceful death that you can have. I have never ever heard such utter bollocks. (Laughter) It is the most frightening and panicky feeling that you can have.

Almost dying gave Lewis a dose of humility.  And his crew gave him a new plan.

And there, we sat down, and we did a debrief about what had gone wrong there on Mt. Everest. And my team just gave it to me straight.They said, Lewis, you need to have a radical tactical shift if you want to do this swim. Every single thing which you have learned in the past 23 years of swimming, you must forget. Every single thing which you learned when you were serving in the British army, about speed and aggression,you put that to one side. We want you to walk up the hill in another two days time. Take some time to rest and think about things. We want you to walk up the mountain in two days time, and instead of swimming fast, swim as slowly as possible.Instead of swimming crawl, swim breaststroke.And remember, never ever swim with aggression.This is the time to swim with real humility.

And here are the two big lessons that Lewis relates.

But I learned two very, very important lessons there on Mt. Everest. And I thank my team of Sherpas who taught me this. The first one is that just because something has worked in the past so well, doesn't mean it's going to work in the future. And similarly, now, before I do anything, I ask myself what type of mindset do I require to successfully complete a task. And taking that into the world of climate change, which is, frankly, the Mt. Everest of all problems -- just because we've lived the way we have lived for so long, just because we have consumed the way we have for so long and populated the earth the way we have for so long, doesn't mean that we can carry on the way we are carrying on. The warning signs are all there. When I was born, the world's population was 3.5 billion people. We're now 6.8 billion people, and we're expected to be 9 billion people by 2050.

And then the second lesson, the radical, tactical shift. And I've come here to ask you today: what radical tactical shift can you take in your relationship to the environment, which will ensure that our children and our grandchildren live in a safe world and a secure world, and most importantly, in a sustainable world? And I ask you, please, to go away from here and think about that one radical tactical shift which you could make,which will make that big difference, and then commit a hundred percent to doing it. Blog about it, tweet about it, talk about it, and commit a hundred percent. Because very, very few thingsare impossible to achieve if we really put our whole minds to it.

So thank you very, very much.

(Applause)

Read more

Warning an obsession on operational efficiency can lead you to anorexia vs. being competitive

We have all been frustrated by a bean counter approach that focus on the numbers.  Where a short term cost reduction is viewed as a win, even though your long term health suffers.

An example of a potential obsession on a data center efficiency number is PUE.  PUE is often used as identifying a green data center, but PUE is only one number and not the end goal.

The Phoenix Principle has a guest blog post that touches on the Yin and Yang of Operational Excellence.

The Yin & Yang of Operational Excellence & Innovation

Efficiency is a good thing, taken in moderation. The same with focus. It is good management hygiene to pay attention to what you’re doing and try to do it efficiently. This helps build a competitive cost structure and a results-based culture. From an operations standpoint that means that the use of an occasional stopwatch or its modern day equivalents in order to eliminate wasted effort and speed workflows makes perfect sense. Frederick Taylor made the great contribution in 1911 of helping companies recognize that labor is a controllable cost that can be managed, but he taught that a narrow focus on the optimization of each operation and repetition of the “best practice” was the key to success. He missed the point (among others) that it is really the improvement of the process as a whole that changes the game. It took Toyota and Yamaha and other Japanese companies to teach the world that lesson 70 years later – leading to today’s six sigma, lean, and time compression concepts.

One of the points well made is an obsession that can occur when management focuses on efficiency as the end.

The pursuit (often obsession) of operational excellence becomes an end unto itself and gets disconnected from the mission of generating growth and creating value.

How many companies are limited by its IT group and data center capacity?

The end game is not to get lean and agile, but rather to get lean and agile so that you can compete more effectively – leveraging these capabilities to go to market in innovative new ways, to compete in new markets, and ultimately to create new markets.

Which is part of why cloud computing solutions like AWS are successful as companies can side step the corporate IT/data center group as they don't want to incur any new costs.

Be careful trying to be too efficient and miss the focus on supporting the business.

Do you have an accurate image of yourself?

Read more

Meditating, Higher Consciousness, Situation Awareness, Seeing Things in Data Centers most miss

I had one of my local high tech friends come by for an afternoon chat.  It was the first time he had come over, and we spent a couple of quiet hours discussing all kinds of topics including data centers.  My friend appreciated the Zen and quiet time I get working from home.  Whenever someone suggests travel, I try to figure out how I can skip the plane flight. :-)

The next day I got up in the morning, and started writing.

image

This is the view to the south at the same time the sun was rising above.

image

As the evening was approaching, and the moon was almost full. I was using the quiet time to meditate, and try some higher consciousness exercises.

The concept of higher consciousness rests on the belief that the average, ordinary human being is only partially conscious due to the character of the untrained mind and the influence of 'lower' impulses and preoccupations. As a result, most humans are considered to be asleep (to reality) even as they go about their daily business.

image

As the night progressed, I decided to have my own outdoor movie and brought out my laptop to stream a Netflix movie, "The Sensei"

A DIFFERENT KIND OF MARTIAL ARTS FILM

A Different Kind of Martial Arts Film: D. Lee Inosanto’s ‘The Sensei’ battles prejudice and homophobia in 1980s small town in Colorado

If there’s one thing D. Lee Inosanto is no stranger to, it’s martial arts. Her father is martial arts legend Dan Inosanto, her godfather was the late Bruce Lee (whom she refers to simply as “Uncle Bruce”), and Inosanto herself is a highly trained martial artist who has worked as a stunt person on projects from Buffy the Vampire Slayer to Face/Off.

image

Then the next morning it hit the connection between the method of higher consciousness and situation awareness.

Situation awareness, or SA, is the perception of environmental elements within a volume of time and space, the comprehension of their meaning, and the projection of their status in the near future. It is also a field of study concerned with perception of the environment critical to decision-makers in complex, dynamic areas from aviation, air traffic control, power plant operations, military command and control, and emergency services such as fire fighting and policing; to more ordinary but nevertheless complex tasks such as driving an automobile or motorcycle.

Situation awareness (SA) involves being aware of what is happening around you to understand how information, events, and your own actions will impact your goals and objectives, both now and in the near future. Lacking SA or having inadequate SA has been identified as one of the primary factors in accidents attributed to human error (e.g., Hartel, Smith, & Prince, 1991; Merket, Bergondy, & Cuevas-Mesa, 1997; Nullmeyer, Stella, Montijo, & Harden, 2005). Thus, SA is especially important in work domains where the information flow can be quite high and poor decisions may lead to serious consequences (e.g., piloting an airplane, functioning as a soldier, or treating critically ill or injured patients).

There are some people I am working with to apply the ideas of situation awareness (a higher level of consciousness) to the data center.  Here is a situation awareness demo using Geographic Information System (GIS) information from ESRI.

Part of the fun things I am working on is with people who have a situation awareness, a higher level of consciousness of what is going on data centers.  The challenge we have is discussing things we discover with people "who don't know what they don't know."

A Chinese Proverb states.

He who knows not, and knows not that he knows not, is a fool...shun him.

He who knows not, and knows that he knows not, is willing...teach him.

He who knows, and knows not that he knows, is asleep...awaken him.

He who knows, and knows that he knows, is wise...follow him.

How many data center errors/mistakes could be prevented if systems and methods are set up to support a situational awareness.  A consciousness of what what is going on.

Eric Gallant, a Lee Tech employee commented on this concept.

Eric Gallant said...

Excellent thought Dave. Prior to getting into the data center industry, I operated nuclear power plants for the Navy. After countless hours standing watch in the engine room, my senses became tuned to the environment. I could recognize a change in the pitch of a steam turbine, detect the slightest hint of acrid odor from a switchgear section and identify suspicious vibrations in the deck plates through the soles of my boots. My analog senses were often more useful than the abundant digital meters and detectors that monitored plant conditions.
The same phenomenon can be found in experienced data center professionals. I’ve seen data center operators sprint from their offices before the first alarm sounds because of a barely perceptible change in the quality of the light. I’ve even seen an engineer diagnose a bad CRAH shaft bearing by pressing his forehead against the front of the running machine.
As a managers and engineers we focus on metrics. As the old saw goes, “you can’t manage what you can’t measure.” And a good deal of engineering is knowing how, what and why to measure. Perhaps we focus on the measurable and quantifiable to the detriment of our more visceral abilities.

Read more

Spies use of Social Networks

The FBI's arrest of 11 Russian spies is hot news and most of the attention is going to Anna Chapman.

Alleged Russian agent Anna Chapman could have warmed up any Cold War night

GALLERY

Anna Chapman, alleged Russian spy, posts photos online

Alleged Russian spy, Anna Chapman, became an instant Web sensation following the release of photos posted on the Russian social-networking Web site "Odnoklassniki," or Classmates.

By Monica Hesse

Washington Post Staff Writer
Thursday, July 1, 2010

There were 11 alleged Russian agents arrested this week, under accusations that they'd been living as Americans while reporting back to the mother country.

THIS STORY

  • But mostly we care about the hot one.

Ever since photos of Anna Chapman began circulating online late Tuesday, the Internet at large has been foaming, frothing, fanatic for details about the reported 28-year-old secret agent/Maxim model look-alike who specialized in sultry-eyed, pouty-lipped, come-hither stares. Da, da,da!

CNET news has a post on Facebook effect and spies.

A Cold War tale reheated for Facebook

by Caroline McCarthy

A time traveler from the 1960s would find many of today's headlines completely befuddling. Something called theiPhone? Threats from an amorphous, stateless band of terrorists? Reality television? A lot has changed, for sure.

But accused spies for the Kremlin--that's something our unstuck-in-time explorer would thoroughly recognize. Except, of course, when he heard everybody talking about foreign concepts like Facebook and LinkedIn.

Should a spy be on Facebook?

But for a young secret agent like Anna Chapman or Mikhail Semenko, the absence of a Facebook profile could trigger suspicion. If they're going to be like everybody else, of course they're going to use social networks.

Why spying is important.

Espionage is a fact of international life and always has been. The first spy manual, The Art of War, was written by Sun Tzu some 2,500 years ago. Espionage fills a vital niche; a successful operation can provide insight into intentions, plans, and human dynamics that cannot be gleaned from intercepted communications or pictures from space.

It is safe to assume that since the end of World War II there has never been a day that the Soviet Union or Russia was not spying on the United States, or vice versa. Espionage will continue, even as the United States and Russia work out a new modus vivendi.

Data Centers is a competitive industry, and as much as people try to keep things secret. With public disclosures it is not hard to piece together information.  Rich Miller posted on Facebook's 60,000 server count on June 28, 2010.

Facebook Server Count: 60,000 or More

June 28th, 2010 : Rich Miller

It’s said that a picture is worth a thousand words. Sometimes a PowerPoint slide can tell the story of thousands of servers.

That was the case with a presentation from Facebook’s Tom Cook at last week’s  Velocity 2010 conference, which depicted the growth of the company’s server footprint. Designed to illustrate Facebook’s insatiable need for more servers to support its 400 million users, the chart didn’t include any numbers, seeking not to reveal the actual server count.

Dates Provide A Clue
But the chart included dates, which allows us to do some math to fill in the blanks. In a presentation in November 2009, Facebook vice president of technology Jeff Rothschild disclosed that the company had more than 30,000 servers. Cook’s chart shows a brief plateau in Facebook’s server growth at about that time, followed by a sharp upward spike in the growth line through the first quarter of 2010 that effectively doubles the total number of servers.

That suggests that Facebook now has 60,000 or more servers. The sharp acceleration in Facebook’s server growth in late 2009 also helps explain the company’s move to lease large chunks of data center space in northern Virginia and Silicon Valley in March. The growth spurt occurred after Facebook announced plans to construct its own data center in Prineville, Oregon.

Putting together the pieces that are public is what I wrote about in this post.

Mar 09, 2010

A different interpretation of “Open Source” in an Intelligence Analysis scenario that defines how GreenM3 works public data

I ran across the term Open Source Intelligence.

Open source intelligence (OSINT) is a form of intelligence collection management that involves finding, selecting, and acquiring information from publicly available sources and analyzing it to produce actionable intelligence.

This description fits what I have been telling others about the various data center sources of information.

“If there is a public publication of information, we are open to look at and provide feedback on the value we see in the information.”

Which is a pretty good description of how this blog has been run, commenting on public available information.

BTW, the use of social networks is not anything new.  Three Days of the Condor is about a group of CIA researchers who did Open Source Intelligence - "I just read books"

Joe Turner (Robert Redford) is a CIA employee who works in a clandestine office in New York City. He is not a field agent, and indeed bristles at Agency discipline; among other things, he wonders why he can't tell people what he does for a living and notes "I trust some people ... that's a problem." His job is in the OSINT field: he has to read books, newspapers, and magazines from around the world, looking for hidden meanings and new ideas. As part of his duties, Turner files a report to CIA headquarters on a low-quality thriller novel his office has been reading, pointing out strange plot elements therein, and the unusual assortment of languages in which the book has been translated (Turkish but not French, Arabic but not Russian or German, Dutch, and Spanish).

Robert Redford's character says.

I work for the CIA. I'm not a spy. I just read books. We read everything that's published in the world, and we-- we feed the plots-- dirty tricks, codes into a computer, and the computer checks against actual CIA plans and operations. I look for leaks, new ideas. We read adventures and novels and journals. I-- I can-Who'd invent a job like that? I-- Listen! People are trying to kill me!

Here is a video clip from Three Days of the Condor.


Behind all of this is the technique of using public information with a bunch of people who are thinking of questions others don't ask.  There are tons of experts in the CIA.  There are tons in the data center industry.  Yet can the experts anticipate the unexpected?

Taking a bunch of people who look at what is going on in the world allows you to be more creative in figuring out the questions that should be asked.

If you are a spy you need cover your tracks.

There are perils to the process. One source here said that analysts who engage in searches without masking their origin can lead to foreign governments or companies cutting off access to web sites or to people involved. The problem? Some analysts at NSA, CIA and other alphabet soup agencies forget to mask their IP addresses and the times at which they are searching. Chinese, Russian and other savvy operators can check time stamps, for example. If a search occurs during American working hours, it’s a pretty good bet that it’s an American source looking for the information.
Read more: http://www.dodbuzz.com/2009/10/20/open-source-intel-use-soars/#ixzz0svCx1zvG

This technique makes it easier to think of what is a green data center.  Which is more than a low PUE.

Read more

Less is More Gains Momentum, including data centers

The Economist discusses the popularity  of less is better in technology, and how it is growing in spite of technologies typical more is better.

But now there are signs that technologists are waking up to the benefits of minimalism, thanks to two things: feature fatigue among consumers who simply want things to work, and strong demand from less affluent consumers in the developing world. It is telling that the market value of Apple, the company most closely associated with simple, elegant high-tech products, recently overtook that of Microsoft, the company with the most notorious case of new-featuritis. True, Apple’s products contain lots of features under the hood, but the company has a knack for concealing such complexity using elegant design. Other companies have also prospered by providing easy-to-use products: think of the Nintendo Wii video-games console or the Flip video camera. Gadgets are no longer just for geeks, and if technology is to appeal to a broad audience, simplicity trumps fancy specifications.

One of the classic differences between Windows and Mac is you ask how to do something on the Mac, and there is one way.  You ask the same question on Windows and there will many times be three or more. Which way do you think is better the one way or give people multiple ways.  When you have the market share with the diversity of users then you collect the user data, develop the alternatives and test the usability.  If you are Apple you figure out the one way to do it, hope Steve Jobs doesn't think your way is ridiculed, and the feature ships.

With the growth of Apple's iPod, iPhone, and iPad, figuring out the simple user interface is being accepted more.

Frugality is the mother of invention

And then there is the phenomenon of “frugal” innovation—the new ideas that emerge when trying to reduce the cost of something in order to make it affordable to consumers in places like China, India and Brazil. The resulting products often turn out to have huge appeal in the rich world too, especially in an era of belt-tightening. The netbook, or low-cost laptop, was inspired by a scheme to produce cheap laptops for children in poor countries, but has since proved popular with consumers around the world. Tata devised the Nano, the world’s cheapest car, with India’s emerging middle classes in mind; it is now planning to launch it in Europe, too, where there is growing demand for cheap, simple vehicles.

Apple and Google are fighting for the Mobile space, and as they point out, the fight can be about control.

The mobile space also offers something that Jobs craves: control. Unlike being able to buy pretty much any software program you want for the personal computer, with the iPad you’re locked in. There’s only one place to buy apps: Apple’s online App Store. And Jobs keeps a 30 percent cut of the revenue. As for ads, Jobs will sell those, too, and he’ll keep 40 percent. Of course, Jobs also sells music, movies, and books via his iTunes Store, keeping 30 percent. So instead of a one-time sale of a Mac, each iPhone and iPad becomes an ongoing revenue stream. No wonder Jobs is going all-in for mobile.

KC Mares discusses another thing that is better if less, Vibration.

The Data Center Vibration Penalty to Storage Performance

Every now and then a really great way to reduce energy use comes along that is so simple we all whack our head wondering, “why didn’t I think of that!” My principles of achieving ultra-efficient data centers (PUEs between 1.03-1.08; I call anything less than 1.10 ultra-efficient) are based upon simplicity and a holistic approach while meeting the need not the want or convention. Generally the simpler the better, as simple is always lower cost up front and ongoing, as well as easier to maintain, more reliable and more efficient.

As KC mentions, think about all the equipment causing vibration.

If the vibration from yelling into a rack causes performance degradation, think about the vibration affects from HVAC systems, thousands of server fans, and even walking thru your data center.

Wouldn't it be great if you didn't have to yell in data centers as vibration and noise was reduced.  Kind of make sense that the less noise there is the less energy is expended.  If you aren't listening to the noise your hard disks aren't hard of hearing the bits and they have to try again and again.

There are actually many reasons that less is better as I have listed a bunch of ideas above.

But, the common approach in technology is more is better.

Can you shift your thinking to less is better?

It is kind of a Zen thing.  Your life is not happier with more, but in understanding what you have in your life and why it is important.  Meditating, reflecting, questioning.

Maybe people need to spend more time in Data Center Meditation, but it is almost impossible with all the noise and vibration.

meditation4nerds

We finally have some sunny weather here, and as you can see we have very high water as the docks are under water on June 13, 2010.  It is very cool though to walk on the dock in 6 inches of water and think.

image

I am going to change one of my M's for memetics to meditation. So, now Monitoring, Modeling, and Meditating the green data center.

Read more