Musings on personal and enterprise technology (of potential interest to professional technoids and others)

Showing posts with label storage. Show all posts
Showing posts with label storage. Show all posts

Tuesday, June 30, 2009

Data Center Overload, Tom Vanderbilt, NYTimes 8-Jun-2009

Photograph Attribution: Simon Norfolk/NB Pictures, for The New York Times
Known for its bean and spearmint fields, Quincy, Wash., is also home to rows of servers in a 500,000-square-foot data center that Microsoft built in 2006



For those of us already keenly aware of the various business-related and environment-related benefits of reducing datacenter and related power consumption, Tom Vanderbilt's article is a must-read. Published in the recent New York Times Sunday magazine's Architecture Issue, Vanderbilt presents a refreshing and enlightening review of why we should continue to care deeply about these issues, and follow through with practical energy-reducing measures in managing technology and other infrastructure. This is one of the overall best articles on this topic seen by technosurfer in quite some time :)

The Architecture Issue - Data Center Overload - NYTimes.com: "...Much of the daily material of our lives is now dematerialized and outsourced to a far-flung, unseen network. The stack of letters becomes the e-mail database on the computer, which gives way to Hotmail or Gmail. The clipping sent to a friend becomes the attached PDF file, which becomes a set of shared bookmarks, hosted offsite. The photos in a box are replaced by JPEGs on a hard drive, then a hosted sharing service like Snapfish. The tilting CD tower gives way to the MP3-laden hard drive which itself yields to a service like Pandora, music that is always “there,” waiting to be heard.

But where is “there,” and what does it look like?"

“There” is nowadays likely to be increasingly large, powerful, energy-intensive, always-on and essentially out-of-sight data centers. These centers run enormously scaled software applications with millions of users. To appreciate the scope of this phenomenon, and its crushing demands on storage capacity, let me sketch just the iceberg’s tip of one average individual digital presence: my own. I have photos on Flickr (which is owned by Yahoo, so they reside in a Yahoo data center, probably the one in Wenatchee, Wash.); the Wikipedia entry about me dwells on a database in Tampa, Fla.; the video on YouTube of a talk I delivered at Google’s headquarters might dwell in any one of Google’s data centers, from The Dalles in Oregon to Lenoir, N.C.; my LinkedIn profile most likely sits in an Equinix-run data center in Elk Grove Village, Ill.; and my blog lives at Modwest’s headquarters in Missoula, Mont. If one of these sites happened to be down, I might have Twittered a complaint, my tweet paying a virtual visit to (most likely) NTT America’s data center in Sterling, Va. And in each of these cases, there would be at least one mirror data center somewhere else — the built-environment equivalent of an external hard drive, backing things up.

Small wonder that this vast, dispersed network of interdependent data systems has lately come to be referred to by an appropriately atmospheric — and vaporous — metaphor: the cloud. Trying to chart the cloud’s geography can be daunting, a task that is further complicated by security concerns. “It’s like ‘Fight Club,’ ” says Rich Miller, whose Web site, Data Center Knowledge, tracks the industry. “The first rule of data centers is: Don’t talk about data centers.”

Yet as data centers increasingly become the nerve centers of business and society — even the storehouses of our fleeting cultural memory (that dancing cockatoo on YouTube!) — the demand for bigger and better ones increases: there is a growing need to produce the most computing power per square foot at the lowest possible cost in energy and resources. All of which is bringing a new level of attention, and challenges, to a once rather hidden phenomenon. Call it the architecture of search: the tens of thousands of square feet of machinery, humming away 24/7, 365 days a year — often built on, say, a former bean field — that lie behind your Internet queries.

[etc...] As James Hamilton of Amazon Web Services observed recently at a Google-hosted data-center-efficiency summit, there is no Moore’s Law for power — while servers become progressively more powerful (and cheaper to deploy) and software boosts server productivity, the cost of energy (as well as water, needed for cooling) stays constant or rises. Uptime’s Brill notes that while it once took 30 to 50 years for electricity costs to match the cost of the server itself, the electricity on a low-end server will now exceed the server cost itself in less than four years — which is why the geography of the cloud has migrated to lower-rate areas.

The huge power draws have spurred innovation in the form factor of the data center itself. For its Chicago center, Microsoft is outfitting half the building with shipping containers packed with servers. “Imagine a data center that’s about 30 megawatts, with standard industry average density numbers you can probably fit 25,000 to 30,000 servers in a facility like that,” says Microsoft’s Chrapaty. “You can do 10 times that in a container-based facility, because the containers offer power density numbers that are very hard to realize in a standard rack-mount environment.”

The containers — which are pre-equipped with racks of servers and thus are essentially what is known in the trade as plug-and-play — are shipped by truck direct from the original equipment manufacturer and attached to a central spine. “You can literally walk into that building on the first floor and you’d be hard pressed to tell that building apart from a truck-logistics depot,” says Manos, who has since left Microsoft to join Digital Realty Trust. “Once the containers get on site, we plug in power, water, network connectivity, and the boxes inside wake up, figure out which property group they belong to and start imaging themselves. There’s very little need for people.”

“Our perspective long term is: It’s not a building, it’s a piece of equipment,” says Daniel Costello, Microsoft’s director of data-center research, “and the enclosure is not there to protect human occupancy; it’s there to protect the equipment.”

From here, it is easy to imagine gradually doing away with the building itself, and its cooling requirements, which is, in part, what Microsoft is doing next, with its Gen 4 data center in Dublin. One section of the facility consists of a series of containers, essentially parked and stacked amid other modular equipment — with no roof or walls. It will use outside air for cooling. On our drive to Tukwila, Manos gestured to an electrical substation, a collection of transformers grouped behind a chain-link fence. “We’re at the beginning of the information utility,” he said. “The past is big monolithic buildings. The future looks more like a substation — the data center represents the information substation of tomorrow.”


Tom Vanderbilt is the author of “Traffic: Why We Drive the Way We Do (and What It Says About Us).”

Tuesday, January 22, 2008

[enhanced search], security among RIM software updates - InfoWorld/Yahoo! News

Some interesting features described below, in upcoming RIM updates to BES and to the device software, including search/retrieve messages on the server (even if no longer on the device)... Of course the speed of retrieval will presumably remain at least as slow as for most users searching their messages e.g. via Outlook from conventional wired computers (presumably neither Google nor Microsoft can enable the Desktop Search speed improvements of pre-indexed email on the blackberry, until some time in the future when blackberry device storage capacity will be able to handle many more GIGABYTES of index data ;-)

Click-to-call, security among RIM software updates - Yahoo! News: "...Enhanced e-mail handling will include several new features. Users will be able to search for and retrieve messages on their enterprise e-mail servers that are no longer stored on their BlackBerries. Also, the devices will be able to render HTML and rich text e-mail messages, including font colors and styles, images, hyperlinks, and other elements. After downloading Microsoft Word, PowerPoint, and Excel*** files, users will now be able to edit them on the BlackBerry, thanks to Documents to Go software from DataViz that is being integrated into the mobile platform.

Even within e-mail encrypted with PGP or S/MIME, BlackBerry users will be able to view attachments, according to the company.

RIM also has some good news for enterprises that want to more easily manage and lock down their employees' devices. They will be able to drill down and define which applications on a BlackBerry can access its GPS functionality as well as enable or shut down specific Bluetooth profiles and set how long the device is 'discoverable' using Bluetooth. The less time a phone is discoverable by other Bluetooth devices, the less chance an intruder has to hack it, although this method of breaking into a phone hasn't been widely exploited.

A Web-based device management console is also coming, allowing users to control settings and install software from any Web-connected computer. In addition, administrators will now be able to update users' devices over the air....

RIM expects to ship its BES version 4.1.5 software for IBM Lotus Domino and for Microsoft Exchange by the end of February. They will be free upgrades for customers with BES version 4.1.0 or later, while others can buy the upgrade for $999 or purchase a Technical Support Services contract. The price of the BES for new customers will remain at $3,999 per server with 20 user licenses included.

Version 4.5 of the BlackBerry device software will be required to use many of the end-user features; it will be available in the first half of the year, depending on carrier. It will be a free download from RIM and carrier Web sites. The ability to edit Word and PowerPoint documents will come with version 4.5, but ***Excel editing capability will be in a later release, expected in the latter part of this year."

Thursday, December 13, 2007

A new spin on voice mail - Financial Post 2007/12/12

An interesting form of cellphone-centric unified messaging... What a nice way to avoid wasting time listening to my latest voicemail message from unsolicited vendor number 361 received so far this month ;-)

Some interesting potential benefits from storing and searching the transcribed voice messages... (also implicitly raising the generic issues about storage / capacity / archiving etc. relevant for any unified messaging architecture, and clearly part of the overall ROI)...

IMHO the service sounds good, subject to a couple of caveats... But the price still seems a bit steep(?)

A new spin on voice mail: "...Rogers Wireless is looking to make returning calls slightly faster and easier, with a new voice-to-text messaging service the company unveiled yesterday.

For the price of $15 per month, Rogers will be able to take any English or French phone message you might have missed and process it using automated software powered by SpinVox, a U.K.-based firm, that transcribes it to a text message and sends it to your cellphone or other wireless device.

Irv Witte, Rogers Wireless vice-president of business marketing, says the service is aimed at the mobile user who experiences anywhere between 60 to 100 voice mails each month. He also tried to put aside fears about how accurate the service may be, citing that SpinVox is able to convert upwards of 90% of all speech into legible text.

'We've had several hundred people testing this out and have had no complaints about accuracy at all,' Mr. Witte said. 'It's almost frightening how good it is at translating.' The service is available in only seven provinces right away, but Rogers plans to launch the service in Alberta, Saskatchewan and Manitoba early next year. A potential drawback is not getting the entire message. According to an IBM-funded research study, the average voice mail lasts about 31 seconds, longer than the 18 seconds maximum for the SpinVox service.

That may leave the door open for New York-based Simulscribe Inc. to make its own splash in the Canadian market. James Siminoff, chief executive, says Simulscribe will be launching its own voice-to-data service today with a competing plan that offers Canadians on any cellphone plan unlimited message transcriptions regardless of how long as the voice mail lasts for $30 per month.

'Rich, poor, no matter who you are in the workforce, everybody needs to have voice mail', Mr. Siminoff said.

As Eamon Hoey, senior partner at Hoey Associates Management Consultants Inc., puts it, voice mail is just another technology whose innovation is driven by the need for more time..."

Thursday, November 15, 2007

Managed Backup Strategy: "Cotton Companies Walks the Walk", eWeek 8oct2007

An interesting approach to centralized backup strategy (apparently no mention however, of required network bandwidth required for those distributed sites)- for a company specializing in disaster-recovery -:)

Cotton Companies Walks the Walk: "...Asigra's Televaulting is the first agentless solution to deliver bare-metal restoration capabilities across distributed or multisite networks, said Colesante. Agentless means there is no need to install client software on target machines, while bare metal means the software restores servers without the need to load applications or files. Televaulting has two main components—a client, which resides at a customer site, and a server, which resides at a WAN-connected data center. Televaulting's technology performs a full backup followed by incremental, minor backups..."