Open Source Cloud Authors: Liz McMillan, Vaibhaw Pandey, Stackify Blog, Pat Romanski, Wesley Coelho

Related Topics: @CloudExpo, Microservices Expo, Open Source Cloud, Containers Expo Blog, Apache

@CloudExpo: Article

Can’t Find Enough Storage Admins to Run Your Business? Automate

Bridging the Storage Admin Gap

Everyone in IT knows Moore's Law, which states that the number of transistors that can be placed inexpensively on an integrated circuit doubles approximately every two years (sometimes 18 months). Named after Intel co-founder Gordon Moore, who first noted the trend in 1965, Moore's Law is testament to the tremendous increase in processing power and the consequent changes in business and society we have seen over the last 47 (and counting) years. While Moore predicted the continuation of this trend "for at least 10 years," current estimates are that this rate of progress will continue to at least 2020. Until, of course, we have the first operational quantum computers, but that's another story.

Processing and Data Go Hand in Hand
With so much processing power at hand, what is it used for? While it's obvious that computers process raw data to produce information, how much data do computers need to process? As it turns out, a lot. IBM says, "Every day, we create 2.5 quintillion bytes of data - so much that 90 percent of the data in the world today has been created in the last two years alone." (See Bringing big data to the enterprise.) Considering that 60 hours of videos are added to YouTube every minute (see: Exclusive: YouTube hits 4 billion daily video views), this doesn't seem to be far off the mark. While it's obvious that those "cute" videos of cats dressed in hats have little business value, a lot of data that is generated everyday does add value to business.

Have you ever wondered how insurance companies that send you promotional mailers seem to know so much about you, your family, your spending habits and your requirements? That's because they store and process data that you give freely through your buying behavior and even public records like births and deaths.

So ubiquitous is this gathering of data and processing it into actionable information that sometimes it can get out of hand. Earlier this year, The New York Times ran an article describing how Target was able to predict pregnancy even before one expectant mother's family got the news. The retailer sent her coupons for baby products, tipping off others in her household to her condition. (See: How Companies Learn Your Secrets.) Data is being collected everywhere. As a Target statistician quoted in the above article said, "If you use a credit card or a coupon, or fill out a survey, or mail in a refund, or call the customer help line, or open an e-mail we've sent you or visit our Web site, we'll record it and link it to your Guest ID (a unique identifier for each customer)."

The computational techniques that allow this can be collectively termed Business Intelligence (BI). This field includes reporting, online analytical processing, analytics, data mining, process mining, complex event processing, business performance management, benchmarking and predictive analytics. In addition to analyzing and predicting human behavior, business intelligence is used in fields as diverse as disaster management, astronomy, oil and gas exploration, and consumer electronics. However, as stated earlier, all these fields have one thing in common - data, lots and lots of it.

A Rare Breed, the Storage Administrator
Who is in charge of all this valuable data? Storage administrators.

Storage administrators are IT specialists that have been safeguarding corporate data for decades. Storage admins have one of the most demanding jobs in IT today. From securing data against unauthorized access and malicious code to granting access to authorized personnel, allocating storage space to approved users, releasing unused space, monitoring operations, and dealing with outages, the storage administrator has a lot on his or her plate. IT staff at large companies field approximately 100,000 storage-related requests every year, spending approximately half an hour or more on each of those tasks. That means a minimum of 30,000 storage administrator staff hours per year spent on storage requests.

Combine this with the present data explosion and the limited IT budgets in today's post-recession economy, and the problem seems insurmountable. Especially when you consider that unlike the amount of data, which is expected to grow by 20 times by 2020 according to Gartner research, the number of storage administrators is expected to increase by only 50 percent in the same period. With a limited supply and exorbitant demand, enterprises will face a tough time hanging onto existing talent, never mind hiring additional storage administrators. Even if they could, salaries in excess of $60,000 are no small change.

According to IDC research, by the year 2020, IT departments will be tasked with managing 50 times the current amount of information with only 1.5 times the number of IT professionals they have today. IDC estimates staff will also be responsible for 75 times the number of files they manage now and 10 times the number of virtual and physical servers. In other words, it is unreasonable to expect storage admins to function optimally under such circumstances.

The Solution - Storage Automation
Dictionary.com defines "automation" as "the technique, method or system of operating or controlling a process by highly automatic means, as by electronic devices, reducing human intervention to a minimum." In every field of human endeavor as man progressed, he has looked toward automation to make life easier, and ideally, storage administration should be no different.

Storage automation cannot only address this talent gap plaguing enterprise IT departments, but it can also make life for storage admins significantly easier. In fact, here's a list of functionalities that storage automation solutions might provide:

  • Full automation - The solution delivers full automation of services without the need for manual intervention. The service portfolio includes:

♦  Provisioning - Allocation of storage space dynamically as per requirement

♦  Reclamation - Optimum utilization of available space by reclaiming unused fragments

♦  Remediation - Disaster recovery in case of outage without affecting normal performance

  • Self-service portal - A portal equipped with proper authentication protocols that allows users to submit and track requests for storage services
  • Storage services catalog - A catalog of fully automated storage services that can be fired up in a few steps without having to go through lengthy authorization procedures
  • Storage classification - The capability to classify storage and storage services, thereby allowing differential service depending on classification
  • Policy-driven services - Ability to define policies that would be applicable to storage services
  • Fully audited services - Tracking of all operations by keeping a record in a secure audit log
  • Charge back/show back - Ability to associate charge back or show back information to both the storage provisioned as well as the storage services performed, synchronized with the accounting system
  • Universal compatibility - Compatibility with multiple hardware vendors such as HP, Dell, Hitachi, etc.
  • Interoperability with other clouds - Interoperability with other clouds, both public and private, using standard application programming interface (API)

Bridging the Storage Admin Gap
Regardless of whether you view the current explosion of data as a blessing, curse, or somewhere in between, everyone can agree that it's a trend that will be with us for the foreseeable future. Our ability to create and store new data will continue to exceed our ability to train professionals to manage that data. Storage automation technology is key for enabling enterprise organizations to scale their storage admin staff to meet the needs of the current and near term data management needs.

More Stories By Brent Rhymes

Brent Rhymes is President of iWave Software, where he is responsible for sales, marketing, product development and operational activities at the company. He has over 18 years of sales and marketing experience in the IT services and computer software industries. He has co-founded two successful technology startups including Knoxville-based FileKeeper, Inc. (sold to Yosemite Technologies in 2006) and Houston-based Software Realization Corporation (sold to NetIQ Corporation in 2000).

Brent has held senior executive positions at NetIQ Corporation, NEON Systems and Scalable Software. He has also held sales and management positions at Microsoft Corporation, IBM and Exxon Company USA. He holds a BS in Computer Science from the University of Tennessee where he graduated with honors and an MBA in Marketing from the University of St. Thomas.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.

@ThingsExpo Stories
Widespread fragmentation is stalling the growth of the IIoT and making it difficult for partners to work together. The number of software platforms, apps, hardware and connectivity standards is creating paralysis among businesses that are afraid of being locked into a solution. EdgeX Foundry is unifying the community around a common IoT edge framework and an ecosystem of interoperable components.
In his session at 21st Cloud Expo, Carl J. Levine, Senior Technical Evangelist for NS1, will objectively discuss how DNS is used to solve Digital Transformation challenges in large SaaS applications, CDNs, AdTech platforms, and other demanding use cases. Carl J. Levine is the Senior Technical Evangelist for NS1. A veteran of the Internet Infrastructure space, he has over a decade of experience with startups, networking protocols and Internet infrastructure, combined with the unique ability to it...
"MobiDev is a software development company and we do complex, custom software development for everybody from entrepreneurs to large enterprises," explained Alan Winters, U.S. Head of Business Development at MobiDev, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
"Space Monkey by Vivent Smart Home is a product that is a distributed cloud-based edge storage network. Vivent Smart Home, our parent company, is a smart home provider that places a lot of hard drives across homes in North America," explained JT Olds, Director of Engineering, and Brandon Crowfeather, Product Manager, at Vivint Smart Home, in this SYS-CON.tv interview at @ThingsExpo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
"IBM is really all in on blockchain. We take a look at sort of the history of blockchain ledger technologies. It started out with bitcoin, Ethereum, and IBM evaluated these particular blockchain technologies and found they were anonymous and permissionless and that many companies were looking for permissioned blockchain," stated René Bostic, Technical VP of the IBM Cloud Unit in North America, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Conventi...
"Akvelon is a software development company and we also provide consultancy services to folks who are looking to scale or accelerate their engineering roadmaps," explained Jeremiah Mothersell, Marketing Manager at Akvelon, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
Coca-Cola’s Google powered digital signage system lays the groundwork for a more valuable connection between Coke and its customers. Digital signs pair software with high-resolution displays so that a message can be changed instantly based on what the operator wants to communicate or sell. In their Day 3 Keynote at 21st Cloud Expo, Greg Chambers, Global Group Director, Digital Innovation, Coca-Cola, and Vidya Nagarajan, a Senior Product Manager at Google, discussed how from store operations and ...
Large industrial manufacturing organizations are adopting the agile principles of cloud software companies. The industrial manufacturing development process has not scaled over time. Now that design CAD teams are geographically distributed, centralizing their work is key. With large multi-gigabyte projects, outdated tools have stifled industrial team agility, time-to-market milestones, and impacted P&L stakeholders.
Gemini is Yahoo’s native and search advertising platform. To ensure the quality of a complex distributed system that spans multiple products and components and across various desktop websites and mobile app and web experiences – both Yahoo owned and operated and third-party syndication (supply), with complex interaction with more than a billion users and numerous advertisers globally (demand) – it becomes imperative to automate a set of end-to-end tests 24x7 to detect bugs and regression. In th...
"Cloud Academy is an enterprise training platform for the cloud, specifically public clouds. We offer guided learning experiences on AWS, Azure, Google Cloud and all the surrounding methodologies and technologies that you need to know and your teams need to know in order to leverage the full benefits of the cloud," explained Alex Brower, VP of Marketing at Cloud Academy, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clar...
"There's plenty of bandwidth out there but it's never in the right place. So what Cedexis does is uses data to work out the best pathways to get data from the origin to the person who wants to get it," explained Simon Jones, Evangelist and Head of Marketing at Cedexis, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
SYS-CON Events announced today that CrowdReviews.com has been named “Media Sponsor” of SYS-CON's 22nd International Cloud Expo, which will take place on June 5–7, 2018, at the Javits Center in New York City, NY. CrowdReviews.com is a transparent online platform for determining which products and services are the best based on the opinion of the crowd. The crowd consists of Internet users that have experienced products and services first-hand and have an interest in letting other potential buye...
SYS-CON Events announced today that Telecom Reseller has been named “Media Sponsor” of SYS-CON's 22nd International Cloud Expo, which will take place on June 5-7, 2018, at the Javits Center in New York, NY. Telecom Reseller reports on Unified Communications, UCaaS, BPaaS for enterprise and SMBs. They report extensively on both customer premises based solutions such as IP-PBX as well as cloud based and hosted platforms.
It is of utmost importance for the future success of WebRTC to ensure that interoperability is operational between web browsers and any WebRTC-compliant client. To be guaranteed as operational and effective, interoperability must be tested extensively by establishing WebRTC data and media connections between different web browsers running on different devices and operating systems. In his session at WebRTC Summit at @ThingsExpo, Dr. Alex Gouaillard, CEO and Founder of CoSMo Software, presented ...
WebRTC is great technology to build your own communication tools. It will be even more exciting experience it with advanced devices, such as a 360 Camera, 360 microphone, and a depth sensor camera. In his session at @ThingsExpo, Masashi Ganeko, a manager at INFOCOM Corporation, introduced two experimental projects from his team and what they learned from them. "Shotoku Tamago" uses the robot audition software HARK to track speakers in 360 video of a remote party. "Virtual Teleport" uses a multip...
A strange thing is happening along the way to the Internet of Things, namely far too many devices to work with and manage. It has become clear that we'll need much higher efficiency user experiences that can allow us to more easily and scalably work with the thousands of devices that will soon be in each of our lives. Enter the conversational interface revolution, combining bots we can literally talk with, gesture to, and even direct with our thoughts, with embedded artificial intelligence, whic...
SYS-CON Events announced today that Evatronix will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Evatronix SA offers comprehensive solutions in the design and implementation of electronic systems, in CAD / CAM deployment, and also is a designer and manufacturer of advanced 3D scanners for professional applications.
Leading companies, from the Global Fortune 500 to the smallest companies, are adopting hybrid cloud as the path to business advantage. Hybrid cloud depends on cloud services and on-premises infrastructure working in unison. Successful implementations require new levels of data mobility, enabled by an automated and seamless flow across on-premises and cloud resources. In his general session at 21st Cloud Expo, Greg Tevis, an IBM Storage Software Technical Strategist and Customer Solution Architec...
To get the most out of their data, successful companies are not focusing on queries and data lakes, they are actively integrating analytics into their operations with a data-first application development approach. Real-time adjustments to improve revenues, reduce costs, or mitigate risk rely on applications that minimize latency on a variety of data sources. In his session at @BigDataExpo, Jack Norris, Senior Vice President, Data and Applications at MapR Technologies, reviewed best practices to ...
An increasing number of companies are creating products that combine data with analytical capabilities. Running interactive queries on Big Data requires complex architectures to store and query data effectively, typically involving data streams, an choosing efficient file format/database and multiple independent systems that are tied together through custom-engineered pipelines. In his session at @BigDataExpo at @ThingsExpo, Tomer Levi, a senior software engineer at Intel’s Advanced Analytics gr...