Open Source Cloud Authors: Elizabeth White, Rostyslav Demush, Pat Romanski, Liz McMillan, Yeshim Deniz

Related Topics: @CloudExpo, Microservices Expo, Open Source Cloud, Containers Expo Blog, Apache

@CloudExpo: Article

Can’t Find Enough Storage Admins to Run Your Business? Automate

Bridging the Storage Admin Gap

Everyone in IT knows Moore's Law, which states that the number of transistors that can be placed inexpensively on an integrated circuit doubles approximately every two years (sometimes 18 months). Named after Intel co-founder Gordon Moore, who first noted the trend in 1965, Moore's Law is testament to the tremendous increase in processing power and the consequent changes in business and society we have seen over the last 47 (and counting) years. While Moore predicted the continuation of this trend "for at least 10 years," current estimates are that this rate of progress will continue to at least 2020. Until, of course, we have the first operational quantum computers, but that's another story.

Processing and Data Go Hand in Hand
With so much processing power at hand, what is it used for? While it's obvious that computers process raw data to produce information, how much data do computers need to process? As it turns out, a lot. IBM says, "Every day, we create 2.5 quintillion bytes of data - so much that 90 percent of the data in the world today has been created in the last two years alone." (See Bringing big data to the enterprise.) Considering that 60 hours of videos are added to YouTube every minute (see: Exclusive: YouTube hits 4 billion daily video views), this doesn't seem to be far off the mark. While it's obvious that those "cute" videos of cats dressed in hats have little business value, a lot of data that is generated everyday does add value to business.

Have you ever wondered how insurance companies that send you promotional mailers seem to know so much about you, your family, your spending habits and your requirements? That's because they store and process data that you give freely through your buying behavior and even public records like births and deaths.

So ubiquitous is this gathering of data and processing it into actionable information that sometimes it can get out of hand. Earlier this year, The New York Times ran an article describing how Target was able to predict pregnancy even before one expectant mother's family got the news. The retailer sent her coupons for baby products, tipping off others in her household to her condition. (See: How Companies Learn Your Secrets.) Data is being collected everywhere. As a Target statistician quoted in the above article said, "If you use a credit card or a coupon, or fill out a survey, or mail in a refund, or call the customer help line, or open an e-mail we've sent you or visit our Web site, we'll record it and link it to your Guest ID (a unique identifier for each customer)."

The computational techniques that allow this can be collectively termed Business Intelligence (BI). This field includes reporting, online analytical processing, analytics, data mining, process mining, complex event processing, business performance management, benchmarking and predictive analytics. In addition to analyzing and predicting human behavior, business intelligence is used in fields as diverse as disaster management, astronomy, oil and gas exploration, and consumer electronics. However, as stated earlier, all these fields have one thing in common - data, lots and lots of it.

A Rare Breed, the Storage Administrator
Who is in charge of all this valuable data? Storage administrators.

Storage administrators are IT specialists that have been safeguarding corporate data for decades. Storage admins have one of the most demanding jobs in IT today. From securing data against unauthorized access and malicious code to granting access to authorized personnel, allocating storage space to approved users, releasing unused space, monitoring operations, and dealing with outages, the storage administrator has a lot on his or her plate. IT staff at large companies field approximately 100,000 storage-related requests every year, spending approximately half an hour or more on each of those tasks. That means a minimum of 30,000 storage administrator staff hours per year spent on storage requests.

Combine this with the present data explosion and the limited IT budgets in today's post-recession economy, and the problem seems insurmountable. Especially when you consider that unlike the amount of data, which is expected to grow by 20 times by 2020 according to Gartner research, the number of storage administrators is expected to increase by only 50 percent in the same period. With a limited supply and exorbitant demand, enterprises will face a tough time hanging onto existing talent, never mind hiring additional storage administrators. Even if they could, salaries in excess of $60,000 are no small change.

According to IDC research, by the year 2020, IT departments will be tasked with managing 50 times the current amount of information with only 1.5 times the number of IT professionals they have today. IDC estimates staff will also be responsible for 75 times the number of files they manage now and 10 times the number of virtual and physical servers. In other words, it is unreasonable to expect storage admins to function optimally under such circumstances.

The Solution - Storage Automation
Dictionary.com defines "automation" as "the technique, method or system of operating or controlling a process by highly automatic means, as by electronic devices, reducing human intervention to a minimum." In every field of human endeavor as man progressed, he has looked toward automation to make life easier, and ideally, storage administration should be no different.

Storage automation cannot only address this talent gap plaguing enterprise IT departments, but it can also make life for storage admins significantly easier. In fact, here's a list of functionalities that storage automation solutions might provide:

  • Full automation - The solution delivers full automation of services without the need for manual intervention. The service portfolio includes:

♦  Provisioning - Allocation of storage space dynamically as per requirement

♦  Reclamation - Optimum utilization of available space by reclaiming unused fragments

♦  Remediation - Disaster recovery in case of outage without affecting normal performance

  • Self-service portal - A portal equipped with proper authentication protocols that allows users to submit and track requests for storage services
  • Storage services catalog - A catalog of fully automated storage services that can be fired up in a few steps without having to go through lengthy authorization procedures
  • Storage classification - The capability to classify storage and storage services, thereby allowing differential service depending on classification
  • Policy-driven services - Ability to define policies that would be applicable to storage services
  • Fully audited services - Tracking of all operations by keeping a record in a secure audit log
  • Charge back/show back - Ability to associate charge back or show back information to both the storage provisioned as well as the storage services performed, synchronized with the accounting system
  • Universal compatibility - Compatibility with multiple hardware vendors such as HP, Dell, Hitachi, etc.
  • Interoperability with other clouds - Interoperability with other clouds, both public and private, using standard application programming interface (API)

Bridging the Storage Admin Gap
Regardless of whether you view the current explosion of data as a blessing, curse, or somewhere in between, everyone can agree that it's a trend that will be with us for the foreseeable future. Our ability to create and store new data will continue to exceed our ability to train professionals to manage that data. Storage automation technology is key for enabling enterprise organizations to scale their storage admin staff to meet the needs of the current and near term data management needs.

More Stories By Brent Rhymes

Brent Rhymes is President of iWave Software, where he is responsible for sales, marketing, product development and operational activities at the company. He has over 18 years of sales and marketing experience in the IT services and computer software industries. He has co-founded two successful technology startups including Knoxville-based FileKeeper, Inc. (sold to Yosemite Technologies in 2006) and Houston-based Software Realization Corporation (sold to NetIQ Corporation in 2000).

Brent has held senior executive positions at NetIQ Corporation, NEON Systems and Scalable Software. He has also held sales and management positions at Microsoft Corporation, IBM and Exxon Company USA. He holds a BS in Computer Science from the University of Tennessee where he graduated with honors and an MBA in Marketing from the University of St. Thomas.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.

@ThingsExpo Stories
It is of utmost importance for the future success of WebRTC to ensure that interoperability is operational between web browsers and any WebRTC-compliant client. To be guaranteed as operational and effective, interoperability must be tested extensively by establishing WebRTC data and media connections between different web browsers running on different devices and operating systems. In his session at WebRTC Summit at @ThingsExpo, Dr. Alex Gouaillard, CEO and Founder of CoSMo Software, presented ...
WebRTC is great technology to build your own communication tools. It will be even more exciting experience it with advanced devices, such as a 360 Camera, 360 microphone, and a depth sensor camera. In his session at @ThingsExpo, Masashi Ganeko, a manager at INFOCOM Corporation, introduced two experimental projects from his team and what they learned from them. "Shotoku Tamago" uses the robot audition software HARK to track speakers in 360 video of a remote party. "Virtual Teleport" uses a multip...
Business professionals no longer wonder if they'll migrate to the cloud; it's now a matter of when. The cloud environment has proved to be a major force in transitioning to an agile business model that enables quick decisions and fast implementation that solidify customer relationships. And when the cloud is combined with the power of cognitive computing, it drives innovation and transformation that achieves astounding competitive advantage.
Data is the fuel that drives the machine learning algorithmic engines and ultimately provides the business value. In his session at Cloud Expo, Ed Featherston, a director and senior enterprise architect at Collaborative Consulting, discussed the key considerations around quality, volume, timeliness, and pedigree that must be dealt with in order to properly fuel that engine.
IoT is rapidly becoming mainstream as more and more investments are made into the platforms and technology. As this movement continues to expand and gain momentum it creates a massive wall of noise that can be difficult to sift through. Unfortunately, this inevitably makes IoT less approachable for people to get started with and can hamper efforts to integrate this key technology into your own portfolio. There are so many connected products already in place today with many hundreds more on the h...
When shopping for a new data processing platform for IoT solutions, many development teams want to be able to test-drive options before making a choice. Yet when evaluating an IoT solution, it’s simply not feasible to do so at scale with physical devices. Building a sensor simulator is the next best choice; however, generating a realistic simulation at very high TPS with ease of configurability is a formidable challenge. When dealing with multiple application or transport protocols, you would be...
Detecting internal user threats in the Big Data eco-system is challenging and cumbersome. Many organizations monitor internal usage of the Big Data eco-system using a set of alerts. This is not a scalable process given the increase in the number of alerts with the accelerating growth in data volume and user base. Organizations are increasingly leveraging machine learning to monitor only those data elements that are sensitive and critical, autonomously establish monitoring policies, and to detect...
In his keynote at 18th Cloud Expo, Andrew Keys, Co-Founder of ConsenSys Enterprise, provided an overview of the evolution of the Internet and the Database and the future of their combination – the Blockchain. Andrew Keys is Co-Founder of ConsenSys Enterprise. He comes to ConsenSys Enterprise with capital markets, technology and entrepreneurial experience. Previously, he worked for UBS investment bank in equities analysis. Later, he was responsible for the creation and distribution of life settl...
In his session at @ThingsExpo, Dr. Robert Cohen, an economist and senior fellow at the Economic Strategy Institute, presented the findings of a series of six detailed case studies of how large corporations are implementing IoT. The session explored how IoT has improved their economic performance, had major impacts on business models and resulted in impressive ROIs. The companies covered span manufacturing and services firms. He also explored servicification, how manufacturing firms shift from se...
DevOpsSummit New York 2018, colocated with CloudEXPO | DXWorldEXPO New York 2018 will be held November 11-13, 2018, in New York City. Digital Transformation (DX) is a major focus with the introduction of DXWorldEXPO within the program. Successful transformation requires a laser focus on being data-driven and on using all the tools available that enable transformation if they plan to survive over the long term. A total of 88% of Fortune 500 companies from a generation ago are now out of bus...
The Jevons Paradox suggests that when technological advances increase efficiency of a resource, it results in an overall increase in consumption. Writing on the increased use of coal as a result of technological improvements, 19th-century economist William Stanley Jevons found that these improvements led to the development of new ways to utilize coal. In his session at 19th Cloud Expo, Mark Thiele, Chief Strategy Officer for Apcera, compared the Jevons Paradox to modern-day enterprise IT, examin...
IoT solutions exploit operational data generated by Internet-connected smart “things” for the purpose of gaining operational insight and producing “better outcomes” (for example, create new business models, eliminate unscheduled maintenance, etc.). The explosive proliferation of IoT solutions will result in an exponential growth in the volume of IoT data, precipitating significant Information Governance issues: who owns the IoT data, what are the rights/duties of IoT solutions adopters towards t...
Amazon started as an online bookseller 20 years ago. Since then, it has evolved into a technology juggernaut that has disrupted multiple markets and industries and touches many aspects of our lives. It is a relentless technology and business model innovator driving disruption throughout numerous ecosystems. Amazon’s AWS revenues alone are approaching $16B a year making it one of the largest IT companies in the world. With dominant offerings in Cloud, IoT, eCommerce, Big Data, AI, Digital Assista...
Organizations planning enterprise data center consolidation and modernization projects are faced with a challenging, costly reality. Requirements to deploy modern, cloud-native applications simultaneously with traditional client/server applications are almost impossible to achieve with hardware-centric enterprise infrastructure. Compute and network infrastructure are fast moving down a software-defined path, but storage has been a laggard. Until now.
Digital Transformation is much more than a buzzword. The radical shift to digital mechanisms for almost every process is evident across all industries and verticals. This is often especially true in financial services, where the legacy environment is many times unable to keep up with the rapidly shifting demands of the consumer. The constant pressure to provide complete, omnichannel delivery of customer-facing solutions to meet both regulatory and customer demands is putting enormous pressure on...
In his general session at 19th Cloud Expo, Manish Dixit, VP of Product and Engineering at Dice, discussed how Dice leverages data insights and tools to help both tech professionals and recruiters better understand how skills relate to each other and which skills are in high demand using interactive visualizations and salary indicator tools to maximize earning potential. Manish Dixit is VP of Product and Engineering at Dice. As the leader of the Product, Engineering and Data Sciences team at D...
DXWorldEXPO LLC announced today that All in Mobile, a mobile app development company from Poland, will exhibit at the 22nd International CloudEXPO | DXWorldEXPO. All In Mobile is a mobile app development company from Poland. Since 2014, they maintain passion for developing mobile applications for enterprises and startups worldwide.
"Akvelon is a software development company and we also provide consultancy services to folks who are looking to scale or accelerate their engineering roadmaps," explained Jeremiah Mothersell, Marketing Manager at Akvelon, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
IoT is at the core or many Digital Transformation initiatives with the goal of re-inventing a company's business model. We all agree that collecting relevant IoT data will result in massive amounts of data needing to be stored. However, with the rapid development of IoT devices and ongoing business model transformation, we are not able to predict the volume and growth of IoT data. And with the lack of IoT history, traditional methods of IT and infrastructure planning based on the past do not app...
DXWorldEXPO LLC announced today that the upcoming DXWorldEXPO | CloudEXPO New York event will feature 10 companies from Poland to participate at the "Poland Digital Transformation Pavilion" on November 12-13, 2018.