Is AI the key to managing rampant data storage costs?

1 June 2019 Infrastructure

We are currently living in a data economy, where a businesses’ competitive advantage stems from its ability to analyse data, improve customer experience and decision-making. As this data increases, due to the advent of emerging technologies and applications, it is simultaneously opening up additional possibilities. If data is at the core of our competitive edge, operating this data cost-efficiently and with high performance is the new business imperative. Fortunately, Artificial Intelligence (AI) in the form of learning algorithms can help organisations improve data performance and mitigate the increasing cost of storing vast and ever-growing volumes of data.

Eran Brown
Eran Brown

Dealing with data the traditional way

The traditional approach to data storage is to place data that is currently being used into a high-performance production environment. This ecosystem is usually made up of a variety of different storage media, including Flash Array (AFA) and separate, isolated secondary storage arrays. However, by taking a conventional approach to storing data, the greater the performance required, the more expensive media is needed.

In a digital economy this method poses a number of challenges. Firstly, it creates silos of data, as multiple solutions are deployed spanning a variety of media thereby increasing complexity and costs while reducing business performance. Moreover, each silo will have its own capacity, which cannot be accessed by any other silo. When more capacity is required it must be added in reactively, further driving up costs and due to the time taken to implement, reducing business responsiveness.

Secondly, it cannot easily cater for changes to production or mission critical data. As a result, organisations will need to maintain large repositories of high-performance storage to ensure that all data that may be needed can be accessed quickly.

AI – delivering agility, performance and lower costs

The critical element that is missing from traditional data storage infrastructure is agility - the ability to respond quickly to change in demand. Until now, the only way to guarantee high-performance was to spend large sums of money on expensive storage tiers. This is simply not a financially viable option given the cost involved, nor is it the most sophisticated approach. However, AI could be the missing link in this scenario and provide the required agility and assist IT managers to reduce their storage spend. So, how exactly can AI assist?

AI-driven learning algorithms can revolutionise the way businesses manage data storage. These algorithms respond in real time to dynamically changing workloads, supplying non-stop performance optimisation for your data. Consequently, many inputs/outputs (I/Os) are then delivered via RAM, which is up to 100 times faster than flash. The result is that the business can maintain its data in cost effective hardware, while obtaining speed and performance superior to that of AFAs, at a fraction of the cost.

But… how?

No organisation uses 100% of its data 100% of the time – data is only processed in subsets, and at any given second the amount of data requiring high performance is quite small. Yet, these subsets are constantly changing. Learning algorithms respond in real-time to track what is being used and dynamically move the active data sets into RAM predictively and proactively, using AI to determine what data will be required based on past history.

The result is that virtually all data reads and writes can be processed using RAM, while the cost of storage is alleviated thanks to the ability to use low-cost disks without compromising performance.

Every new technology evolution and business application generates more data, which can be used to drive competitive advantage, but only if it can be stored and accessed effectively. AI and learning algorithms are the answer to maximising data performance and optimising the storage media mix, to reduce the total cost of data storage and increase business agility.





Share this article:
Share via emailShare via LinkedInPrint this page



Further reading:

Short-range indoor LiDAR sensor
OPTEX Perimeter Security, Alarms & Intruder Detection Infrastructure Products & Solutions
The REDSCAN Lite RLS-1010L has been developed to provide comprehensive coverage and protect high-risk security zones and vulnerable, narrow indoor spaces that are difficult to protect with traditional sensors.

Read more...
Understanding shared responsibility
Infrastructure
Data management is increasingly coming under the governance spotlight, yet a significant vulnerability often goes unnoticed. Many businesses operating on Microsoft 365 assume their data is comprehensively backed up.

Read more...
Direct-to-cloud surveillance platform
Surveillance Infrastructure
Oncam has announced a forthcoming end-to-end, direct-to-cloud video platform that combines AI-enabled cameras, intelligent IoT devices, and cloud-integrated video management software to deliver smarter performance with reduced complexity.

Read more...
Local-first data security is South Africa's new digital fortress
Infrastructure Information Security
With many global conversations taking place about data security and privacy, a distinct and powerful message is emerging from South Africa: the critical importance of a 'local first' approach to data security.

Read more...
Software security is a team sport
Information Security Infrastructure
Building and maintaining secure software is not a one-team effort; it requires the collective strength and collaboration of security, engineering, and operations teams.

Read more...
Data resilience at VeeamON
Technews Publishing SMART Security Solutions Infrastructure Information Security
SMART Security Solutions attended the VeeamON Tour in Johannesburg in August to learn more about data resilience and Veeam’s initiatives to enhance data protection, both on-site and in the cloud.

Read more...
Troye exposes the Entra ID backup blind spot
Information Security Infrastructure
If you trust Microsoft to protect your identity, think again. Many organisations naively believe that Microsoft’s shared responsibility model covers Microsoft Entra?ID – formerly Azure AD – but it does not.

Read more...
Secure data protection without hardware lock-in
Infrastructure Information Security News & Events
New Veeam Software Appliance empowers IT teams to achieve instant protection with Veeam’s fully preconfigured, software-only appliance, delivering enterprise-ready simplified deployment and operational efficiency, robust cyber resilience.

Read more...
Hytera supports communication upgrade for Joburg
News & Events Infrastructure Government and Parastatal (Industry)
By equipping Johannesburg’s metro police and emergency services with multimode radios which integrate TETRA and LTE networks, Hytera is bridging coverage gaps and improving response times across the city.

Read more...
Combining TETRA or DMR with 5G broadband
Infrastructure IoT & Automation
As enterprises face rising complexity and connectivity demands, hybrid networks offer a transformative path, combining the proven reliability of TETRA or DMR with the innovation and coverage of 5G broadband.

Read more...










While every effort has been made to ensure the accuracy of the information contained herein, the publisher and its agents cannot be held responsible for any errors contained, or any loss incurred as a result. Articles published do not necessarily reflect the views of the publishers. The editor reserves the right to alter or cut copy. Articles submitted are deemed to have been cleared for publication. Advertisements and company contact details are published as provided by the advertiser. Technews Publishing (Pty) Ltd cannot be held responsible for the accuracy or veracity of supplied material.




© Technews Publishing (Pty) Ltd. | All Rights Reserved.