Is AI the key to managing rampant data storage costs?

June 2019 IT infrastructure

We are currently living in a data economy, where a businesses’ competitive advantage stems from its ability to analyse data, improve customer experience and decision-making. As this data increases, due to the advent of emerging technologies and applications, it is simultaneously opening up additional possibilities. If data is at the core of our competitive edge, operating this data cost-efficiently and with high performance is the new business imperative. Fortunately, Artificial Intelligence (AI) in the form of learning algorithms can help organisations improve data performance and mitigate the increasing cost of storing vast and ever-growing volumes of data.

Eran Brown
Eran Brown

Dealing with data the traditional way

The traditional approach to data storage is to place data that is currently being used into a high-performance production environment. This ecosystem is usually made up of a variety of different storage media, including Flash Array (AFA) and separate, isolated secondary storage arrays. However, by taking a conventional approach to storing data, the greater the performance required, the more expensive media is needed.

In a digital economy this method poses a number of challenges. Firstly, it creates silos of data, as multiple solutions are deployed spanning a variety of media thereby increasing complexity and costs while reducing business performance. Moreover, each silo will have its own capacity, which cannot be accessed by any other silo. When more capacity is required it must be added in reactively, further driving up costs and due to the time taken to implement, reducing business responsiveness.

Secondly, it cannot easily cater for changes to production or mission critical data. As a result, organisations will need to maintain large repositories of high-performance storage to ensure that all data that may be needed can be accessed quickly.

AI – delivering agility, performance and lower costs

The critical element that is missing from traditional data storage infrastructure is agility - the ability to respond quickly to change in demand. Until now, the only way to guarantee high-performance was to spend large sums of money on expensive storage tiers. This is simply not a financially viable option given the cost involved, nor is it the most sophisticated approach. However, AI could be the missing link in this scenario and provide the required agility and assist IT managers to reduce their storage spend. So, how exactly can AI assist?

AI-driven learning algorithms can revolutionise the way businesses manage data storage. These algorithms respond in real time to dynamically changing workloads, supplying non-stop performance optimisation for your data. Consequently, many inputs/outputs (I/Os) are then delivered via RAM, which is up to 100 times faster than flash. The result is that the business can maintain its data in cost effective hardware, while obtaining speed and performance superior to that of AFAs, at a fraction of the cost.

But… how?

No organisation uses 100% of its data 100% of the time – data is only processed in subsets, and at any given second the amount of data requiring high performance is quite small. Yet, these subsets are constantly changing. Learning algorithms respond in real-time to track what is being used and dynamically move the active data sets into RAM predictively and proactively, using AI to determine what data will be required based on past history.

The result is that virtually all data reads and writes can be processed using RAM, while the cost of storage is alleviated thanks to the ability to use low-cost disks without compromising performance.

Every new technology evolution and business application generates more data, which can be used to drive competitive advantage, but only if it can be stored and accessed effectively. AI and learning algorithms are the answer to maximising data performance and optimising the storage media mix, to reduce the total cost of data storage and increase business agility.

Share this article:
Share via emailShare via LinkedInPrint this page

Further reading:

A platform to the future
June 2019, Genetec, Cathexis Technologies, Milestone Systems, Gijima Electronic and Security Systems (GESS) , Integrated Solutions, CCTV, Surveillance & Remote Monitoring, IT infrastructure
With AI, IoT and cloud changing the security technology landscape, will your security management platform be able to adapt to new demands?

Hyper-converged simplicity
June 2019 , IT infrastructure, CCTV, Surveillance & Remote Monitoring
Hyper-converged infrastructure combines all of the data centre’s critical components, such as storage, networking, compute, backup and more into pre-packaged units.

AI and cloud for sustainable buildings
June 2019, Johnson Controls , Commercial (Industry), Integrated Solutions, IT infrastructure
Bee’ah’s sustainable headquarters will be infused with artificial intelligence across systems and spaces, including a digital concierge for every occupant and visitor.

Netgear Armor on Orbi Wi-Fi
June 2019, Duxbury Networking , Home Security, Cyber Security, IT infrastructure
Netgear has announced the worldwide availability of Netgear Armor Cyber Threat Protection, powered by Bitdefender, on Orbi Wi-Fi mesh systems, to protect home IT and IoT devices.

KYD: Know Your Data
June 2019, Technews Publishing , IT infrastructure, Security Services & Risk Management
Organisations need to know what information they have, why they collected it, and they need to adhere to regulations about how long they can or must keep it before deleting it.

The importance of BC and DR
June 2019 , IT infrastructure, Security Services & Risk Management
Organisations need to realise that business continuity and disaster recovery entail entirely different strategies with both being vital to keeping a business operational.

Building a zero trust environment
June 2019, Axiz , IT infrastructure, Integrated Solutions
People are the new perimeter and identity is at the very core of maintaining a secure, trusted environment.

Data solution for the mining digital revolution
June 2019 , IT infrastructure, Security Services & Risk Management
The ability to analyse and derive intelligence from vast amounts of data generated across the various aspects of any mine is a revolution in this sector.

Does your control room add value?
May 2019, Fidelity Security Group, G4S South Africa, Progroup , Editor's Choice, CCTV, Surveillance & Remote Monitoring, Integrated Solutions, IT infrastructure, Commercial (Industry)
Whether on- or offsite, control rooms are a critical aspect of security today and care must be taken in the design and rollout of these nerve centres.

Huawei’s Platform + Ecosystem strategy for 2019
May 2019, Huawei Technologies South Africa , News, Integrated Solutions, IT infrastructure, Conferences & Events
The annual Huawei Eco Connect event took place at the Sandton Convention Centre in Johannesburg and saw more than a 1000 attendees and housed exhibition stands from an array of partners.