Software defined storage

CCTV Handbook 2015 IT infrastructure

Software Defined Storage (SDS) is the new buzz phrase in the cloud world and as usual, vendor after vendor is jumping on it. In the case of storage, you have ‘system’ vendors on one side looking to defend their proprietary stance whilst newer, software-only companies look to turn storage hardware into a commodity. For those with an interest in data management, it begs the question ‘will software defined storage replace data management?’

Bryan Balfe, channel manager at CommVault in South Africa.
Bryan Balfe, channel manager at CommVault in South Africa.

Before we can decide that, we need to get a definition of SDS itself, and because it’s a new field that’s currently more of a direction than actual product, that’s where it gets tricky.

Analysts such as Gartner and IDC have their definitions and vendors with an interest in this space have theirs, each coming from a different direction. For the most part, it’s defined as automation that can set the appropriate storage volume size, performance, redundancy and access required by workloads or applications based on policy.

The bottom line is it enables data mobility to match the virtual server technology using it. It may even define some levels of protection such as replication and snapshots and can blur into wider orchestration because it still relies on networks and servers to work – doing all three add up to defining much of data centre with software – a panacea for many organisations which have invested heavily in cloud technologies.

Data management

The next challenge is defining data management and where it overlaps with the ambitions of SDS. Some hardware vendors would have you believe that snapshots and replication are as far as you need to go and while these companies have some very capable (and important) tools in this space, snapshots and replication clearly don’t answer the challenges of data growth, long term retention, access and compliance.

The current thrust of SDS development is following this same path, so in the future it may be possible for SDS technology and commodity storage to offer similar functions to proprietary setups, but at lower cost. This presents the market with more choice and will ultimately help to lower platform costs.

We can safely say that, at least in the early days of the technology, the real overlap between SDS and data management will be firmly in the traditional hardware vendor space in most cases and additionally where virtualisation typically plays with the storage and protection mechanisms too.

However, handing snapshot control to a data management software layer at the point that snapshots are created has a huge number of benefits, just one of which is an element of custody.

Custody of data

What does the issue of custody of the data mean? Custody normally refers to the owner or manager of the data in personnel or departmental terms. Here, I’m referring to data management software and have specifically used the word custody because it alludes to knowledge of the original context of the data (what it is, its value etc.) and what happens to it down the line such as where it goes and the security at rest and in transit.

For example, knowing a snapshot of a virtual server contains an Exchange email store means you can process it in a specific way that streamlines tasks such as indexing and deduplication and also allows for one-stage granular restore. This last point is important as many storage admins are left to recover whole volumes to scratch disk before manually sieving and plucking out the required mail or attachment if the data no longer resides on a disk snapshot.

There are also other functions that can be carried out from snapshot copies, such as archiving. Most people associate this as a function acted on by the primary system via an agent but there are a number of advantages of doing it in the protection tier instead; avoiding disk intensive and lengthy file scans on the primary storage being just one of them.

What happens after the snapshot is important and while no one in the SDS world is suggesting that SDS technology will go much beyond that currently, data management processes that are initiated after the snap will always have a disadvantage over data management software that looks after snapshot initiation as well.

So is control of the snapshot the battleground between SDS and data management software? It could be in many cases but it need not be in all cases. When you analyse what’s actually going on, there are a number of distinct functions taking place that have a natural division of labour.

Most of the snapshot engines today create only ‘crash consistent’ snapshots, whereas data management software combined with the same engine can manage application data to guarantee its integrity and ultimately its recoverability, as well as add value with functions like indexing.

Storage flexibility

There is no doubt that SDS will have a growing impact on primary storage flexibility and some first line protection processes, which will worry many array vendors. The benefit of orchestrating an abstracted heterogeneous pool of storage in an automated fashion, based on rules with one foot in the business, is an attractive one. The fact is that it’s not a reality yet and many companies with big budgets are working to actively hinder its progress, or at least keep you locked in to their flavour of it.

The orchestration goals of SDS may still be some way off but the control of heterogeneous storage snap engines and automation based on classes of service and workloads is already here. Combining that level of management with the ability to maintain the context of the original data and move it through different tiers based on policy is very powerful indeed.

For more information contact Bryan Balfe, CommVault, +27 (0)11 510 0047, [email protected]





Share this article:
Share via emailShare via LinkedInPrint this page



Further reading:

Cyber resilience is more than cybersecurity
Technews Publishing Cyber Security Integrated Solutions IT infrastructure
Hi-Tech Security Solutions held a round-table discussion focusing on cyber resilience and found that while the resilience discipline includes cybersecurity, it also goes much further.

Read more...
Reliable, low-maintenance video appliances
Technews Publishing Editor's Choice CCTV, Surveillance & Remote Monitoring News IT infrastructure Products
Symetrix, part of the Agera Group, has added the AES range of video recording servers, storage appliances and workstations to its portfolio.

Read more...
Infinidat a leader in ransomware protection
IT infrastructure Products
InfiniSafe brings together the key foundational requirements essential for delivering comprehensive cyber-recovery capabilities with immutable snapshots, logical air-gapped protection, a fenced forensic network, and near-instantaneous recovery of backups of any repository size.

Read more...
What’s the difference between SASE, SD-WAN and SSE?
IT infrastructure
When it comes to the wide area network (WAN), the letter ‘S’ plays a pivotal role – from SASE to SD-WAN to SSE – but there can be some confusion with so many WAN ‘S’ acronyms.

Read more...
Cold chain integrity in real time
Technews Publishing Editor's Choice Asset Management, EAS, RFID IT infrastructure Transport (Industry) Logistics (Industry)
DeltaTrak offers real-time farm-to-fork IoT monitoring of the cold chain to ensure every step of the journey is recorded and verifiable via the cloud.

Read more...
BCX and Alibaba Cloud confirm partnership
News IT infrastructure
BCX and Alibaba Cloud have formed a partnership to bring cloud technologies to businesses in South Africa to drive local digitalisation.

Read more...
IoV – the cutting edge of vehicle automation
Integrated Solutions IT infrastructure Transport (Industry) Logistics (Industry)
Today’s cars have become bona fide connected machines and not merely an extension of our mobile devices such as smartphones.

Read more...
Advanced technologies to curb corruption
News Cyber Security IT infrastructure
The use of advanced technology to curb fraud, corruption and cyber-related crimes received a massive boost as the Council for Scientific and Industrial Research (CSIR) and Special Investigation Unit (SIU) agreed to work together.

Read more...
DMaaS is the solution to hybrid cloud complexity woes
IT infrastructure
After an initial scramble to move everything to the cloud, companies are increasingly moving to a hybrid cloud environment, with a mix of private and public cloud infrastructure and services, coupled with on-premises storage.

Read more...
The current and future state of smart OT security
Technews Publishing Industrial (Industry) Cyber Security IT infrastructure
Nearly 60% of survey respondents also revealed that their organisation suffered at least one OT breach during the past 12 months, with 10% experiencing four or more.

Read more...