For StorPool, it’s a never-ending mission to provide the best software-defined block storage on the market. We are really excited to be featured on Architecting IT. In this series of posts, you’ll learn more about StorPool’s technology, with a hands-on and in-depth look at how the distributed storage architecture works, how it performs, and how it integrates into an on-premises public cloud strategy.
In the final post in the series, we’ll see how StorPool compares with other solutions in the marketplace – Commvault Distributed Storage (Hedvig), Ceph, Microsoft Storage Spaces Direct (S2D), and Dell PowerFlex.
Background
The last twenty years has seen significant evolution in the storage market. At the turn of the new millennium, storage arrays or appliances were the primary way in which persistent storage resources were attached to multiple servers and applications. Fibre Channel drove the adoption of this architecture, which removed the distance and other physical challenges of directly attached SCSI connections. Storage Area Networks and storage arrays provided resilient, efficient, and more manageable storage than was achieved with hard drives in individual servers.
Evolution
Of course, technology never stands still, and the benefits of shared storage began to represent challenges to the deployment of infrastructure. Fibre Channel was seen as complicated and expensive while representing a second physical network that had to be deployed just for storage.
Performance hard disk drives have been superseded by NAND flash, while NVMe has been adopted as a modern storage protocol to remove the overheads and bottlenecks of SAS and SATA. Storage vendors are now starting to adopt persistent memory as yet another tier in the storage hierarchy.
Software-Defined
Probably the most significant change for the industry has been the move towards software-defined storage (SDS). All modern storage solutions are now essentially software-defined, with little or no dedicated firmware and a widespread use of commodity (or off the shelf) components. This transition means the capabilities of software are where new storage features are implemented, generally exploiting the capabilities of hardware and mitigating specific media characteristics (such as SMR and zoned NAND).
Symbiosis
The move to software-defined hasn’t resulted in a widespread divergence of hardware and software that could have been expected a decade ago. The bifurcation of the storage array has allowed vendors to offer support for pre-validated hardware configurations while focusing on the software side as the place for feature evolution. New hardware components such as persistent memory mean that the interoperability between software and hardware is more important than ever. As a case in point, storage solution vendors have started a move towards software-only sales, with certified hardware delivered through partners. This is as much a financial sleight of hand as a technical one.
Choices
A decade ago, software-defined storage was almost a novelty and a technology for enthusiasts looking to save money by building their own solutions.
Today, there is no difference between the packaged appliances sold by the likes of Dell and HPE and those built from software-defined storage. Arguably, modern SDS offers the flexibility of hardware choice without the inevitable lag of vendor-supplied hardware.
Comparisons
How does the modern shared storage experience fit in with the features and functionality offered by StorPool? First, we should set some categorisation for comparison. Modern storage should provide features in the following broad categories:
- Architecture – features designed to offer flexibility of deployment, the ability to use modern infrastructure (both storage and networking), plus support for a wide range of modern data protocols.
- Data Availability/Resiliency – features like on-disk checksums, automated failure detection and recovery, non-disruptive upgrades, data replication and snapshots/clones.
- Data Efficiency – thin provisioning, compression/dedupe, thin provisioning.
- Data Management – quality of service, native platform support (virtualisation and containerisation), storage tiering, data tiering and locality, storage pools.
- Operations Management – CLIs and APIs, mature and extensive data collection and analysis tools.
- Performance – offer high performance in terms of throughput, with low latency. Any performance capabilities should fully exploit the abilities of the underlying media.
In evaluating solutions, the most obvious route is to compare similar SDS offerings. This method does give a good view to IT organisations looking to compare one architectural design. However, in modern infrastructure, traditional SANs can now easily be replaced by SDS solutions such as StorPool. As a result, it makes sense to compare StorPool with the broader market.
Appliances
The storage appliance market continues to be dominated by Dell, HPE, NetApp, IBM, Hitachi and Pure Storage. However, this market has been flat in revenue terms for years. Product evolution has been limited, with “newcomers” such as Pure Storage releasing new products and solutions while others re-invent or rehash their existing solutions.
This approach by vendors is fascinating to explore. Dell/EMC focuses on PowerMax (Symmetrix evolved from 30 years ago) and PowerStore (legacy Clariion/VNX/Unity heritage) yet has arguably underdeveloped solutions like PowerFlex available in its portfolio. NetApp continues to sell ONTAP, the original storage appliance software developed in the early 1990s. IBM sells either DS series (based on PowerPC) from 30 years ago or FlashSystem based on 20+ year-old SVC technology. Curiously, Infinidat, with consistent year-on-year growth, still doesn’t appear in analyst sales’ ratings.
How can we compare StorPool (or any SDS solution) with these vendor products? Architecturally, none of these solutions is designed for true scale-out or a cloud-based infrastructure model. However, functionally, most have a more comprehensive set of storage-based features than StorPool. For example, offering de-duplication, compression, or RAID-based resiliency (rather than mirroring). But when positioned for scale-out cloud infrastructure, StorPool offers greater integration and manageability than any of the appliance-based solutions.
Vendors such as StorPool will continue to gain share with MSPs and enterprises that have a greater bias and need for cloud-like functionality and scale-out, rather than cost-saving data efficiency features, so any comparisons need to reflect the requirements of the end-user.
SDS
Software-defined storage offers much more to service providers and enterprises looking to emulate the public cloud. Hardware is disaggregated from the discussion, as most solutions use off-the-shelf components rather than bespoke hardware designs. We compared StorPool with four popular SDS solutions in the market and summarised the results in individual radar charts.
StorPool comparison
As Architecting IT has highlighted before, the solution is perhaps an undiscovered gem in the storage world. The technology fits well with the service provider market, scoring highly on efficiency and usability. The SaaS backend reporting capabilities are probably the most extensive we’ve ever seen, with every possible metric covered. StorPool could be stronger in data efficiency by introducing de-duplication, compression and more RAID-like protection. However, these features would need to be developed in a way that doesn’t compromise performance (or could be set at a per-volume level). We’d like to see more integrated solutions discussions with products for unstructured protocols (NAS and object). This would expand the TAM for StorPool considerably, bearing in mind the current appetite for fast file and object solutions.
Read the full comparison of StorPool Storage with Commvault Distributed Storage (Hedvig), Ceph, Microsoft Storage Spaces Direct (S2D) and Dell PowerFlex:
Read the full article on the Architecting IT blog!
Learn more about Architecting IT’s review on StorPool Storage
StorPool Review – Part 1 – Installation & Configuration
StorPool Review – Part 2 – performance, quality of service (QoS) and monitoring.
StorPool Review – Part 3 – Connectivity & Scripting