3dmentat - Fotolia
Enterprise IT is in the midst of a generational transition from internal, monolithic infrastructure and applications built for the client-server era to distributed applications using a mix of internal and external cloud services built for the mobile, social age. At EMC World 2015, the company demonstrated a range of products, services and open source initiatives that address the needs of cloud-centric, next-generation IT and that move EMC far beyond its traditional market of big iron storage systems.
EMC World 2015 can be seen as a milestone in the firm's transformation from a purveyor of storage systems to a supplier of integrated software and infrastructure stacks for building next-generation applications.
Sure, there was plenty of new hardware, like a major upgrade to the XtremIO all flash array, a new VMAX3 tiered storage system and updates to the Data Domain data protection software, but the shift to cloud and open source stacks was the big news. Indeed, the event's theme, Redefine Next, captured its essence: EMC redefining itself and its product portfolio to better serve changed enterprise IT strategies and priorities, what VMware's chief strategist calls the New IT Agenda.
Of course, EMC has long had its hands in many facets of IT infrastructure via its Federation Solutions group partners: VMware, Pivotal and now VCE (after EMC bought Cisco's share of the joint venture). This year, though, there seemed more emphasis on how all the parts fit together to build clouds and next-generation applications.
EMC's transformation mirrors that occurring within enterprise software writ large, as each migrates from the world of what EMC calls Platform 2, client-server applications and infrastructure designed for thousands of PC users, to Platform 3 systems built with virtual servers, cloud services, big data and social features designed for millions of primarily mobile clients.
EMC embraces openness for next-generation applications
The first shocker came not from what EMC is selling, but what it's giving away. The company announced that the ViPR software-defined storage controller will be going into the wild as an open source project. Sticking with the snake metaphor, Project CoprHD is a Mozilla Public Licensed version of ViPR, including all existing storage automation and control features with code available on GitHub in early June. This is the first step toward creating an open ecosystem around EMC's SDS technology and is likely a precursor to ViPR's eventual incorporation into OpenStack.
The extent of corporate and developer adoption of ViPR won't be clear for months, but the project has already been endorsed by executives at Intel and Canonical. Although EMC will continue to sell a supported version of ViPR, it will be based on the public code base and all new feature development will occur within the open source project.
EMC's next concession to openness comes via ScaleIO, although in this case the company isn't giving away the store, just free samples. ScaleIO, software that turns direct attached storage across multiple servers into shared block devices on a virtual SAN, is now free to download for test and development; users must still license the product for production use. Although freemium distribution is nothing new, EMC's move is more significant than it may appear. After all, ScaleIO has been almost impossible for developers to get without paying for a full license -- a problem EMC execs admit greatly limited adoption.
Acknowledging new norms among developers weaned in the era of open source and GitHub, Jeremy Burton, EMC's president of products and marketing said, "If developers want to steal software, we want them stealing our software." He believes that getting ScaleIO in the hands of developers will serve to illustrate the product's performance advantages versus public cloud services (e.g., AWS EBS, Google Persistent Disks) and open source alternatives like Ceph.
EMC's OpenStack Erector Set
Outside the realm of storage systems and services, EMC has been busy building software and services to support next-generation Platform 3 applications. The company's Pivotal division, a well-known leader in PaaS with a commercial Cloud Foundry release, announced several updates to its big data suite of Hadoop, Greenplum, Spring and other software for data aggregation and analysis.
The bigger news came out of EMC's Federation, which serves as a systems integrator for products spanning the company's major product divisions (EMC II, VMware, VCE, Pivotal and RSA). The company unveiled and demoed Project Caspian, an enterprise OpenStack-in-a-box hardware and software bundle. Chad Sakac, EMC's president of global systems engineering, describes Caspian as an "industrialized software stack" plus converged infrastructure, designed for cloud native, Platform 3 applications using open source components.
The core of Caspian is a customized OpenStack using technology from EMC's CloudScaling acquisition; however, Sakac stresses its goal is to "stay as close to the 'vanilla' OpenStack core as possible." Next, Caspian adds a persistent data layer of object storage (like Swift), HDFS (Hadoop) and block, using ScaleIO. Finally, Caspian includes what EMC calls a Cluster Manager, an orchestration layer like Kubernetes and Mesos, to automate deployments and monitor workload and system condition.
Caspian runs on VCE's newly announced VXRACK hyper-converged systems (think rack-scale EVO RAIL), although Caspian's primary hardware dependence appears to be in the orchestration layer, meaning customers prepared for some DIY reconfiguration could likely repurpose other converged hardware into a Caspian cloud. Indeed, Sakac's blog mentions a hardware abstraction layer, meaning there's some attempt to insulate the software control plane from underlying hardware details. Caspian's persistence layer currently uses ScaleIO on DAS, but as an impressive demonstration of the new DSSD rack-scale all-flash array made clear, future versions will include an all flash tier.
Hardening the cloud
In total, EMC demonstrated its aim to make the cloud easy, reliable and safe enough for even the most conservative enterprise. A case in point is Cloudlink, a small Canadian company EMC acquired earlier this year. Sakac noted that Cloudlink's SecureVM encrypts (and attests to and otherwise controls and manages) compute instances in clouds, whether the VM images be Windows or Linux or reside on AWS, Azure, Google Cloud or vCloud Air. Cloudlink integrates on-site key management with in-cloud key repositories allowing companies to maintain full control over encryption credentials and policies while providing end-to-end VM, boot volume and application encryption.
All in all, the event shows that EMC is modernizing, expanding and normalizing its products into a full stack enterprise cloud suite that can be deployed on-premises or consumed as shared services. And collectively, EMC's new products will significantly broaden its market to include cloud architects, app developers, channel solution providers and business/data analysts. In retrospect, EMC World 2015 was "Pivotal" to the company's future.
EMC opens app marketplace
Preparing for next-generation cloud apps