OpenStack Summit October 2015 Tokyo

Manila, at its core, provides basic provisioning and management of file shares to users of an OpenStack cloud. The Sahara project provides a framework to expose Big Data services such as Spark and Hadoop. Together these two projects create a solution that is greater than the sum of its parts.

Natural synergy and popular demand led these three teams to develop a joint solution to expose Manila file shares within the Sahara construct to solve real Big Data challenges.
  
This talk serves as a brief introduction to what these two projects encompass as well as a detailed look at the joint integration work that was created involving:

 o      Sahara Data sources
 o      Manila File Shares
 o      Horizon Integration
 o      Sample Workflows
     
 Some administrative enhancements to Manila will also be covered including:

 o   Manila snapshots
 o   NFS Connector for Hadoop
 o   HDFS driver for Manila
 
Finally, a demo will be presented showing a Sahara data processing job running with binaries, data sets, and results hosted in Manila file shares mounted on a Sahara cluster.

Attendees will leave this session with an understanding of Manila and Sahara integrations and tangible use cases where it can be leveraged as a key component of a Big Data application deployment.