Loading…
This event has ended. View the official site or create your own event → Check it out
This event has ended. Create your own
View analytic
Thursday, October 29 • 4:30pm - 5:10pm
Sahara+Storm: Real-time Data Analytics in Openstack

Sign up or log in to save this to your schedule and see who's attending!

One of the most recent addition to Sahara (OpenStack Data-Processing-as-a-Service component) was the Storm plugin. Up to Juno, Openstack Sahara included only batch processing alternatives and Storm is one of the most popular open-source tools for real-time data analytics and stream processing.

Implementing real-time data processing differs from Hadoop and other batch processing approaches because the data cannot be stored and then processed. The processing takes place while the data traverses the system. As a consequence sub-second processing latencies can be achieved. Therefore, this plugin enables new types of applications to be executed in Sahara.

Real-time data processing is increasingly popular. Many such applications are now in our daily routine. One example, is online data summarization, where a high volume data feed (e.g., logs from a large cluster or sensor network) is summarized to let only relevant events be stored in a database. Other common examples, with varying performance and scalability requirements, include fraud detection, trend topics, and high frequency trading.

In this talk, we will present the Storm plugin for Sahara and guide the user through the essential steps to setup a scalable real-time data processing application. We will also share our plans for improving real-time data processing in OpenStack.

Speakers
avatar for Andrey Brito

Andrey Brito

Professor - Universidade Federal de Campina Grande, UFCG
Andrey Brito is a Professor at UFCG (Universidade Federal de Campina Grande) in the Computer Science Department. Andrey’s main interests are robustness and scalability aspects of distributed systems. He coordinates R&D teams that have been contributing to OpenStack, specially regarding federation, hierarchical multitenancy and integration between Ironic and infrastructure managers.
avatar for Michael McCune

Michael McCune

Senior Software Engineer, Red Hat
Michael is a software developer on Red Hat's Emerging Technology team, currently working on the Sahara project. He is also a member of the OpenStack API Working Group and OpenStack Security Team. He has been adding functionality and security enhancements to the Sahara project since the Icehouse release, as well as authoring the Data Processing chapter of the OpenStack Security Guide. He is currently working towards greater integration between... Read More →
avatar for Telles Nobrega

Telles Nobrega

Software Engineer and Masters Student, Laboratório de Sistemas Distribuídos - LSD, UFCG
Telles Nobrega is an assistant researcher at Universidade Federal de Campina Grande. Telles Nobrega has have been contributing to OpenStack, specially in projects such as Sahara and Keystone. Currently, his research focus is on maximizing hardware utilization and exploiting idle resources to reduce job durations in Sahara.


Thursday October 29, 2015 4:30pm - 5:10pm
Wakaba

Attendees (94)