Loading…
This event has ended. View the official site or create your own event → Check it out
This event has ended. Create your own
View analytic
Thursday, October 29 • 2:40pm - 3:20pm
ELK and Monasca Crossing: Logging as an OpenStack Service

Sign up or log in to save this to your schedule and see who's attending!

Monitoring and log management are two closely related siblings, necessary to guarantee the stability and availability of an OpenStack system. Monasca is a scalable, multi-tenant, high performance, fault-tolerant OpenStack Monitoring as a Service (MONaaS) solution described at https://wiki.openstack.org/wiki/Monasca. In this session we present our work on integrating additional log management functionality into Monasca, to bring the two siblings together in one tool - tailored for OpenStack'ers.

The technical basis of our work consists of Elasticsearch, Logstash and Kibana, aka ELK. The ELK stack has probably become the most widely used open source tool for centralized log management. It also finds frequent adoption among OpenStack users, as demonstrated in various sessions at previous summits. The goal of our work in the Monasca project is to:

1. give operators a unified turn-key solution to manage all logs from their multiple OpenStack systems;
2. provide OpenStack tenants a service that allows for managing logs from their applications running on OpenStack - accessible from Horizon.

As part of this talk we will dive into our architecture to show how to meet our primary design goals: scalability, multi-tenancy, resilience and extensibility. One important aspect is our integration with Monasca that uses common components, such as Kafka, and common architectural patterns. Another highlight that we will point out is our newly implemented REST API, that facilitates Logging as a Service in the spirit of Loggly. Here, authentication happens via Keystone, which extends the existing ELK stack by adding multi-tenancy, applying the tenant model of OpenStack.

Finally, we will give a demo of our solution.

Keywords: monasca, elk stack, elasticsearch, fujitsu, hp, logging, log management, monitoring

Speakers
WB

Witold Bedyk

Software Engineer, Fujitsu Enabling Software Technology
avatar for Roland Hochmuth

Roland Hochmuth

Tech Lead and Software Architect on Monasca, HP
I am the Tech Lead and Software Architect on Monasca, the open-source Monitoring-as-a-Service (at-scale) OpenStack project (https://wiki.openstack.org/wiki/Monasca). We focus on developing a highly performant, scalable and reliable turn-key monitoring solution that leverages the industries leading trends and innovations around streaming data, analytics and big data. I am also responsible for the metrics processing pipeline for HP's public... Read More →
avatar for Martin Roderus

Martin Roderus

Product Manager, Fujitsu EST
Martin Roderus is a product manager at Fujitsu for cloud management software. His current focus is on monitoring and log management in OpenStack environments, as well as workload management. He joined Fujitsu in 2012 as a software engineer, developing iPaaS and SaaS cloud applications. Prior to his time at Fujitsu, Martin worked as an academic researcher at TU Munich, focusing on high performance computing and parallel programming models. He... Read More →


Thursday October 29, 2015 2:40pm - 3:20pm
Wakaba

Attendees (123)