pixel
Seite wählen

NETWAYS Blog

stackconf 2022 | Vitess: Running MySQL with confidence on Kubernetes

This entry is part 1 of 1 in the series stackconf 2022

How about taking a walk down memory lane and seeing which insights stackconf 2022 has brought? Let’s start this blog series with Sebstian’s talk “Vitess: Running MySQL with confidence on Kubernetes”.

 

What to Expect

Kubernetes and cloud native computing changed the way how applications and workloads are deployed and operated. Besides stateless applications there is of course still the need for more static components like MySQL databases.

In his talk Sebastian discusses the question if it’s a good idea to run MySQL databases on Kubernetes.

 

Enjoy his valuable Expert Know-How and watch the Video!

YouTube player

 

You’re convinced by our top-level speaker and want to gain even more knowledge from our open source experts? Then you should definitely join this year’s edition of the event. stackconf 2023 takes place from September 13 – 14, 2023 in Berlin. Save your Early Bird ticket until April 30 and you’re in!

In case you also want to share some know-how about several topics around the whole DevOps lifecycle, feel free to submit your proposal until May 31.

We’re looking forward to hearing from you!

Katja Kotschenreuther
Katja Kotschenreuther
Marketing Manager

Katja ist seit Oktober 2020 Teil des Marketing Teams. Als Online Marketing Managerin kümmert sie sich neben der Optimierung unserer Websites und Social Media Kampagnen hauptsächlich um die Bewerbung unserer Konferenzen und Trainings. In ihrer Freizeit ist sie immer auf der Suche nach neuen Geocaches, bereist gern die Welt, knuddelt alle Tierkinder, die ihr über den Weg laufen und stattet ihrer niederbayrischen Heimat Passau regelmäßig Besuche ab.

OSMC 2022 | AI Driven Observability based on Open Source

Observability and monitoring of resources are growing every day and it is inevitable to analyse all the data points to arrive at a solution. At Mercedes-Benz they have developed an Open Source data metric analyzer and drive it with data science to identify anomalies. At OSMC 2022, Satish Karunakaran, a data scientist with 19 years of experience in the field, presented how they established the entire data processing ecosystem based on Open Source.

In the beginning of his talk, Satish immediately questioned how much value can be generated manually out of Big Data, since metrics, logs and traces all provide intelligence. His point was not about scalability, management (manual patching) versus unmanaged (self-healing) here, but how to optimize for prediction and detection of failures.

Following up, the question arose what is normal, and how to determine normality versus abnormality.

 

Especially cases of „looks normal, but not sure“ or „better than last week, but something is wrong“ could be optimized with a data driven approach.

The idea is the following: 1) Collect lots of functional & correct data (as much as possible, as long as possible). 2a) Use lots of nested if conditions: Check if a value / limit ( 3 < 5 = yes ) has been reached, and if so, get more and more granular ( 3 < 4 =yes ) and split up based on previous choices (3 < 3 = false). This is also called a decision-tree. 2b ) Create labelling tags. 2c) Make this process highly parallel via scalable, distributed, gradient-boosted decision trees (XGBoost).

Boosting comes from the idea of improving single weak models by combining them with other weak models, in order to generate a strong model! Gradient boosting is an improved supervised learning variant if this, which takes labeled training data as input, and tries to correctly predict each training example – to label future data.

TLDR: If we know what is healthy, because if we have lots of healthy data, and are able to labelpredict each next data point to the real world (not necessarily watching what is happening, but predicting what will happen), and suddenly our predictions do not match, then we have an abnormality and should call an alert! Or, if you prefer to watch an AI explain XGBoost:

This morning I came across a cool demo by @LinusEkenstam about creating animated AI-generated characters. I decided to give it a try, and, with slight modifications, this is what I ended up with. pic.twitter.com/e2vx9OP0Ls

— Bojan Tunguz (@tunguz) January 18, 2023

Unfortunately compared to Neural Nets, XGBoost appears slow and memory intense with many decision-branches, wheares Neural Nets allow scalability and optimization – due to being able to optimize and drop for hidden functions. Additionally, one tries to converge for the maximum (XGBoost), and the other tries to converge for the minimum (Neural Nets). So combining both and getting the best possible tag tag-prediction is the art of someone who does this for quite a long time, like Satish!

An example of how Satish and his team implemented this can be seen in this picture, which displays the path of data flow, data orchestration and visualization.

Do you think all monitoring should follow an AI based anomaly approach?

Would you find it cool if all monitoring solutions one day would have predictive models? And how would they deal with statistical outliers? Maybe lots of human time wasted could be saved, if we could focus on „the essentials“? Would you like to hear more about about data science & AI at further NETWAYS Events or like to talk to Icinga developers about this fascinating topic? Please feel free to contact us!

The recording and slides of this talk and all other OSMC talks can be found in our Archives. Check it out! We hope to see you around at OSMC 2023! Stay in touch and subscribe to our Newsletter!

Patrick Dolinic
Patrick Dolinic
Junior Consultant

Nachdem Patrick sein Psychologiestudium abgeschlossen hat, ist er 2020 zu NETWAYS, wo er nun sein Hobby zum Beruf macht: Endlich kann er sich voll und ganz der Linux-Welt widmen und sein Faible für Computersicherheit ausleben. Wenn er nicht gerade arbeitet, arbeitet oder zockt er. Nebenbei versucht er beim Joggen 8 km zu reißen, schafft aktuell aber nicht mal die ersten 7.

Icinga Camp Berlin: Call for Papers is open

It’s time to spread some monitoring love! The next Icinga Camp will take place in Berlin on May 17, 2023 and you’re invited to join the event. This is your chance to share your newest findings, best practices, and Icinga expert know-how with the community. And to get back the well-deserved kudos and for sure some valuable feedback!

Don’t be shy to say hi and get on stage

The Call for Papers is open until end of February. Submit your abstract for a 30- or 45-minute presentation on your technical topic, your specific use case or new, future-oriented developments. Be a speaker and inspire others with the benefits Icinga brings to your organization or project!

Icinga Camps are the perfect platform to learn new things and share knowledge. Icinga developers, community members and enterprise users come together to discuss the latest monitoring trends and share their best practices with Icinga.

How else to support and take part

The Icinga Team is currently looking for sponsors for the event. Check out their sponsorship leaflet for your opportunities and don’t hesitate to get in touch with them!

Until February 28 you can also get one of the coveted Early Bird tickets. Register now and save your seat for the best price you can get! The Icinga and NETWAYS Events Team is looking forward to seeing you in Berlin!

Julia Hornung
Julia Hornung
Lead Marketing Manager

Julia ist seit Juni 2018 bei NETWAYS. Mit ihren Spezialgebieten Texte/Konzepte, Branding und PR ist sie für Tone of Voice und Wording von NETWAYS und Icinga verantwortlich. Davor war sie als Journalistin und in der freien Theaterszene spannenden Geschichten auf der Spur. Ihre Leidenschaft gilt gutem Storytelling, klarer Sprache und ausgefeilten Texten. Ihre innere Mitte findet sie beim Klettern und Yoga.

stackconf 2023 | Submit your Talk now!

Submissions for stackconf 2023 are now open! The event will take place on September 13 & 14 in Berlin and for it to take place at all, we are currently looking for speakers who will shape this year’s conference program.

 

Why Speaking at stackconf

The actual question is: why not speaking at stackconf? So let’s take a look at the benefits you will enjoy as a speaker.

Meet your target audience, capture them with your expertise and get infected by their prevailing enthusiasm. Join the two-day conference inclusive its awesome evening event for free. And last but not least take the advantage of the various networking opportunities at the conference, exchange ideas with other attendees and make new friends.

 

What we are Looking for

Lectures focusing on a comprehensive technical insight are very appreciated. Let your audience benefit by learning about new topics or open source projects, technical backgrounds, how-tos, etc. Proof your expert know-how in Q&A session following after your talk.

Chose the lecture format that suites you best and customize your speaking session.

  • IGNITE TALK | Five minutes to talk accompanied by 20 slides, 15 seconds each.
  • MEDIUM TALK | The short lecture format limited to 30 minutes, including a Q&A session.
  • FULL TALK | The long lecture format of 45 minutes, including a Q&A session.

 

Call for Sponsors is Open

As a sponsor at stackconf you have the chance to present your company in a focused environment to international IT professionals & decision makers. Realize your goals and network with potential partners, grow your business with lead generation or promote your brand. Customize your presence at stackconf with our versatile and custom-fit sponsorship program.

 

Early Bird Ticket Alert

In case you want to join stackconf 2023 as an attendee you now have the opportunity to grab one of our coveted Early Bird tickets. They are on sale until April 30. So save your seat now and you will be part of the coolest DevOps event this year!

Katja Kotschenreuther
Katja Kotschenreuther
Marketing Manager

Katja ist seit Oktober 2020 Teil des Marketing Teams. Als Online Marketing Managerin kümmert sie sich neben der Optimierung unserer Websites und Social Media Kampagnen hauptsächlich um die Bewerbung unserer Konferenzen und Trainings. In ihrer Freizeit ist sie immer auf der Suche nach neuen Geocaches, bereist gern die Welt, knuddelt alle Tierkinder, die ihr über den Weg laufen und stattet ihrer niederbayrischen Heimat Passau regelmäßig Besuche ab.

OSMC 2022 | VictoriaMetrics: scaling to 100 million metrics per second

This entry is part 1 of 1 in the series OSMC 2022

OSMC 2022 has brought lots of insightful open source expert know-how. In this blog series we will together take a glance back into our archives and pick out some of our highly appreciated speaker talks. Today we will start with Aliaksandr’s talk “VictoriaMetrics: scaling to 100 million metrics per second”. His session will be very interesting for software engineers and DevOps familiar with observability and modern monitoring systems, or for those who’re interested in building scalable high performant databases for time series.

 

That’s what it’s all about

The growth of observability trends and Kubernetes adoption generates more demanding requirements for monitoring systems. Volumes of time series data increase exponentially, and old solutions just can’t keep up with the pace. In his talk Aliaksandr will cover how and why they created a new open source time series database from scratch. Which architectural decisions, which trade-offs we had to take in order to match the new expectations and handle 100 million metrics per second with VictoriaMetrics.

 

Get inspired by his Talk

YouTube player

 

You like his content and want event more? Reason enough to join the next edition of the event. OSMC 2023 takes place from November 7 – 9, 2023 in Nuremberg.

Mark your calendars! We’re looking forward to meeting you there!

Katja Kotschenreuther
Katja Kotschenreuther
Marketing Manager

Katja ist seit Oktober 2020 Teil des Marketing Teams. Als Online Marketing Managerin kümmert sie sich neben der Optimierung unserer Websites und Social Media Kampagnen hauptsächlich um die Bewerbung unserer Konferenzen und Trainings. In ihrer Freizeit ist sie immer auf der Suche nach neuen Geocaches, bereist gern die Welt, knuddelt alle Tierkinder, die ihr über den Weg laufen und stattet ihrer niederbayrischen Heimat Passau regelmäßig Besuche ab.