pixel
Select Page

NETWAYS Blog

OSMC 2021 | Advanced MySQL optimization and troubleshooting using PMM 2

This entry is part 4 of 4 in the series OSMC 2021

Last November OSMC 2021 took place. With me being part of NETWAYS since September 2021 it also has been my first OSMC. In the heart of Open Source many speakers talked about their experiences, shared knowledge and showcased what can be done in the field of monitoring using Open Source.
I want to give you a small glimpse into one of the talks we have had.

 

The importance of data

In our modern age data is probably the most valuable resource on our planet when looking at it from a monetary point of view. Businesses big and small alike use data to guide their behaviour, make decisions and plan their future.

Long gone are the days where simple spreadsheets did suffice. Modern companies rely on databases and their efficiency to support their work processes, sometimes even making them possible in the first place.

In his talk at OSMC 2021 Peter Zaitsev, co-founder of Percona, discusses what certain parties want regarding databases, where problems may lie and he also offers a solution to some of the laid out problems.

For most developers a database should simply just work in a reliable fashion. It should be available when needed and deliver correct information in a timely manner.
Since time also means money efficiency becomes especially important to people in management who usually want any given database to cost as little money as possible.

Problems

Possible problems can arise in a lot of different spots. Imagine for example a developer who decides to query certain information every minute to make sure the data is up to date even though the specific information does not change that frequently.

Clearly this would put a lot of unnecessary load onto the database. That’s why looking at the application side is also important when optimizing databases.

Now let’s think of a different scenario where every application makes good queries. Even ideal circumstances on the application side do not guarantee that a database will run efficiently or even effectively.

Bad or faulty hardware – CPU, RAM and storage alike – can immensely decrease the efficiency of any database. Even good queries can run slowly on bad hardware.

Other processes besides database related ones can also take away performance that would otherwise be beneficial to the queries.

Simply the way a database is structured can also decrease its own efficiency.

A solution – PMM2

Percona Monitoring and Management (PMM) 2 addresses the aforementioned problems and helps identifying them.

PMM is an Open Source database monitoring solution that offers one singular place to monitor all of your databases. This is achieved by using one server and a client agent per system you want to monitor. In the web interface you can look at a dashboard with all the gathered information together with some visualizations.

Some of the information PMM shows:

  • the impact specific queries have over time
  • information about the database tables that a relevant to a certain query
  • the amount of load specific applications cause
  • the amount of rows searched through before a query delivers a result
  • CPU and memory utilization sorted by processes
  • disk I/O latency

Using the information PMM delivers you can identify oversubscribed queries and applications which cause a lot of load, predict future scaling needs and even find those databases that are just not structured in an efficient way to begin with.

If you want to know how all of this can look like their PMM demo can give you a good first impression.
For further information also check out their documentation or just go ahead and watch the talk.

 

Full talk and more from and about OSMC 2021

Watch the whole talk by Peter Zaitsev here:

 

Since OSMC 2021 is unfortunately over we still have something for you: Did you already check out this year’s conference archives? They provide you slides and videos of each talk and also some photographs of the conference itself.

OSMC 2022 will take place from November 14 – 16 and we’re already looking forward  to meeting you all again!

Stay tuned!

Matthias Döhler
Matthias Döhler
Junior Consultant

Über ein paar Umwege ist Matthias nun endlich da gelandet, wo er sich wohl fühlt: in der IT! Bei NETWAYS hat er im September 2021 seine Ausbildung zum Fachinformatiker für Systemintegration im Bereich Professional Services begonnen. Wenn er sich zu Hause nicht auch noch mit Themen rund um Linux auseinandersetzt, sieht er sich leidenschaftlich gerne Horrorfilme und solche an, die man als "Trash" bezeichnen könnte. Je seltsamer, desto besser! Den üblichen Beschäftigungen wie Freunde treffen,...

OSMC 2021 | Thola – A tool for monitoring and provisioning network devices

This entry is part 3 of 4 in the series OSMC 2021

In November this year the OSMC 2021 took place. The two-days conference here in Nurembergs Old Town was all about Open Source Monitoring Solutions. This year, two students from Saarbrücken, Tobias Berdin and Stephan Schmidt from Inexio Deutsche Glasfaser talked about Thola, a new open source (licensed under the BSD 2-Clause license) tool for reading, monitoring and provisioning network devices.

 

How Thola has developed

Before they developed Thola, they used an old check plugin written in Perl for monitoring network devices. With the growth of their network, the usage of hardware resources also increased. In order to save resources, they began to create a new tool for monitoring and proviosiong network devcies in Go called Thola. Its first beta release was in late October 2020. The last major release 0.5 was in October 2021. It serves as a unified interface for communication with network devices and features a check mode which compiles with the monitoring plugins development guidelines.

Some of its features:

  • reading, monitoring and configuring of network devices
    • from many vendors like Huawei, Nokia, Cisco
    • from different device types like switches, routers, UPS
  • you can easy add support for more devices with YAML configuration files
  • support for icinga
  • RESTful API

 

Thola’s commands

With Thola you can monitor network interfaces, hardware stats and many more. This can be done by simply using Tholas’s CLI mode. Thola has some different commands:

  • thola identify – for automatically identifying a device with its properties like Vendor, Model, Serialnumber by its IP-Address
  • thola read interfaces – for reading out special interface informations of a device
  • thola check – can check metrics of devices and outputs them in a check plugin format, it can be used in monitoring tools like Icinga2
  • thola api – for configuring the thola api. Afterwards you can use the thola-client binary

Here is an example for checking out the cpu-load of a network device with thola check:

./thola check cpu-load 192.168.112.35 --warning 80 --critical 90
WARNING: average cpu load is 84% | 'cpu_load'=84%;80;90;0;100

For every supported vendor exists a specific device class, so for the ip10 devices from Ceragon exists a subclass in the ceraos-device-class. These device classes are written in a .yaml file. They are easy to write, not bound to a programming language and embedded in a binary. You can also automate the usage of thola with Ansible.

 

Full talk and more from and about OSMC 2021

Watch the whole talk by Tobias Berdin and Stephan Schmidt here:

 

Since OSMC 2021 is unfortunately over we still have something for you: Did you already check out this year’s conference archives? They provide you slides and videos of each talk and also some photographs of the conference itself.

OSMC 2022 will take place from November 14 – 16 and we’re already looking forward  to meeting you all again!

Stay tuned!

Björn Berg
Björn Berg
Junior Consultant

Björn hat nach seinem Abitur 2019 Datenschutz und IT-Sicherheit in Ansbach studiert. Nach einigen Semestern entschied er sich auf eine Ausbildung zum Fachinformatiker für Systemintegration umzusteigen und fing im September 2021 bei NETWAYS Professional Services an. Auch in seiner Freizeit sitzt er viel vor seinem PC und hat Spaß mit diversen Spielen, experimentiert auch mit verschiedenen Linux-Distributionen herum und geht im Sommer gerne mal campen.

OSMC 2021 | On the Bleeding Edge of OpenTelemetry

This entry is part 2 of 4 in the series OSMC 2021

OSMC 2021 has been over for about a month now. It was a pretty interesting conference, and also my first one as a trainee at NETWAYS. The two-day conference including a workshop and hackathon was all about open source monitoring software like Icinga2, CheckMK or Prometheus.
Today I give you some insights about one of the talks:

 

About the Speaker

Philipp Krenn is a development advocate and EMEA team lead at the american-dutch company Elastic NV, best known for the Elastic Stack. Most of his time he is traveling Europe and beyond to speak and discuss open source software, search, databases, infrastructure and security. At the Open Source Monitoring Conference 2021 in Nuremberg he’s shown his passion to demo interesting technology, when he introduced the audience to OpenTelemetry.

 

What is OpenTelemetry?

OpenTelemetry (OTel) is an open source project, which is backed by the CNCF (Cloud Native Computing Foundation). The CNCF is a project founded in 2015 by the Linux Foundation to help advance container technology and to align the big tech companies around its evolution.

OpenTelemetry combines traces, metrics and logs. With this approach the plan is to unify instrumentation and down the road replace OpenTracing and OpenCensus.
One key factor of the new tool is its vendor neutrality. The compatibility and interoperability approach has wide support throughout the telemetry industry, including global players like Google, Elastic or Splunk.

Including the forementioned companies, a lot of vendors are helping to build OpenTelemetry, while almost everyone who works in the observability space is more or less standardizing in OpenTelemetry right now.

What problem can OpenTelemetry solve?

The question you might be asking right now is: why should I start using OpenTelemetry?
If it’s about logging/events, you can use the Elastic Stack. And you are right. But especially in a distributed environment with multiple instances of an application, load balancing and databases, to recognize and analyze issues you also need metrics and traces.

Metrics can help you to identify bottlenecks in your infrastructure and outputs them in measurable numbers, while traces give you a much-needed overview to understand what happens when an application is running as well as the possibility to retrace e.g. the way of a customer or a session through the entire system.

With all of these parameters combined in one software as well as the targeted goal as industry standard, there are going to be multiple advantages like time saved by not having to develop the right agent or a new layer of communication.

 

Three Ways to integrate an application in OpenTelemetry

To use OpenTelemetry in your projects, it is necessary to integrate your application into OTel. There are three different options available for you to do this, while the vendor can implement one or more of these.

Your possibilities are:

  •  You have your application in whatever language you want together with the OpenTelemetry agent. Within every agent of every language you have something called vendor exporter who can talk to the backend of the vendor you are using. This way is not the ideal one because everything after the OpenTelemetry agent, e.g. wire protocoll, is from the vendor. Because of this, you have to write the vendor exporter for every single programming language and even constantly maintain it.
  • The second option is the OpenTelemetry collector. With this approach, the agent speaks the language of the OpenTelemetry protocol and sends his information to your centralized collector. A vendor exporter is located in the collector, from where your data is transferred to your vendor. A big benefit of this approach is that you only need one exporter for all applications, instead of one for every application.
  • The last way is to push back the vendor and his protocol even more. For this approach, your agent speaks the OpenTelemetry protocol, while the vendor just takes the protocol and implements it in his workflow. This option can be described as vendor neutral because you only need to implement the OTel protocol and not like in e.g. possibility one must have an agent in every language for every one of your applications.

 

What you can see in the OpenTelemetry demo

After explaining a lot of background information to the possibilities of OpenTelemetry, Philipp Krenn used one third of his speaking time to show a demo of what the program can do.
He demonstrated the combination of a java agent and elastic exporter as collector. With this setup, all the information is transferred to the Elastic Stack, so the storage takes place in Elastic Search while it is displayed in Kibana.

As a speciality he explains the preloading that is possible with java. He also talks about how this procedure works for other languages and shows how to implement your own information apart from the ones available as standard.
If you want to learn more about the possibilities OpenTelemetry has to offer, check out their Homepage for further and more in-depth information.

 

Full talk and more from and about OSMC 2021

Watch the whole talk by Philipp Krenn here:

 

Since OSMC 2021 is unfortunately over we still have something for you: Did you already check out this year’s conference archives? They provide you slides and videos of each talk and also some photographs of the conference itself.

OSMC 2022 will take place from November 14 – 16 and we’re already looking forward  to meeting you all again!

Stay tuned!

Marc Rupprecht
Marc Rupprecht
Junior Consultant

Nach seinem Bachelorabschluss im Fach Technikjournalismus und zweieinhalb Jahren als Online-Redakteur hat Marc sich entschieden, die Medienwelt hinter sich zu lassen und den Wechsel in die IT vollzogen. Als Auszubildender zum Fachinformatiker für Systemintegration verstärkt er nun seit September 2021 das Team der NETWAYS Professional Services. In seiner Freizeit ist er seit vielen Jahren begeisterter Volleyballspieler und hat vor Kurzem das Scuba Diving für sich entdeckt. Ansonsten versucht er regelmäßig neue Länder auf seiner Weltkarte...

OSMC 2021 – Take a glimpse in the archives!

It’s a wrap!

OSMC 2021 is over and it was once again an extraordinary and exciting on site event. We have enjoyed three days full of knowledge in the area of open source monitoring, sozializing within the community members and lots of fun in general. Thanks to our 28 high-level speakers, sponsors and international participants for joining us this year. It was a very great pleasure for us to having you on board!

 

Check out the archives

For all of you who either couldn’t join OSMC or want to work on the given lectures as a follow-up we provide all speaker talks including slides and videos and lots of photographs in our archives. They are already online – cool, right? So use the chance to check it out and take a walk down memory lane. Enjoy besides technical sessions, case studies and best pactices also new approaches, pioneering solutions and future perspectives. There’s something for everyone!

 

Save the date!

Since this year’s OSMC is unfortunately over we still have some good news for you. The date for our next monitoring conference is already set. It is going to take place from November 14 to 16, 2022 in Nuremberg. Be curious and mark your calendars! 

 

Katja Kotschenreuther
Katja Kotschenreuther
Online Marketing Manager

Katja ist seit Oktober 2020 Mitglied im Marketing-Team von NETWAYS. Nach ihrem Studium in Passau vollzog sie ihren Berufseinstieg im Bereich der Suchmaschinenoptimierung und möchte sich nun neben SEO auch anderen Online Marketing-Kanälen widmen. Neben Basteln und Malen, treibt sie in ihrer Freizeit gerne Sport und spielt Klavier und Gitarre.

STARFACE: Software Version 7.1.1

Am 16. November 2021 hat STARFACE das erste Service Release für die Version 7.1 veröffentlicht. Damit steht nun für alle Kunden, die einen Updatevertrag haben, die Version 7.1.1 zur Verfügung. Mit dem Release wird jetzt ein neues Telefon unterstützt, nämlich das Yealink T46U. Des Weiteren werden Firmware Updates für folgende Geräte ausgeliefert:

  • Yealink: T41S T42S T46S T48S T53 T54 T57
  • Snom: D120 D305 D315 D345 D375 D385 D712 D715 D717 D725 D735 D745 D765 D785
  • Gigaset: N510 N720 N670 N870
  • Grandstream: HT802, HT814

Bitte beachtet beim Kauf neuer Yealink-Geräte der T5er-Serie, dass diese in der Regel einen neuen Chipsatz haben. Für die Provisionierung dieser Geräte ist die nun in STARFACE 7.1.1 enthaltene neue Firmware-Version notwendig!

Außerdem wird nun auch G.722 für Gespräche im Anlagenverbund und der Provider A1 Telekom Austria unterstützt. Und wie üblich wurden natürlich auch wieder diverse Bugs gefixt. Die Details findet Ihr in den Release Notes.

Im Allgemeinen bietet Euch ein Update von STARFACE Version 6 auf  Version 7 etliche neue Funktionen:

  • Neue UCI-Funktionen zur Abfrage der iQueue Statistiken
  • Neuer Funktionstasten-Typ: Mit der Funktionstaste kann für mehrere eigene Nummern ein spezielles Umleitungs-Ziel eingestellt werden
  • Adressbuchordner können nun geleert werden
  • Das Administrationsfenster in der Weboberfläche kann nun vergrößert werden

 

Auch bei den STARFACE Apps werden Neuerungen geliefert:

  • OPUS: Neuer Übertragungs-Codec, der bei den STARFACE Mobile Apps die Calls robuster gegen schlechte Netzverbindungen macht
  • STARFACE für Windows STARFACE: iQueue in integriert
  • STARFACE für iOS: Chatnachrichten, die per Push versendet wurden, werden nun auf dem Display angezeigt
  • STARFACE für macOS mit neuer Programmiersprache (SWIFT) refactored und unterstützt die neuen Apple M1-Prozessoren

 

WICHITG für Euch ist, dass Ihr zwingend einen Updatevertrag benötigt, um von den Vorteilen der neuen Software Version profitieren zu können. Alle Infos zum Updatevertrag findet Ihr bei uns im Shop! Sehr gerne könnt Ihr uns auch direkt kontaktieren über unser Formular.

Nicole Frosch
Nicole Frosch
Sales Engineer

Ihr Interesse für die IT kam bei Nicole in ihrer Zeit als Übersetzerin mit dem Fachgebiet Technik. Seit 2010 sammelt sie bereits Erfahrungen im Support und der Administration von Storagesystemen beim ZDF in Mainz. Ab September 2016 startete Sie Ihre Ausbildung zur Fachinformatikerin für Systemintegration bei NETWAYS, wo sie vor allem das Arbeiten mit Linux und freier Software reizt. In ihrer Freizeit überschüttet Sie Ihren Hund mit Liebe, kocht viel Gesundes, werkelt im Garten, liest...