Publicação
Monitoring and detection of anomaly in microservices environments
| Resumo: | Microservices architectures have become increasingly popular in recent years because of their scalability and agility. However, the distributed nature of this architecture also introduces some challenges, especially in terms of monitoring and detecting anomalies. Anomaly detection is the process of identifying anomalous events or patterns in data that do not conform to expected behavior. In microservices environments, this eventually becomes very important, since the number of services tends to grow increasingly, making the interaction between them complex. Because it is recent, there are still few studies on the best approaches to detecting anomalies in microservices. This thesis investigates how well PyOD library algorithms can detect anomalous behavior in a microservices dataset. PyOD is an open-source Python toolbox for performing scalable outlier detection on multivariate data. Some benefits of PyOD are that it is scalable, includes several algorithms, and can detect anomalies in multivariate data. We also review among the PyOD, KNN and HBOS algorithms, which one performs better at detecting anomalies. To evaluate the approach, we used TraceRCA dataset to detect anomalies such as application bugs, CPU exhausted, and network jam. This dataset contains logs from a real microservices system. The preliminary results show that the HBOS algorithm performs better than kNN, with Recall and F1-Score of 83% and 91%, respectively, while for kNN these metrics were 80% and 89%, respectively. |
|---|---|
| Autores principais: | Landim, Lauriana Patricia Tavares |
| Assunto: | Microservices Monitoring Anomaly detection Py0D Outliers algorithms Microserviços Monitorização Deteção de anomalias Py0D Algoritmos outliers |
| Ano: | 2023 |
| País: | Portugal |
| Tipo de documento: | dissertação de mestrado |
| Tipo de acesso: | acesso aberto |
| Instituição associada: | Instituto Politécnico de Castelo Branco |
| Idioma: | inglês |
| Origem: | Repositório Científico do Instituto Politécnico de Castelo Branco |
Registos relacionados
article A simple approach to detect anomalies in microservices-based systems using PyOD
por: Landim, Lauriana Patricia Tavares
Publicado em: (2022)
por: Landim, Lauriana Patricia Tavares
Publicado em: (2022)
school Outlier detection in lithography: benchmarking and the creation of a new algorithm
por: Brown, Monika Rose
Publicado em: (2020)
por: Brown, Monika Rose
Publicado em: (2020)
school Network anomalies detection via event analysis and correlation by a smart system
por: Cruz, Gonçalo Monteiro
Publicado em: (2022)
por: Cruz, Gonçalo Monteiro
Publicado em: (2022)
school Building and monitoring an event-driven microservices ecosystem
por: Santos, Pedro Aguiar Sousa Moreira dos
Publicado em: (2020)
por: Santos, Pedro Aguiar Sousa Moreira dos
Publicado em: (2020)
school Machine Learning na identificação de operações de pagamento fraudulentas e atribuição de nível de risco de operações e clientes
por: Costa, Nuno Filipe Rocha
Publicado em: (2023)
por: Costa, Nuno Filipe Rocha
Publicado em: (2023)
article An incremental local outlier detection method in the Data Stream
por: Yao, H.
Publicado em: (2018)
por: Yao, H.
Publicado em: (2018)
article Pattern Recognition in Older Adults’ Activities of Daily Living
por: Augusto, Gonçalo F.
Publicado em: (2024)
por: Augusto, Gonçalo F.
Publicado em: (2024)
school Monitorização de microserviços na empresa Hovione
por: Godinho, Elsa Nunes
Publicado em: (2023)
por: Godinho, Elsa Nunes
Publicado em: (2023)
school Automatic anomaly detection in microservices-based systems
por: Nobre, João Artur Ventura Valério
Publicado em: (2024)
por: Nobre, João Artur Ventura Valério
Publicado em: (2024)
school Anomaly Detection in Microservices Using Ensemble Methods
por: Salvado, Nuno Miguel da Silva
Publicado em: (2025)
por: Salvado, Nuno Miguel da Silva
Publicado em: (2025)
school Advanced Monitoring of Home Appliances
por: Carvalho, Cláudia Alexandra Almeida
Publicado em: (2020)
por: Carvalho, Cláudia Alexandra Almeida
Publicado em: (2020)
groups Detecting sudden variations in web apps code smells’ density: A longitudinal study
por: Rio, A.
Publicado em: (2021)
por: Rio, A.
Publicado em: (2021)
groups Detecting sudden variations in web apps code smells’ density: A longitudinal study
por: Rio, A.
Publicado em: (2021)
por: Rio, A.
Publicado em: (2021)
school Neuromorphic Vision-Based Traffic Anomaly Detection
por: Cardoso, Henrique Ferreira
Publicado em: (2023)
por: Cardoso, Henrique Ferreira
Publicado em: (2023)
school Guidelines for Testing Microservice-based Applications
por: Costa, Daniel Nunes Nogueira da
Publicado em: (2022)
por: Costa, Daniel Nunes Nogueira da
Publicado em: (2022)
school µDetector: An Intrusion Detection Tool for Microservices
por: Teixeira, Miguel de Sousa Nunes
Publicado em: (2022)
por: Teixeira, Miguel de Sousa Nunes
Publicado em: (2022)
description Classification of anomalies in microservices using an XGboost-based approach with data balancing and hyperparameter tuning
por: Barata, Luís
Publicado em: (2025)
por: Barata, Luís
Publicado em: (2025)
school Deteção de fraude em telecomunicações através de machine learning
por: Caldas, Luísa Lopes
Publicado em: (2019)
por: Caldas, Luísa Lopes
Publicado em: (2019)
category Misturas de regressões lineares: um novo teste de alteração da estrutura
por: Faria, Susana
Publicado em: (2006)
por: Faria, Susana
Publicado em: (2006)
article World feature detection and mapping using stereovision and inertial sensors
por: Lobo, Jorge
Publicado em: (2003)
por: Lobo, Jorge
Publicado em: (2003)
school Elastic Microservices Platform
por: Ribeiro, Fábio de Carvalho
Publicado em: (2018)
por: Ribeiro, Fábio de Carvalho
Publicado em: (2018)
school Outlier detection for improved clustering : empirical research for unsupervised data mining
por: Madsen, Jacob Hastrup
Publicado em: (2018)
por: Madsen, Jacob Hastrup
Publicado em: (2018)
article Ferulates and lignin structural composition in cork
por: V Marques, A
Publicado em: (2016)
por: V Marques, A
Publicado em: (2016)
school Software defined vehicular networks: mobility of microservices in an emulated environment
por: Santos, Rúben Samuel Alves
Publicado em: (2025)
por: Santos, Rúben Samuel Alves
Publicado em: (2025)
article An intelligent system for harmonic distortions detection in wind generator power electronic devices
por: Jove, Esteban
Publicado em: (2021)
por: Jove, Esteban
Publicado em: (2021)
groups Adding value to sensor data of civil engineering structures: automatic outlier detection
por: Antunes, A. L.
Publicado em: (2018)
por: Antunes, A. L.
Publicado em: (2018)
school A Guide for Microservices in Greenfield Projects
por: Cardoso, João Pedro Santos
Publicado em: (2021)
por: Cardoso, João Pedro Santos
Publicado em: (2021)
school Estender a Plataforma de Microserviços Elásticos
por: Sequeira, António Miguel Guedes de Campos dos Santos
Publicado em: (2020)
por: Sequeira, António Miguel Guedes de Campos dos Santos
Publicado em: (2020)
groups Handling outliers in panel data models: a robust approach
por: Rocha, Anabela
Publicado em: (2024)
por: Rocha, Anabela
Publicado em: (2024)
article Handling outliers in panel data models: a robust approach
por: Rocha, Anabela
Publicado em: (2024)
por: Rocha, Anabela
Publicado em: (2024)
school Sobre testes de detecção de "outliers" em populações exponenciais
por: Braumann, Maria Manuela São Pedro Abreu
Publicado em: (2014)
por: Braumann, Maria Manuela São Pedro Abreu
Publicado em: (2014)
school Deteção de anomalias e previsão de falhas de qualidade
por: Gomes, Ana Rita Silva
Publicado em: (2020)
por: Gomes, Ana Rita Silva
Publicado em: (2020)
groups Using clustering and robust estimators to detect outliers in multivariate data
por: Pires, Ana
Publicado em: (2018)
por: Pires, Ana
Publicado em: (2018)
article Applications of Pyrrole Based Molecularly Imprinted Polymers as Analytical Sensors: a Review
por: Rajendraprasad,Nagaraju
Publicado em: (2022)
por: Rajendraprasad,Nagaraju
Publicado em: (2022)
school Analysis and detection of anomalies in mobile devices
por: Lima, António Carlos Lagarto Cabral Bastos de
Publicado em: (2017)
por: Lima, António Carlos Lagarto Cabral Bastos de
Publicado em: (2017)
category A non parametric robust method for the detection of outliers in linear models
por: Faria, Susana
Publicado em: (2006)
por: Faria, Susana
Publicado em: (2006)
book Robust clustering method for the detection of outliers: using AIC to select the number of clusters
por: Pires, Ana M.
Publicado em: (2014)
por: Pires, Ana M.
Publicado em: (2014)
school Railway signal monitoring - an algorithmic approach for improved. Maintenance strategies
por: Henriques, Inês Figueiredo Leão
Publicado em: (2024)
por: Henriques, Inês Figueiredo Leão
Publicado em: (2024)
school OUTLIER AND ATTACKER RESILIENT METHODS BASED ON RATING AND REPUTATION SYSTEM
por: Matias, Pedro Miguel Pereira
Publicado em: (2023)
por: Matias, Pedro Miguel Pereira
Publicado em: (2023)
school Integration of machine learning models in a microservices architecture
por: Ibrahim, Ahmed Gamal Ali Ali
Publicado em: (2024)
por: Ibrahim, Ahmed Gamal Ali Ali
Publicado em: (2024)
Registos relacionados
-
article A simple approach to detect anomalies in microservices-based systems using PyOD
por: Landim, Lauriana Patricia Tavares
Publicado em: (2022) -
school Outlier detection in lithography: benchmarking and the creation of a new algorithm
por: Brown, Monika Rose
Publicado em: (2020) -
school Network anomalies detection via event analysis and correlation by a smart system
por: Cruz, Gonçalo Monteiro
Publicado em: (2022) -
school Building and monitoring an event-driven microservices ecosystem
por: Santos, Pedro Aguiar Sousa Moreira dos
Publicado em: (2020) -
school Machine Learning na identificação de operações de pagamento fraudulentas e atribuição de nível de risco de operações e clientes
por: Costa, Nuno Filipe Rocha
Publicado em: (2023)