Publicação
Software tools for conducting real-time information processing and visualization in industry: an up-to-date review
| Resumo: | The processing of information in real-time (through the processing of complex events) has become an essential task for the optimal functioning of manufacturing plants. Only in this way can artificial intelligence, data extraction, and even business intelligence techniques be applied, and the data produced daily be used in a beneficent way, enhancing automation processes and improving service delivery. Therefore, professionals and researchers need a wide range of tools to extract, transform, and load data in real-time efficiently. Additionally, the same tool supports or at least facilitates the visualization of this data intuitively and interactively. The review presented in this document aims to provide an up-to-date review of the various tools available to perform these tasks. Of the selected tools, a brief description of how they work, as well as the advantages and disadvantages of their use, will be presented. Furthermore, a critical analysis of overall operation and performance will be presented. Finally, a hybrid architecture that aims to synergize all tools and technologies is presented and discussed. |
|---|---|
| Autores principais: | Sousa, Ana Regina Coelho |
| Outros Autores: | Miranda, Rui Pedro Mesquita; Moreira, Ailton; Alves, Carlos Manuel Ferreira; Lori, Nicolas Francisco; Machado, José Manuel |
| Assunto: | Real time information processing Complex Event Processing (CEP) Data visualization Power BI Kafka Spark Tableau |
| Ano: | 2021 |
| País: | Portugal |
| Tipo de documento: | artigo |
| Tipo de acesso: | acesso aberto |
| Instituição associada: | Universidade do Minho |
| Idioma: | inglês |
| Origem: | RepositóriUM - Universidade do Minho |
Registos relacionados
school Smart Alerting for Smart Cities
por: Costa, Diogo Filipe Ferreira Vinhas da
Publicado em: (2019)
por: Costa, Diogo Filipe Ferreira Vinhas da
Publicado em: (2019)
school Sistema de recomendações em tempo real com spark-streaming
por: Barros, Guilherme Peres
Publicado em: (2021)
por: Barros, Guilherme Peres
Publicado em: (2021)
text_fields Performance Comparison of Python-Based Complex Event Processing Engines for IoT Intrusion Detection: Faust Versus Streamz
por: Abbasi, Maryam
Publicado em: (2026)
por: Abbasi, Maryam
Publicado em: (2026)
text_fields Optimizing Database Performance in Complex Event Processing through Indexing Strategies
por: Abbasi, Maryam
Publicado em: (2024)
por: Abbasi, Maryam
Publicado em: (2024)
school Near Real Time Data Aggregation for NLP
por: Ferreira, Tiago Miguel da Costa
Publicado em: (2023)
por: Ferreira, Tiago Miguel da Costa
Publicado em: (2023)
article Performance Evaluation Analysis of Spark Streaming Backpressure for Data-Intensive Pipelines
por: Matteussi, Kassiano José
Publicado em: (2022)
por: Matteussi, Kassiano José
Publicado em: (2022)
school Delivering the future: a comprehensive valuation of UPS
por: Eusébio, Pedro Miguel Cabaço
Publicado em: (2025)
por: Eusébio, Pedro Miguel Cabaço
Publicado em: (2025)
article The impact of contingency measures on the COVID-19 reproduction rate
por: Sousa, Regina
Publicado em: (2023)
por: Sousa, Regina
Publicado em: (2023)
school IPTV data reduction strategy to measure real users’ behaviours
por: Fidalgo, André Filipe dos Santos Pinto
Publicado em: (2012)
por: Fidalgo, André Filipe dos Santos Pinto
Publicado em: (2012)
article Intelligent and real time data acquisition and evaluation to determine critical events in Intensive medicine
por: Portela, Filipe
Publicado em: (2012)
por: Portela, Filipe
Publicado em: (2012)
article An immersive web visualization platform for a big data context in bosch’s industry 4.0 movement
por: Rebelo, João
Publicado em: (2020)
por: Rebelo, João
Publicado em: (2020)
school Utilização de eventos aplicacionais para análise de negócio em tempo real
por: Paulino, Vitor Miguel Lourenço Esteves
Publicado em: (2017)
por: Paulino, Vitor Miguel Lourenço Esteves
Publicado em: (2017)
school METAMORPHOSIS: Construção de uma demo musical
por: Sousa, Fernando Gil Gonçalves Fortuna Teles de
Publicado em: (2018)
por: Sousa, Fernando Gil Gonçalves Fortuna Teles de
Publicado em: (2018)
article A high performance real-time plasma control and event detection DSP based VME system
por: Rodrigues, A. P.
Publicado em: (2002)
por: Rodrigues, A. P.
Publicado em: (2002)
article SPARK: missão Micro-Rato ‘99
por: Duarte, Anabela A.
Publicado em: (1999)
por: Duarte, Anabela A.
Publicado em: (1999)
school PySpark-Based Data Processing Library for Distributed Machine Learning Workflows
por: Sousa, Leonardo Emanuel Miranda de
Publicado em: (2025)
por: Sousa, Leonardo Emanuel Miranda de
Publicado em: (2025)
article Après quoi rien à dire
por: Bouju, Emmanuel
Publicado em: (2016)
por: Bouju, Emmanuel
Publicado em: (2016)
school Reports of Internships and Monograph titled “Procedure for the Certification of Suitability of the European Pharmacopoeia: A Regulatory Affairs Overview, in collaboration with the European Directorate for the Quality of Medicines & Healthcare”
por: Monteiro, Marta Vicente da Cruz
Publicado em: (2024)
por: Monteiro, Marta Vicente da Cruz
Publicado em: (2024)
school Integração e Otimização do Onlinedesk através do eProcess para gestão de processos End-to-End
por: Ferreira, Bernardo José Lopes
Publicado em: (2025)
por: Ferreira, Bernardo José Lopes
Publicado em: (2025)
article Program verification in SPARK and ACSL : a comparative case study
por: Brito, Eduardo
Publicado em: (2010)
por: Brito, Eduardo
Publicado em: (2010)
article Roy Andersson’s tableau aesthetic: a cinematic social space between painting and theatre
por: Chinita, Fátima
Publicado em: (2018)
por: Chinita, Fátima
Publicado em: (2018)
school On the use of CEP in safety-critical systems
por: Abramova, Veronika
Publicado em: (2018)
por: Abramova, Veronika
Publicado em: (2018)
article Designing monitoring systems for complex event processing in Big Data contexts
por: Andrade, Carina
Publicado em: (2022)
por: Andrade, Carina
Publicado em: (2022)
description Pervasive real-time intelligent system for tracking critical events in intensive care patients
por: Portela, Filipe
Publicado em: (2013)
por: Portela, Filipe
Publicado em: (2013)
article Alienated Labor, Non-Hegemonic Development Trajectories and Capitalism: What Does Kafka’s Metamorphosis Have to Tell Us about This?
por: Abreu, Fabrício Santos Dias de
Publicado em: (2023)
por: Abreu, Fabrício Santos Dias de
Publicado em: (2023)
school Controlo de gestão na indústria dos bens de luxo
por: Santos, Inês Rafaela Rodrigues dos
Publicado em: (2023)
por: Santos, Inês Rafaela Rodrigues dos
Publicado em: (2023)
article EASAHE, um algoritmo para o agendamento de trabalhos em ferramentas de processamento de dados com preocupações de eficiência energética
por: Azevedo, Renato
Publicado em: (2023)
por: Azevedo, Renato
Publicado em: (2023)
school Comparação da alteração da coloração de alinhadores estéticos dos sistemas Invisalign® e Spark® quando expostos a agentes potencialmente corantes
por: Castelhano, Mariana Inês da Silva
Publicado em: (2022)
por: Castelhano, Mariana Inês da Silva
Publicado em: (2022)
groups Response time analysis of hard real-time tasks sharing software transactional memory data under fully partitioned scheduling
por: Barros, António
Publicado em: (2016)
por: Barros, António
Publicado em: (2016)
school Hive on spark and MapReduce : a methodology for parameter tuning
por: Forster, Rodrigo Richard
Publicado em: (2018)
por: Forster, Rodrigo Richard
Publicado em: (2018)
school Estudo Comparativo de Soluções de Data Analytics e Business Intelligence: o papel da Inteligência Artificial em visualização de dados
por: Pereira, Thayná Alves
Publicado em: (2025)
por: Pereira, Thayná Alves
Publicado em: (2025)
school BUBBLES's communication platform proof of concept
por: Ribeiro, Pedro Alexandre Gonçalves
Publicado em: (2021)
por: Ribeiro, Pedro Alexandre Gonçalves
Publicado em: (2021)
groups Smartlighting: a platform for intelligent building management
por: Moreira, Helder
Publicado em: (2016)
por: Moreira, Helder
Publicado em: (2016)
school Management of IoT devices in a physical network
por: Soares, João Nuno Fernandes Pedro
Publicado em: (2017)
por: Soares, João Nuno Fernandes Pedro
Publicado em: (2017)
article TECHNOLOGIES, DISINFORMATION AND KAFKA IN THE DIGITAL AGE
por: Mendonça Teixeira, Marcelo
Publicado em: (2025)
por: Mendonça Teixeira, Marcelo
Publicado em: (2025)
groups Extraction of information from log files using Python programming and Tableau
por: Rigueira, F.
Publicado em: (2020)
por: Rigueira, F.
Publicado em: (2020)
school Estudo da Função Mitótica da Proteína Cep57 Humana na Regulação das Interacções dos Microtúbulos com os Centrossomas e Cinetocoros
por: Ferreira, Daniela
Publicado em: (2009)
por: Ferreira, Daniela
Publicado em: (2009)
school State-Based Programming in PQL
por: Bernardino, Ricardo Jorge Rocha
Publicado em: (2014)
por: Bernardino, Ricardo Jorge Rocha
Publicado em: (2014)
article Writing through Gestures: Photography and Mimicry in “The Metamorphosis”, by Franz Kafka
por: Brito, Humberto
Publicado em: (2025)
por: Brito, Humberto
Publicado em: (2025)
article Performance and emissions of a spark ignition engine operated with gasoline supplemented with pyrogasoline and ethanol
por: Durão, Luís
Publicado em: (2020)
por: Durão, Luís
Publicado em: (2020)
Registos relacionados
-
school Smart Alerting for Smart Cities
por: Costa, Diogo Filipe Ferreira Vinhas da
Publicado em: (2019) -
school Sistema de recomendações em tempo real com spark-streaming
por: Barros, Guilherme Peres
Publicado em: (2021) -
text_fields Performance Comparison of Python-Based Complex Event Processing Engines for IoT Intrusion Detection: Faust Versus Streamz
por: Abbasi, Maryam
Publicado em: (2026) -
text_fields Optimizing Database Performance in Complex Event Processing through Indexing Strategies
por: Abbasi, Maryam
Publicado em: (2024) -
school Near Real Time Data Aggregation for NLP
por: Ferreira, Tiago Miguel da Costa
Publicado em: (2023)