Publicação
Towards MLOps in a Startup Company
| Resumo: | Companies which have developed around a product or service built on top of one or several machine learning applications will reach a point where the complexity of these applications become unfeasible to manage manually. To approach a more mature level of their machine learning applications these companies must start implementing MLOps in their operations as well as orchestration tooling for building durable and scalable machine learning pipelines. This paper presents how a startup company in the marketing- and market research sector has taken their first steps towards machine learning maturity by implementing MLOps practices and orchestration with Apache Airflow. |
|---|---|
| Autores principais: | Ene, Emil Henricsson |
| Assunto: | MLOps Automation Machine Learning Pipelines Orchestration Apache Airflow DAGs Parallelization |
| Ano: | 2023 |
| País: | Portugal |
| Tipo de documento: | dissertação de mestrado |
| Tipo de acesso: | acesso aberto |
| Instituição associada: | Universidade de Lisboa |
| Idioma: | inglês |
| Origem: | Repositório da Universidade de Lisboa |
Registos relacionados
school Orchestrator selection process for cloud-native machine learning experimentation
por: Sousa, Afonso Rafael Carvalho
Publicado em: (2022)
por: Sousa, Afonso Rafael Carvalho
Publicado em: (2022)
school Automation of machine learning models benchmarking
por: Sá, João Pedro Barros
Publicado em: (2022)
por: Sá, João Pedro Barros
Publicado em: (2022)
article Machine learning on insurance premium prediction
por: Jesus, Rodrigo M.
Publicado em: (2023)
por: Jesus, Rodrigo M.
Publicado em: (2023)
school Automation of machine learning pipelines for anomaly detection challenges
por: Martins, Ricardo Rodrigues
Publicado em: (2023)
por: Martins, Ricardo Rodrigues
Publicado em: (2023)
article SOTERIA: Preserving privacy in distributed machine learning
por: Brito, Cláudia Vanessa Martins
Publicado em: (2023)
por: Brito, Cláudia Vanessa Martins
Publicado em: (2023)
school Generic productization of ML Models
por: Costeira, Gonçalo Nogueira
Publicado em: (2024)
por: Costeira, Gonçalo Nogueira
Publicado em: (2024)
article Bringing named entity recognition on Drupal content management system
por: Fernandes, José
Publicado em: (2014)
por: Fernandes, José
Publicado em: (2014)
school MLOps aplicado à análise comportamental dos clientes no ambiente de um ERP
por: Carvalho, Joel Costa
Publicado em: (2022)
por: Carvalho, Joel Costa
Publicado em: (2022)
school Developing an automated machine learning framework for protein classification
por: Bullitta, Roberto Costa
Publicado em: (2023)
por: Bullitta, Roberto Costa
Publicado em: (2023)
article Privacy-preserving machine learning on Apache Spark
por: Brito, Cláudia Vanessa Martins
Publicado em: (2023)
por: Brito, Cláudia Vanessa Martins
Publicado em: (2023)
school Otimização distribuída de indicadores logísticos com recurso a ferramentas Apache
por: Oliveira, Miguel Pimentel de
Publicado em: (2022)
por: Oliveira, Miguel Pimentel de
Publicado em: (2022)
school Programmable environments for quick orchestration of deployments
por: Poleri, Maria Helena Ribeiro
Publicado em: (2020)
por: Poleri, Maria Helena Ribeiro
Publicado em: (2020)
school Pipeline CI/CD para automação e orquestração de redes
por: Borges, João Miguel Caracóis
Publicado em: (2023)
por: Borges, João Miguel Caracóis
Publicado em: (2023)
article BrainCAT: a tool for automated and combined functional magnetic resonance imaging and diffusion tensor imaging brain connectivity analysis
por: Marques, Paulo César Gonçalves
Publicado em: (2013)
por: Marques, Paulo César Gonçalves
Publicado em: (2013)
article Agnostic performance testing framework
por: Esteves, Rui P.
Publicado em: (2023)
por: Esteves, Rui P.
Publicado em: (2023)
groups NGSPipes: from specification to automatic deployment of NGS pipelines
por: Dantas, Bruno
Publicado em: (2016)
por: Dantas, Bruno
Publicado em: (2016)
article A scalable and automated machine learning framework to support risk management
por: Ferreira, Luís
Publicado em: (2021)
por: Ferreira, Luís
Publicado em: (2021)
article IoTMapper: a metrics aggregation system architecture in support of smart city solutions
por: Vitorino, João Pedro
Publicado em: (2022)
por: Vitorino, João Pedro
Publicado em: (2022)
article An automated and distributed machine learning framework for telecommunications risk management
por: Ferreira, Luís
Publicado em: (2020)
por: Ferreira, Luís
Publicado em: (2020)
school Leveraging apache superset: a business intelligence solution
por: Soares, Guilherme Henrique Dourado da Cruz
Publicado em: (2023)
por: Soares, Guilherme Henrique Dourado da Cruz
Publicado em: (2023)
article A comparison of automated machine learning tools for predicting energy building consumption in smart cities
por: Soares, Daniela
Publicado em: (2023)
por: Soares, Daniela
Publicado em: (2023)
article AI4CITY - An automated machine learning platform for smart cities
por: Pereira, Pedro José
Publicado em: (2023)
por: Pereira, Pedro José
Publicado em: (2023)
article Prediction of maintenance equipment failures using automated machine learning
por: Ferreira, Luís
Publicado em: (2021)
por: Ferreira, Luís
Publicado em: (2021)
article SOS – Simple orchestration of services
por: Queirós, Ricardo
Publicado em: (2017)
por: Queirós, Ricardo
Publicado em: (2017)
groups Oversubscribing micro-clouds with energy-aware containers scheduling
por: Mendes, Sérgio
Publicado em: (2019)
por: Mendes, Sérgio
Publicado em: (2019)
article Deep learning based pipeline for fingerprinting using brain functional MRI connectivity data
por: Lori, Nicolás F.
Publicado em: (2018)
por: Lori, Nicolás F.
Publicado em: (2018)
article Predicting multiple domain queue waiting time via machine learning
por: Loureiro, Carolina
Publicado em: (2023)
por: Loureiro, Carolina
Publicado em: (2023)
article Production time prediction for contract manufacturing industries using automated machine learning
por: Sousa, Afonso
Publicado em: (2022)
por: Sousa, Afonso
Publicado em: (2022)
article Effect of airflow rate on yields of Steinernema carpocapse Az 20 in liquid culture in an external-loop airlift bioreactor
por: Neves, J. M.
Publicado em: (2001)
por: Neves, J. M.
Publicado em: (2001)
article MLT-prealigner: a tool for multilingual text alignment
por: Carvalho, Pedro
Publicado em: (2014)
por: Carvalho, Pedro
Publicado em: (2014)
article A labelling strategy to define airtightness performance ranges of naturally ventilated dwellings: An application in southern Europe
por: Cardoso, Vitor E. M.
Publicado em: (2022)
por: Cardoso, Vitor E. M.
Publicado em: (2022)
article Chemical laboratories 4.0: A two-stage machine learning system for predicting the arrival of samples
por: Silva, António João
Publicado em: (2020)
por: Silva, António João
Publicado em: (2020)
book A matheuristic based on column generation for parallel machine scheduling with sequence dependent setup times
por: Alvelos, Filipe Pereira e
Publicado em: (2016)
por: Alvelos, Filipe Pereira e
Publicado em: (2016)
article Business Intelligence over and above Apache Superset
por: Soares, Guilherme H.
Publicado em: (2023)
por: Soares, Guilherme H.
Publicado em: (2023)
school Virtual production and nuke : workflow optimization through custom tool development
por: Ferreira, Ricardo Jorge Regufe Pinheiro
Publicado em: (2026)
por: Ferreira, Ricardo Jorge Regufe Pinheiro
Publicado em: (2026)
article Production scheduling using multi-objective optimization and cluster approaches
por: Azevedo, Beatriz Flamia
Publicado em: (2022)
por: Azevedo, Beatriz Flamia
Publicado em: (2022)
article Combinatory examples extraction for machine translation
por: Simões, Alberto
Publicado em: (2006)
por: Simões, Alberto
Publicado em: (2006)
school Relacionamento entre a melhoria no escoamento de ar e o aumento de potência em motores de competição
por: Oliveira, José Pedro Gomes
Publicado em: (2017)
por: Oliveira, José Pedro Gomes
Publicado em: (2017)
article Using supervised and one-class automated machine learning for predictive maintenance
por: Ferreira, Luís
Publicado em: (2022)
por: Ferreira, Luís
Publicado em: (2022)
article A multi-agent system for automated machine learning
por: Fernandes, B.
Publicado em: (2022)
por: Fernandes, B.
Publicado em: (2022)
Registos relacionados
-
school Orchestrator selection process for cloud-native machine learning experimentation
por: Sousa, Afonso Rafael Carvalho
Publicado em: (2022) -
school Automation of machine learning models benchmarking
por: Sá, João Pedro Barros
Publicado em: (2022) -
article Machine learning on insurance premium prediction
por: Jesus, Rodrigo M.
Publicado em: (2023) -
school Automation of machine learning pipelines for anomaly detection challenges
por: Martins, Ricardo Rodrigues
Publicado em: (2023) -
article SOTERIA: Preserving privacy in distributed machine learning
por: Brito, Cláudia Vanessa Martins
Publicado em: (2023)