Título: | REQUIREMENTS ENGINEERING FOR ML-ENABLED SYSTEMS: STATUS QUO AND PROBLEMS | ||||||||||||
Autor: |
ANTONIO PEDRO SANTOS ALVES |
||||||||||||
Colaborador(es): |
MARCOS KALINOWSKI - Orientador DANIEL MENDEZ FERNANDEZ - Coorientador |
||||||||||||
Catalogação: | 06/FEV/2024 | Língua(s): | ENGLISH - UNITED STATES |
||||||||||
Tipo: | TEXT | Subtipo: | THESIS | ||||||||||
Notas: |
[pt] Todos os dados constantes dos documentos são de inteira responsabilidade de seus autores. Os dados utilizados nas descrições dos documentos estão em conformidade com os sistemas da administração da PUC-Rio. [en] All data contained in the documents are the sole responsibility of the authors. The data used in the descriptions of the documents are in conformity with the systems of the administration of PUC-Rio. |
||||||||||||
Referência(s): |
[pt] https://www.maxwell.vrac.puc-rio.br/projetosEspeciais/ETDs/consultas/conteudo.php?strSecao=resultado&nrSeq=65995&idi=1 [en] https://www.maxwell.vrac.puc-rio.br/projetosEspeciais/ETDs/consultas/conteudo.php?strSecao=resultado&nrSeq=65995&idi=2 |
||||||||||||
DOI: | https://doi.org/10.17771/PUCRio.acad.65995 | ||||||||||||
Resumo: | |||||||||||||
Systems that use Machine Learning (ML) have become commonplace
for companies that want to improve their products, services, and processes.
Literature suggests that Requirements Engineering (RE) can help to address
many problems when engineering ML-Enabled Systems. However, the state of
empirical evidence on how RE is applied in practice in the context of MLenabled systems is mainly dominated by isolated case studies with limited
generalizability. We conducted an international survey to gather practitioner
insights into the status quo and problems of RE in ML-enabled systems. We
gathered 188 complete responses from 25 countries. We conducted quantitative
statistical analyses on contemporary practices using bootstrapping with confidence intervals and qualitative analyses on the reported problems involving
open and axial coding procedures. We found significant differences in RE practices within ML projects, some of them have been reported on literature and
some are totally new. For instance, (i) RE-related activities are mostly conducted by project leaders and data scientists, (ii) the prevalent requirements
documentation format concerns interactive Notebooks, (iii) the main focus of
non-functional requirements includes data quality, model reliability, and model
explainability, and (iv) main challenges include managing customer expectations and aligning requirements with data. The qualitative analyses revealed
that practitioners face problems related to lack of business domain understanding, unclear requirements, and low customer engagement. These results help to
provide a better understanding of the adopted practices and which problems
exist in practical environments. We put forward the need to adapt further and
disseminate RE-related practices for engineering ML-enabled systems.
|
|||||||||||||
|