LLM-Based Agents for Automating the Enhancement of User Story Quality: An Early Report

Zheying Zhang; Maruf Rayhan; Tomas Herda; Manuel Goisauf; Pekka Abrahamsson

doi:10.1007/978-3-031-61154-4_8

LLM-Based Agents for Automating the Enhancement of User Story Quality: An Early Report

Zheying Zhang, Maruf Rayhan, Tomas Herda, Manuel Goisauf, Pekka Abrahamsson

Computing Sciences

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Scientific › peer-review

1 Citation (Scopus)

10 Downloads (Pure)

Abstract

In agile software development, maintaining high-quality user stories is crucial, but also challenging. This study explores the application of large language models (LLMs) to improve the quality of user stories within the agile teams of Austrian Post Group IT. We developed an Autonomous LLM-based Agent System (ALAS) and evaluated its impact on user story quality with 11 participants from six agile teams. Our findings reveal the potential of LLMs in improving user story quality, provide a practical example, and lay the foundation for future research into the broad application of LLMs in a variety of industry settings.

Original language	English
Title of host publication	Agile Processes in Software Engineering and Extreme Programming - 25th International Conference on Agile Software Development, XP 2024, Proceedings
Editors	Darja Šmite, Eduardo Guerra, Xiaofeng Wang, Michele Marchesi, Peggy Gregory
Publisher	Springer
Pages	117-126
Number of pages	10
ISBN (Electronic)	978-3-031-61154-4
ISBN (Print)	978-3-031-61153-7
DOIs	https://doi.org/10.1007/978-3-031-61154-4_8
Publication status	Published - 2024
Publication type	A4 Article in conference proceedings
Event	International Conference on Agile Software Development - Bozen-Bolzano, Italy Duration: 4 Jun 2024 → 7 Jun 2024

Publication series

Name	Lecture Notes in Business Information Processing
Volume	512 LNBIP
ISSN (Print)	1865-1348
ISSN (Electronic)	1865-1356

Conference

Conference	International Conference on Agile Software Development
Country/Territory	Italy
City	Bozen-Bolzano
Period	4/06/24 → 7/06/24

Keywords

Agents
Large language models
User Story Quality

Publication forum classification

Publication forum level 1

ASJC Scopus subject areas

Management Information Systems
Control and Systems Engineering
Business and International Management
Information Systems
Modelling and Simulation
Information Systems and Management

Access to Document

10.1007/978-3-031-61154-4_8Licence: CC BY

LLM-based agentsFinal published version, 655 KBLicence: CC BY

https://urn.fi/URN:NBN:fi:tuni-2024111410201Licence: CC BY

Cite this

Zhang, Z., Rayhan, M., Herda, T., Goisauf, M., & Abrahamsson, P. (2024). LLM-Based Agents for Automating the Enhancement of User Story Quality: An Early Report. In D. Šmite, E. Guerra, X. Wang, M. Marchesi, & P. Gregory (Eds.), Agile Processes in Software Engineering and Extreme Programming - 25th International Conference on Agile Software Development, XP 2024, Proceedings (pp. 117-126). (Lecture Notes in Business Information Processing; Vol. 512 LNBIP). Springer. https://doi.org/10.1007/978-3-031-61154-4_8

Zhang, Zheying ; Rayhan, Maruf ; Herda, Tomas et al. / LLM-Based Agents for Automating the Enhancement of User Story Quality : An Early Report. Agile Processes in Software Engineering and Extreme Programming - 25th International Conference on Agile Software Development, XP 2024, Proceedings. editor / Darja Šmite ; Eduardo Guerra ; Xiaofeng Wang ; Michele Marchesi ; Peggy Gregory. Springer, 2024. pp. 117-126 (Lecture Notes in Business Information Processing).

@inproceedings{d4b3bbad910d46f3bbcbe03f02a90a3e,

title = "LLM-Based Agents for Automating the Enhancement of User Story Quality: An Early Report",

abstract = "In agile software development, maintaining high-quality user stories is crucial, but also challenging. This study explores the application of large language models (LLMs) to improve the quality of user stories within the agile teams of Austrian Post Group IT. We developed an Autonomous LLM-based Agent System (ALAS) and evaluated its impact on user story quality with 11 participants from six agile teams. Our findings reveal the potential of LLMs in improving user story quality, provide a practical example, and lay the foundation for future research into the broad application of LLMs in a variety of industry settings.",

keywords = "Agents, Large language models, User Story Quality",

author = "Zheying Zhang and Maruf Rayhan and Tomas Herda and Manuel Goisauf and Pekka Abrahamsson",

note = "Publisher Copyright: {\textcopyright} The Author(s) 2024.; International Conference on Agile Software Development ; Conference date: 04-06-2024 Through 07-06-2024",

year = "2024",

doi = "10.1007/978-3-031-61154-4_8",

language = "English",

isbn = "978-3-031-61153-7",

series = "Lecture Notes in Business Information Processing",

publisher = "Springer",

pages = "117--126",

editor = "Darja {\v S}mite and Eduardo Guerra and Xiaofeng Wang and Michele Marchesi and Peggy Gregory",

booktitle = "Agile Processes in Software Engineering and Extreme Programming - 25th International Conference on Agile Software Development, XP 2024, Proceedings",

}

Zhang, Z, Rayhan, M, Herda, T, Goisauf, M & Abrahamsson, P 2024, LLM-Based Agents for Automating the Enhancement of User Story Quality: An Early Report. in D Šmite, E Guerra, X Wang, M Marchesi & P Gregory (eds), Agile Processes in Software Engineering and Extreme Programming - 25th International Conference on Agile Software Development, XP 2024, Proceedings. Lecture Notes in Business Information Processing, vol. 512 LNBIP, Springer, pp. 117-126, International Conference on Agile Software Development, Bozen-Bolzano, Italy, 4/06/24. https://doi.org/10.1007/978-3-031-61154-4_8

LLM-Based Agents for Automating the Enhancement of User Story Quality: An Early Report. / Zhang, Zheying; Rayhan, Maruf; Herda, Tomas et al.
Agile Processes in Software Engineering and Extreme Programming - 25th International Conference on Agile Software Development, XP 2024, Proceedings. ed. / Darja Šmite; Eduardo Guerra; Xiaofeng Wang; Michele Marchesi; Peggy Gregory. Springer, 2024. p. 117-126 (Lecture Notes in Business Information Processing; Vol. 512 LNBIP).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Scientific › peer-review

TY - GEN

T1 - LLM-Based Agents for Automating the Enhancement of User Story Quality

T2 - International Conference on Agile Software Development

AU - Zhang, Zheying

AU - Rayhan, Maruf

AU - Herda, Tomas

AU - Goisauf, Manuel

AU - Abrahamsson, Pekka

PY - 2024

Y1 - 2024

N2 - In agile software development, maintaining high-quality user stories is crucial, but also challenging. This study explores the application of large language models (LLMs) to improve the quality of user stories within the agile teams of Austrian Post Group IT. We developed an Autonomous LLM-based Agent System (ALAS) and evaluated its impact on user story quality with 11 participants from six agile teams. Our findings reveal the potential of LLMs in improving user story quality, provide a practical example, and lay the foundation for future research into the broad application of LLMs in a variety of industry settings.

AB - In agile software development, maintaining high-quality user stories is crucial, but also challenging. This study explores the application of large language models (LLMs) to improve the quality of user stories within the agile teams of Austrian Post Group IT. We developed an Autonomous LLM-based Agent System (ALAS) and evaluated its impact on user story quality with 11 participants from six agile teams. Our findings reveal the potential of LLMs in improving user story quality, provide a practical example, and lay the foundation for future research into the broad application of LLMs in a variety of industry settings.

KW - Agents

KW - Large language models

KW - User Story Quality

U2 - 10.1007/978-3-031-61154-4_8

DO - 10.1007/978-3-031-61154-4_8

M3 - Conference contribution

AN - SCOPUS:85197230809

SN - 978-3-031-61153-7

T3 - Lecture Notes in Business Information Processing

SP - 117

EP - 126

BT - Agile Processes in Software Engineering and Extreme Programming - 25th International Conference on Agile Software Development, XP 2024, Proceedings

A2 - Šmite, Darja

A2 - Guerra, Eduardo

A2 - Wang, Xiaofeng

A2 - Marchesi, Michele

A2 - Gregory, Peggy

PB - Springer

Y2 - 4 June 2024 through 7 June 2024

ER -

Zhang Z, Rayhan M, Herda T, Goisauf M, Abrahamsson P. LLM-Based Agents for Automating the Enhancement of User Story Quality: An Early Report. In Šmite D, Guerra E, Wang X, Marchesi M, Gregory P, editors, Agile Processes in Software Engineering and Extreme Programming - 25th International Conference on Agile Software Development, XP 2024, Proceedings. Springer. 2024. p. 117-126. (Lecture Notes in Business Information Processing). doi: 10.1007/978-3-031-61154-4_8