Change search
Link to record
Permanent link

Direct link
Alternative names
Publications (10 of 121) Show all publications
Netz, J., Padhi, P., Magnusson, P., Odhe, J., Skrinning, M. & Windfäll, Å. (2025). Configure to Conquer: Implementing Configurators to Improve Competitiveness. In: Lars Witell (Ed.), Service Innovation and Management: Digitalization, Service Infusion and Customer Experience (pp. 71-86). Springer Nature
Open this publication in new window or tab >>Configure to Conquer: Implementing Configurators to Improve Competitiveness
Show others...
2025 (English)In: Service Innovation and Management: Digitalization, Service Infusion and Customer Experience / [ed] Lars Witell, Springer Nature, 2025, p. 71-86Chapter in book (Refereed)
Abstract [en]

Recent advancements in technology have created new possibilities for customizing product design without significantly changing the costs of production. By using so-called configurators, which are a form of platform-based technology, firms now have the means to customize products more efficiently. Previous research has mainly focused on the technical side of configurators, whereas the business and organizational issues involved during their introduction are much less understood. The purpose of this chapter is to explore the challenges of adopting configurators in an organization. We combine a literature review from 1980 to the present with findings from an empirical study of a newly developed sales configurator for maritime components.

Place, publisher, year, edition, pages
Springer Nature, 2025
Series
Future of Business and Finance
National Category
Business Administration
Research subject
Business Administration
Identifiers
urn:nbn:se:kau:diva-106335 (URN)10.1007/978-3-031-76560-5 (DOI)978-3-031-76562-9 (ISBN)
Available from: 2025-07-17 Created: 2025-07-17 Last updated: 2025-10-16Bibliographically approved
Jagstedt, S., Magnusson, P., Ahmed, B. S. & Bayram, F. (2025). Exploring AI as a lever for personalised tourism services. In: : . Paper presented at QUIS19 - 19th International Research Symposium on Service Excellence in Management.
Open this publication in new window or tab >>Exploring AI as a lever for personalised tourism services
2025 (English)Conference paper, Oral presentation with published abstract (Refereed)
National Category
Industrial engineering and management
Research subject
Business Administration; Computer Science
Identifiers
urn:nbn:se:kau:diva-106945 (URN)
Conference
QUIS19 - 19th International Research Symposium on Service Excellence in Management
Available from: 2025-09-19 Created: 2025-09-19 Last updated: 2025-10-16Bibliographically approved
Ahmed, B. S., Baader, L. O., Bayram, F., Jagstedt, S. & Magnusson, P. (2025). Quality Assurance for LLM-RAG Systems: Empirical Insights from Tourism Application Testing. In: Fasolino A.R., Panichella S., Aleti A., Mesbah A. (Ed.), Proceedings of International Conference on Software Testing, Verification and Validation Workshops: . Paper presented at International Conference on Software Testing, Verification and Validation Workshops, ICSTW, Naples, Italy, March 31-April 4, 2025. (pp. 200-207). Institute of Electrical and Electronics Engineers (IEEE)
Open this publication in new window or tab >>Quality Assurance for LLM-RAG Systems: Empirical Insights from Tourism Application Testing
Show others...
2025 (English)In: Proceedings of International Conference on Software Testing, Verification and Validation Workshops / [ed] Fasolino A.R., Panichella S., Aleti A., Mesbah A., Institute of Electrical and Electronics Engineers (IEEE), 2025, p. 200-207Conference paper, Published paper (Refereed)
Abstract [en]

This paper presents a comprehensive framework for testing and evaluating quality characteristics of Large Language Model (LLM) systems enhanced with Retrieval-Augmented Generation (RAG) in tourism applications. Through systematic empirical evaluation of three different LLM variants across multiple parameter configurations, we demonstrate the effectiveness of our testing methodology in assessing both functional correctness and extra-functional properties. Our framework implements 17 distinct metrics that encompass syntactic analysis, semantic evaluation, and behavioral evaluation through LLM judges. The study reveals significant information about how different architectural choices and parameter configurations affect system performance, particularly highlighting the impact of temperature and top-p parameters on response quality. The tests were carried out on a tourism recommendation system for the Varmland region in Sweden, utilizing standard and RAG-enhanced configurations. The results indicate that the newer LLM versions show modest improvements in performance metrics, though the differences are more pronounced in response length and complexity rather than in semantic quality. The research contributes practical insights for implementing robust testing practices in LLM-RAG systems, providing valuable guidance to organizations deploying these architectures in production environments. 

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2025
Keywords
Application programs, Recommender systems, Redundancy, Reliability analysis, Reliability theory, Software testing, AI quality assurance, Extra-functional properties, Language model, Large language model, ML system testing, Quality testing, Retrieval-augmented generation, Software Quality, Software quality testing, System testing, Software quality
National Category
Computer Systems Computer Sciences
Research subject
Business Administration; Computer Science
Identifiers
urn:nbn:se:kau:diva-104820 (URN)10.1109/ICSTW64639.2025.10962487 (DOI)001483187700031 ()2-s2.0-105004730418 (Scopus ID)979-8-3315-3467-7 (ISBN)979-8-3315-3468-4 (ISBN)
Conference
International Conference on Software Testing, Verification and Validation Workshops, ICSTW, Naples, Italy, March 31-April 4, 2025.
Funder
Region VärmlandKarlstad University
Available from: 2025-06-06 Created: 2025-06-06 Last updated: 2025-10-16Bibliographically approved
Ahmed, B. S., Baader, O. L., Bayram, F., Jagstedt, S. & Magnusson, P. (2025). Quality Assurance for LLM-RAG Systems: Empirical Insights from Tourism Application Testing. In: : . Paper presented at ITEQS conference 2025, The 9th International Workshop on Testing Extra-Functional Properties and Quality Characteristics of Software Systems.
Open this publication in new window or tab >>Quality Assurance for LLM-RAG Systems: Empirical Insights from Tourism Application Testing
Show others...
2025 (English)Conference paper, Oral presentation with published abstract (Refereed)
Abstract [en]

This paper presents a comprehensive framework for testing and evaluating quality characteristics of Large Language Model (LLM) systems enhanced with Retrieval-Augmented Generation (RAG) in tourism applications. Through systematic empirical evaluation of three different LLM variants across multiple parameter configurations, we demonstrate the effectiveness of our testing methodology in assessing both functional correctness and extra-functional properties. Our framework implements 17 distinct metrics that encompass syntactic analysis, semantic evaluation, and behavioral evaluation through LLM judges. The study reveals significant information about how different architectural choices and parameter configurations affect system performance, particularly highlighting the impact of temperature and top-p parameters on response quality. The tests were carried out on a tourism recommendation system for the Värmland region, utilizing standard and RAG-enhanced configurations. The results indicate that the newer LLM versions show modest improvements in performance metrics, though the differences are more pronounced in response length and complexity rather than in semantic quality. The research contributes practical insights for implementing robust testing practices in LLM-RAG systems, providing valuable guidance to organizations deploying these architectures in production environments.

National Category
Computer Systems
Research subject
Computer Science; Business Administration
Identifiers
urn:nbn:se:kau:diva-104250 (URN)
Conference
ITEQS conference 2025, The 9th International Workshop on Testing Extra-Functional Properties and Quality Characteristics of Software Systems
Available from: 2025-05-07 Created: 2025-05-07 Last updated: 2025-10-16Bibliographically approved
Magnusson, P. (2023). Harnessing ordinary users’ ideas for innovation (4ed.). In: Bstieler, Ludwig; Noble, Charles H. (Ed.), The PDMA Handbook of Innovation and New Product Development: (pp. 337-349). John Wiley & Sons
Open this publication in new window or tab >>Harnessing ordinary users’ ideas for innovation
2023 (English)In: The PDMA Handbook of Innovation and New Product Development / [ed] Bstieler, Ludwig; Noble, Charles H., John Wiley & Sons, 2023, 4, p. 337-349Chapter in book (Refereed)
Place, publisher, year, edition, pages
John Wiley & Sons, 2023 Edition: 4
National Category
Industrial engineering and management
Research subject
Business Administration
Identifiers
urn:nbn:se:kau:diva-106334 (URN)978-1-119-89021-8 (ISBN)
Available from: 2025-07-17 Created: 2025-07-17 Last updated: 2025-10-16Bibliographically approved
Sihvonen, A., Sukhov, A., Netz, J., Olsson, L. E. & Magnusson, P. (2023). Intuition, Analysis and Sensemaking: How to Select Ideas for Innovation (1sted.). In: Jay Liebowitz (Ed.), Developing the Intuitive Executive: Using Analytics and Intuition for Success (pp. 193-208). CRC Press
Open this publication in new window or tab >>Intuition, Analysis and Sensemaking: How to Select Ideas for Innovation
Show others...
2023 (English)In: Developing the Intuitive Executive: Using Analytics and Intuition for Success / [ed] Jay Liebowitz, CRC Press, 2023, 1st, p. 193-208Chapter in book (Other academic)
Abstract [en]

The role of idea screening is to identify promising ideas and select the most qualified ones to proceed into the NPD process. Equally important is understanding which ideas should be avoided to prevent potential failures and avoid unnecessary expenditure of resources. During intuitive decision-making, experts may favor the familiar over the new and may factor personal affection into the decision. Thus, in the context of screening ideas for innovative products, relying entirely on intuition may be risky since the task might require decision-makers to identify radical innovations and look outside of their own comfort zone. Sensemaking is a process that enables people to develop plausible meanings and take actions based on that meaning making. In idea screening, sensemaking can occur when a person struggles to understand an idea or how to proceed with screening. Instead, generative screening can be used by organizations when the intent is to explore new opportunities, use raw ideas as triggers for inspiration. 

Place, publisher, year, edition, pages
CRC Press, 2023 Edition: 1st
National Category
Business Administration
Research subject
Business Administration; Psychology
Identifiers
urn:nbn:se:kau:diva-97575 (URN)10.1201/9781032617183-12 (DOI)2-s2.0-85176838350 (Scopus ID)9781032617183 (ISBN)
Available from: 2023-11-30 Created: 2023-11-30 Last updated: 2025-10-16Bibliographically approved
Magnusson, P. & Odhe, J. (2022). Servitization and the Necessity of Becoming Ambidextrous: A 12-Year Longitudinal Study. In: Bo Edvardsson, Bård Tronvoll (Ed.), The Palgrave Handbook of Service Management: (pp. 201-222). Palgrave Macmillan
Open this publication in new window or tab >>Servitization and the Necessity of Becoming Ambidextrous: A 12-Year Longitudinal Study
2022 (English)In: The Palgrave Handbook of Service Management / [ed] Bo Edvardsson, Bård Tronvoll, Palgrave Macmillan, 2022, p. 201-222Chapter in book (Refereed)
Abstract [en]

This chapter reports the findings from a longitudinal study spanning 12 years. It contributes to an improved understanding of how servitization actually happens, and, more specifically, how it affects the servicizing organization. The focal company AIR was a B2B manufacturing company in the aviation business, specializing in manufacturing jet engines. The case describes and analyzes how a unit at AIR made the successful transition from a pure make-to-print actor (product/production logic) to offering overall solutions (service logic), where we focus on the challenges that AIR encountered. It provides six major findings; the most surprising is perhaps the necessity to handle ambidexterity for successful servitization.

Place, publisher, year, edition, pages
Palgrave Macmillan, 2022
Keywords
Servitization, Ambidexterity, Product Service Systems, Transition, Ecosystem, Modularization
National Category
Business Administration
Research subject
Business Administration
Identifiers
urn:nbn:se:kau:diva-90456 (URN)10.1007/978-3-030-91828-6_11 (DOI)2-s2.0-85159451518 (Scopus ID)978-3-030-91827-9 (ISBN)978-3-030-91830-9 (ISBN)
Available from: 2022-06-15 Created: 2022-06-15 Last updated: 2025-10-16Bibliographically approved
Sukhov, A., Sihvonen, A., Netz, J., Magnusson, P. & Olsson, L. E. (2021). How Experts Screen Ideas: The Complex Interplay of Intuition, Analysis, and Sensemaking. The Journal of product innovation management, 38(2), 248-270
Open this publication in new window or tab >>How Experts Screen Ideas: The Complex Interplay of Intuition, Analysis, and Sensemaking
Show others...
2021 (English)In: The Journal of product innovation management, ISSN 0737-6782, E-ISSN 1540-5885, Vol. 38, no 2, p. 248-270Article in journal (Refereed) Published
Abstract [en]

Organizations use idea screening to select which ideas will be developed into innovation projects. Extant research has revealed that, during idea screening, expert evaluators use intuition to make rapid holistic decisions about idea quality, analyze ideas in detail to determine their value and employ sensemaking to understand and elaborate on ideas. However, much of this takes place in the minds of the evaluators, which limits our understanding of how experts identify good ideas. This study addresses the issue by mapping the activities that expert evaluators use to screen ideas and by examining how these activities are used to identify high quality ideas. To study this, 204 idea screening cases were collected, using the think aloud method on two samples of experts. The data were analyzed using grounded theory techniques to outline the range of idea screening activities that expert evaluators use and then complemented with fuzzy set qualitative comparative analysis (fsQCA) to understand how these activities are combined together to make judgments of idea quality. The findings break down intuition, analysis, and sensemaking into seven key activities that experts use when screening ideas and detail their dimensions on the micro‐level. The fsQCA further shows that experts combine these activities into distinct patterns in order to find high quality ideas, where sensemaking plays a crucial role. This demonstrates that finding high quality ideas often requires effortful interpretation, while also generating opportunities to develop ideas further. These findings add depth to our understanding of how evaluators think when screening ideas, suggesting that expert evaluators can be used for both the screening and development of ideas during the idea screening stage. Integrating idea development into screening can potentially lead to the more effective use of resources, while saving time at the front‐end of innovation.

Place, publisher, year, edition, pages
John Wiley & Sons, 2021
Keywords
Idea screening, Intuition, Sensmaking, fsQCA
National Category
Economics and Business
Research subject
Business Administration
Identifiers
urn:nbn:se:kau:diva-82889 (URN)10.1111/jpim.12559 (DOI)000611959200001 ()2-s2.0-85100065324 (Scopus ID)
Available from: 2021-02-17 Created: 2021-02-17 Last updated: 2025-10-17Bibliographically approved
Bäckström, I. & Magnusson, P. (2021). Managing digital employee-driven innovation: The role of middle-level managers and ambidextrous leadership (1ed.). In: Peter Ekman, Peter Dahlin and Christina Keller (Ed.), Management and information technology after digital transformation: (pp. 138-148). Routledge
Open this publication in new window or tab >>Managing digital employee-driven innovation: The role of middle-level managers and ambidextrous leadership
2021 (English)In: Management and information technology after digital transformation / [ed] Peter Ekman, Peter Dahlin and Christina Keller, Routledge, 2021, 1, p. 138-148Chapter in book (Refereed)
Place, publisher, year, edition, pages
Routledge, 2021 Edition: 1
Series
Routledge Studies in Innovation, Organization and Technology
National Category
Business Administration
Research subject
Business Administration
Identifiers
urn:nbn:se:kau:diva-87086 (URN)10.4324/9781003111245-16 (DOI)2-s2.0-85118330362 (Scopus ID)978-0-367-61276-4 (ISBN)978-1-003-11124-5 (ISBN)
Available from: 2021-11-10 Created: 2021-11-10 Last updated: 2025-10-16Bibliographically approved
Magnusson, P., Christiane, H. & Edvardsson, B. (2019). Exploring the challenges of servitization in manufacturing companies. In: P. Kristensson, P. R. Magnusson, & L. Witell (Ed.), Service innovation for sustainable business : Stimulating, realizing and capturing the value from service innovation (pp. 253-279). New Jersey: World Scientific
Open this publication in new window or tab >>Exploring the challenges of servitization in manufacturing companies
2019 (English)In: Service innovation for sustainable business : Stimulating, realizing and capturing the value from service innovation / [ed] P. Kristensson, P. R. Magnusson, & L. Witell, New Jersey: World Scientific, 2019, p. 253-279Chapter in book (Refereed)
Place, publisher, year, edition, pages
New Jersey: World Scientific, 2019
National Category
Business Administration
Research subject
Business Administration
Identifiers
urn:nbn:se:kau:diva-75174 (URN)10.1142/9789813273382_0013 (DOI)9789813273375 (ISBN)9789813273382 (ISBN)
Available from: 2019-10-09 Created: 2019-10-09 Last updated: 2025-10-17Bibliographically approved
Organisations
Identifiers
ORCID iD: ORCID iD iconorcid.org/0000-0002-7653-5226

Search in DiVA

Show all publications