Change search
Link to record
Permanent link

Direct link
BETA
Eldh, Sigrid
Publications (8 of 8) Show all publications
Hassan, M. M., Afzal, W., Blom, M., Lindström, B., Andler, S. & Eldh, S. (2015). Testability and Software Robustness: A Systematic Literature Review. In: 2015 41st Euromicro Conference on Software Engineering and Advanced Applications: . Paper presented at The 41st Euromicro Conference on Software Engineering and Advanced Applications SEAA'15, August 26-28, 2015, Funchal, Madeira, Portugal (pp. 341-348). IEEE
Open this publication in new window or tab >>Testability and Software Robustness: A Systematic Literature Review
Show others...
2015 (English)In: 2015 41st Euromicro Conference on Software Engineering and Advanced Applications, IEEE, 2015, p. 341-348Conference paper, Published paper (Refereed)
Abstract [en]

The concept of software testability has been researched in several different dimensions, however the relation of this important concept with other quality attributes is a grey area where existing evidence is scattered. The objective of this study is to present a state-of-the-art with respect to issues of importance concerning software testability and an important quality attribute: software robustness. The objective is achieved by conducting a systematic literature review (SLR) on the topic. Our results show that a variety of testability issues are in focus with observability and controllability issues being most researched. Fault tolerance, exception handling and handling external influence are prominent robustness issues in focus.

Place, publisher, year, edition, pages
IEEE, 2015
Series
Proceedings of the EUROMICRO Conference, ISSN 1089-6503, E-ISSN 2376-9505
Keywords
Software testability, Software robustness, Systematic literature review
National Category
Computer Systems
Research subject
Computer Science
Identifiers
urn:nbn:se:kau:diva-37894 (URN)10.1109/SEAA.2015.47 (DOI)000380478300049 ()978-1-4673-7585-6 (ISBN)
Conference
The 41st Euromicro Conference on Software Engineering and Advanced Applications SEAA'15, August 26-28, 2015, Funchal, Madeira, Portugal
Projects
TOCSYC - Testing of Critical System Characteristics (KKS)
Funder
Knowledge Foundation, 20130085
Available from: 2015-09-09 Created: 2015-09-09 Last updated: 2019-11-10Bibliographically approved
Wiklund, K., Sundmark, D., Eldh, S. & Lundqvist, K. (2014). Impediments for Automated Testing - An Empirical Analysis of a User Support Discussion Board. In: 2014 IEEE Seventh International Conference on Software Testing, Verification and Validation: . Paper presented at The 7th IEEE International Conference on Software Testing, Verification and Validation (ICST), Mar 31-APR 04, 2014, Cleveland, OH (pp. 113-122). IEEE
Open this publication in new window or tab >>Impediments for Automated Testing - An Empirical Analysis of a User Support Discussion Board
2014 (English)In: 2014 IEEE Seventh International Conference on Software Testing, Verification and Validation, IEEE, 2014, p. 113-122Conference paper, Published paper (Refereed)
Abstract [en]

To better understand the challenges encountered by users and developers of automatic software testing, we have performed an empirical investigation of a discussion board used for support of a test automation framework having several hundred users. The messages on the discussion board were stratified into problem reports, help requests, development information, and feature requests. The messages in the problem report and help request strata were then sampled and analyzed using thematic analysis, searching for common patterns. Our analysis indicate that a large part of the impediments discussed on the board are related to issues related to the centralized IT environment, and to erroneous behavior connected to the use of the framework and related components. We also observed a large amount of impediments related to the use of software development tools. Turning to the help requests, we found that the majority of the help requests were about designing test scripts and not about the areas that appear to be most problematic. From our results and previous publications, we see a clear need to simplify the use, installation, and configuration of test systems of this type. The problems attributable to software development tools suggest that testers implementing test automation need more skills in handling those tools, than historically has been assumed. Finally, we propose that further research into the benefits of centralization of tools and IT environments, as well as structured deployment and efficient use of test automation, is performed.

Place, publisher, year, edition, pages
IEEE, 2014
Keywords
software testing, test automation, test tools, empirical software engineering
National Category
Computer and Information Sciences
Identifiers
urn:nbn:se:kau:diva-41561 (URN)10.1109/ICST.2014.24 (DOI)000355985000014 ()978-0-7695-5185-2 (ISBN)
Conference
The 7th IEEE International Conference on Software Testing, Verification and Validation (ICST), Mar 31-APR 04, 2014, Cleveland, OH
Available from: 2016-04-25 Created: 2016-04-11 Last updated: 2019-11-10Bibliographically approved
Doganay, K., Eldh, S., Afzal, W. & Bohlin, M. (2014). Search-Based Testing for Embedded Telecom Software with Complex Input Structures. In: Merayo, MG & DeOca, EM (Ed.), Testing Software and Systems (Ictss 2014): . Paper presented at 26th IFIP WG 6.1 International Conference on Testing Software and Systems (ICTSS), SEP 23-25, 2014, Madrid, SPAIN (pp. 205-210). Springer
Open this publication in new window or tab >>Search-Based Testing for Embedded Telecom Software with Complex Input Structures
2014 (English)In: Testing Software and Systems (Ictss 2014) / [ed] Merayo, MG & DeOca, EM, Springer, 2014, p. 205-210Conference paper, Published paper (Refereed)
Abstract [en]

In this paper, we discuss the application of search-based software testing techniques for unit level testing of a real-world telecommunication middleware at Ericsson. Our current implementation analyzes the existing test cases to handle non-trivial variables such as uninitialized pointers, and to discover any setup code that needs to run before the actual test case, such as setting global system parameters. Hill climbing (HC) and (1+1) evolutionary algorithm (EA) metaheuristic search algorithms are used to generate input data for branch coverage. We compare HC, (1+1) EA, and random search with respect to effectiveness, measured as branch coverage, and efficiency, measured as number of executions needed. Difficulties arising from the specialized execution environment and the adaptations for handling these problems are also discussed.

Place, publisher, year, edition, pages
Springer, 2014
Series
Lecture Notes in Computer Science, ISSN 0302-9743 ; 8763
National Category
Computer Sciences
Research subject
Computer Science
Identifiers
urn:nbn:se:kau:diva-44645 (URN)000378212600017 ()978-3-662-44857-1 (ISBN)
Conference
26th IFIP WG 6.1 International Conference on Testing Software and Systems (ICTSS), SEP 23-25, 2014, Madrid, SPAIN
Available from: 2016-08-10 Created: 2016-08-10 Last updated: 2019-11-11Bibliographically approved
Eldh, S., Andersson, K., Ermedahl, A. & Wiklund, K. (2014). Towards a Test Automation Improvement Model (TAIM). Paper presented at 7th IEEE International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2014 ; Conference Date: 31 March 2014 Through 4 April 2014. Proceedings - IEEE 7th International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2014, 337-342
Open this publication in new window or tab >>Towards a Test Automation Improvement Model (TAIM)
2014 (English)In: Proceedings - IEEE 7th International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2014, p. 337-342Article in journal (Refereed) Published
Abstract [en]

In agile software development, industries are becoming more dependent on automated test suites. Thus, the test code quality is an important factor for the overall system quality and maintainability. We propose a Test Automation Improvement Model (TAIM) defining ten key areas and one general area. Each area should be based on measurements, to fill the gap of existing assessments models. The main contribution of this paper is to provide the outline of TAIM and present our intermediate results and some initial metrics to support our model. Our initial target has been the key area targeting implementation and structure of test code. We have used common static measurements to compare the test code and the source code of a unit test automation suite being part of a large complex telecom subsystem. Our intermediate results show that it is possible to outline such an improvement model and our metrics approach seems promising. However, to get a generic useful model to aid test automation evolution and provide for comparable measurements, many problems still remain to be solved. TAIM can as such be viewed as a framework to guide the research on metrics for test automation artifacts. 

Place, publisher, year, edition, pages
IEEE Press, 2014
Keywords
Automation; Computer software; Industry; Measurements; Software engineering; Testing, Agile software development; Automated test; Intermediate results; Source codes; Static measurements; System quality; Test Automation; Test code, Software testing
National Category
Computer Sciences
Research subject
Computer Science
Identifiers
urn:nbn:se:kau:diva-43224 (URN)10.1109/ICSTW.2014.38 (DOI)2-s2.0-84903647674 (Scopus ID)
Conference
7th IEEE International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2014 ; Conference Date: 31 March 2014 Through 4 April 2014
Available from: 2016-06-15 Created: 2016-06-15 Last updated: 2018-01-10Bibliographically approved
Blom, M. & Eldh, S. (2013). Is Common Test Data the Solution to Poor Quality?: Solving the Right Problem – An Analysis of a Public Health Information System. In: Maria Manuela Cruz-Cunha, João Varajão, Helmut Krcmar and Ricardo Martinho (Ed.), Procedia Technology: HCIST 2013 - International Conference on Health and Social Care Information Systems and Technologies. Paper presented at HCIST 2013 - International Conference on Health and Social Care Information Systems and Technologies (pp. 1227-1236). Elsevier, 9
Open this publication in new window or tab >>Is Common Test Data the Solution to Poor Quality?: Solving the Right Problem – An Analysis of a Public Health Information System
2013 (English)In: Procedia Technology: HCIST 2013 - International Conference on Health and Social Care Information Systems and Technologies / [ed] Maria Manuela Cruz-Cunha, João Varajão, Helmut Krcmar and Ricardo Martinho, Elsevier, 2013, Vol. 9, p. 1227-1236Conference paper, Published paper (Refereed)
Abstract [en]

This paper reports our initial findings regarding the state of testing of software in the Swedish public health information system. At present, the system is only available through a black-box interface, i.e. through the GUI. This and other issues related to politics, management and organization indicate that much work is needed in order for the software to have the quality level expected by a safety-critical system. The proposed solution by the public health organization for raising the quality is to use an independent test database. Based on our initial understanding of the problem, we argue that there might be other solutions that would perhaps be more cost-effective and have a stronger impact on the quality of the system. Our main contribution lies in the data analysis, where we have collected the problems and suggested alternative cost-saving solutions.

Place, publisher, year, edition, pages
Elsevier, 2013
Series
Procedia Technology, ISSN 2212-0173
Keywords
Software testing, Public health care, Acceptance testing, Test automation, Interoperability, Information System
National Category
Computer Systems
Research subject
Computer Science
Identifiers
urn:nbn:se:kau:diva-35987 (URN)10.1016/j.protcy.2013.12.137 (DOI)
Conference
HCIST 2013 - International Conference on Health and Social Care Information Systems and Technologies
Projects
CBIC III
Funder
Knowledge Foundation, CBIC III
Available from: 2015-05-08 Created: 2015-05-08 Last updated: 2019-10-28
Eldh, S. (2013). Some researcher considerations when conducting empirical studies in industry. In: Conducting Empirical Studies in Industry (CESI): . Paper presented at 1st International Workshop on Conducting Empirical Studies in Industry (CESI), San Francisco, USA, 20-20 May 2013 (pp. 69-70). Elsevier, Article ID 6618476.
Open this publication in new window or tab >>Some researcher considerations when conducting empirical studies in industry
2013 (English)In: Conducting Empirical Studies in Industry (CESI), Elsevier, 2013, p. 69-70, article id 6618476Conference paper, Published paper (Refereed)
Abstract [en]

Research collaborations must be set up for a win-win relationship, avoiding many hurdles along the way. In this short paper the goal is to identify some considerations when conducting empirical studies in industry. These considerations deal with problem solution approaches, communication focus, unpleasant results, mismatching interpretations and scope, business aspects and some evaluation criteria for a successful collaboration.

Place, publisher, year, edition, pages
Elsevier, 2013
Keywords
Industrial research, Business aspects; Empirical research; Empirical studies; Evaluation criteria; Industrial collaboration; Problem solutions; Research collaborations; Win-win, Industry
National Category
Social Sciences Civil Engineering
Research subject
Computer Science
Identifiers
urn:nbn:se:kau:diva-44262 (URN)10.1109/CESI.2013.6618476 (DOI)2-s2.0-84888878998 (Scopus ID)978-1-4673-6286-3 (ISBN)
Conference
1st International Workshop on Conducting Empirical Studies in Industry (CESI), San Francisco, USA, 20-20 May 2013
Available from: 2016-07-01 Created: 2016-07-01 Last updated: 2017-08-08Bibliographically approved
Eldh, S. & Sundmark, D. (2012). Robustness Testing of Mobile Telecommunication Systems: A Case Study on Industrial Practice and Challenges. In: : . Paper presented at Software Testing, Verification and Validation (ICST), 2012 IEEE Fifth International Conference on (pp. 895-900). IEEE Press
Open this publication in new window or tab >>Robustness Testing of Mobile Telecommunication Systems: A Case Study on Industrial Practice and Challenges
2012 (English)Conference paper, Published paper (Refereed)
Abstract [en]

Robustness relates to the capability of a system to handle internal and external negative situations and disturbances. Robustness testing is the act of subjecting the system under test to such disturbances in a controlled manner. The objective of this study is to understand how robustness is considered in the development and testing of large-scale telecom systems, to identify the main challenges related to robustness and robustness testing, and to identify potential improvements to the current situation. We performed an exploratory case study of a telecom industry. Data was collected through interviews, study of documentation, and participant observation. Our result is a number of challenges related to robustness testing. The key challenge identified relates to understanding how robustness test can be broken down from a system-level to a low-level perspective. Our conclusion is that the area of robustness test is challenging for large complex systems, where the understanding of how to provoke complex failures and derive a root cause, as well as defining the correct level of robust design in software is not sufficiently explored.

Place, publisher, year, edition, pages
IEEE Press, 2012
Keywords
robustness, software testing, large complex systems, exploratory system study, computer science, reliability
National Category
Computer Sciences
Research subject
Computer Science
Identifiers
urn:nbn:se:kau:diva-15757 (URN)10.1109/ICST.2012.228 (DOI)
Conference
Software Testing, Verification and Validation (ICST), 2012 IEEE Fifth International Conference on
Projects
CBIC FAS 3ATAC (ITEA2)
Available from: 2012-12-10 Created: 2012-11-23 Last updated: 2018-01-12Bibliographically approved
Eldh, S. & Punnekkat, S. (2012). Synergizing industrial needs and academic research for better software education. In: Software Engineering Education based on Real-World Experiences (EduRex), 2012 First International Workshop: . Paper presented at Software Engineering Education based on Real-World Experiences (EduRex), 2012 First International Workshop Co-located with IEEE Conference on Software Engineering (ICSE) 2012, Zurich, Schweiz (pp. 33-36). IEEE Press
Open this publication in new window or tab >>Synergizing industrial needs and academic research for better software education
2012 (English)In: Software Engineering Education based on Real-World Experiences (EduRex), 2012 First International Workshop, IEEE Press, 2012, p. 33-36Conference paper, Published paper (Refereed)
Abstract [en]

The ubiquity of software is making every industry increasingly dependent on it for achieving their core products' functionality. The complexity in a telecommunication network requires not only thorough understanding of telecommunication per se, but software becomes equally interesting. This is the case with many industries, which rely more and more on software as their key enabler. Industry definitely needs a large number of software engineers with potential to be productive from day one. They are feeling impatient at the academic community for not being pragmatic. At the same time Academic community faces many challenges, which often make them thread a traditional path thus ignoring the industrial needs. We present some of these challenges from both the industrial and academic perspectives. We also present how we established a Master level advanced course on software verification and validation through mutual support and collaboration which became highly successful.

Place, publisher, year, edition, pages
IEEE Press, 2012
Keywords
industry-academia collaboration, software engineering education, software testing course, software testing, software engineering, software education
National Category
Computer Sciences
Research subject
Computer Science
Identifiers
urn:nbn:se:kau:diva-15758 (URN)10.1109/EduRex.2012.6225703 (DOI)978-1-4673-1805-1 (ISBN)978-1-4673-1804-4 (ISBN)
Conference
Software Engineering Education based on Real-World Experiences (EduRex), 2012 First International Workshop Co-located with IEEE Conference on Software Engineering (ICSE) 2012, Zurich, Schweiz
Available from: 2012-11-23 Created: 2012-11-23 Last updated: 2018-01-12Bibliographically approved
Organisations

Search in DiVA

Show all publications