Conducting Systematic Literature Reviews and Systematic Mapping Studies

Tony Clark, Balbir Barn, Souvik Barat

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Context: An essential part of conducting software engineering (SE) research is the ability to identify extant research on tools, technologies, concepts and methods in order to evaluate and make rational and scientific decisions. The domain from which such knowledge is extracted is typically existing research literature found in journals, conference proceedings, books and gray literature. Empirical approaches that include various systematic review (SR) methodologies such as systematic literature review (SLR) and systematic mapping study (SMS) are found to be effective in this context. They adopt rigorous planning, follow repeatable and well-defined processes, and produce unbiased and evidence-based outcomes. Despite these significant benefits, the general trend on using these systematic review (SR) methodologies is not encouraging in SE research. The primary reasons emerging are twofold - a) SR methodologies are largely cited as time-consuming activities and b) lack of guidance to conduct systematic reviews. This tutorial discusses these concerns and describes an effective way of using SR methodologies for SE research.
Objectives: Attendees will be introduced to the key concepts, methods and processes for conducting systematic literature reviews (SLR) and systematic mapping studies (SMS). The benefits, limitations, guidelines for using SR methodologies in an effective manner will discussed in the session. Attendees will be guided on the appropriate formulation of a research question and sub questions; the development of a review protocol such as inclusion criteria, exclusion criteria, quality criteria and classification structures; and execution of review protocol using digital libraries and syntheses of review data. A web based software tool1, for supporting the systematic literature review process will be demonstrated and attendees will get the opportunity to use the tool to conduct the review to help in identification of relevant research and extraction and synthesis of data.
Method: We will use a blend of information presentation, interactive hands-on session and knowledge sharing session. The presentation will introduce the key concepts, benefits, limitations and how to overcome the limitations; hands on session will illustrate a review process with a case study, and finally the knowledge sharing session will discuss the experiences, best practices and the lesson learnt.
Original languageEnglish
Title of host publicationISEC '17 Proceedings of the 10th Innovations in Software Engineering Conference
PublisherACM
Pages212-213
ISBN (Print)978-1-4503-4856-0
DOIs
Publication statusPublished - 2 May 2017
Eventthe 10th Innovations in Software Engineering Conference - Jaipur, India
Duration: 5 Feb 20177 Feb 2017

Conference

Conferencethe 10th Innovations in Software Engineering Conference
Period5/02/177/02/17

Fingerprint

Engineering research
Software engineering
Network protocols
Digital libraries
Planning

Cite this

Clark, T., Barn, B., & Barat, S. (2017). Conducting Systematic Literature Reviews and Systematic Mapping Studies. In ISEC '17 Proceedings of the 10th Innovations in Software Engineering Conference (pp. 212-213). ACM. https://doi.org/10.1145/3021460.3021489
Clark, Tony ; Barn, Balbir ; Barat, Souvik. / Conducting Systematic Literature Reviews and Systematic Mapping Studies. ISEC '17 Proceedings of the 10th Innovations in Software Engineering Conference. ACM, 2017. pp. 212-213
@inproceedings{8e3543cd41994feda1b2980836f30ba2,
title = "Conducting Systematic Literature Reviews and Systematic Mapping Studies",
abstract = "Context: An essential part of conducting software engineering (SE) research is the ability to identify extant research on tools, technologies, concepts and methods in order to evaluate and make rational and scientific decisions. The domain from which such knowledge is extracted is typically existing research literature found in journals, conference proceedings, books and gray literature. Empirical approaches that include various systematic review (SR) methodologies such as systematic literature review (SLR) and systematic mapping study (SMS) are found to be effective in this context. They adopt rigorous planning, follow repeatable and well-defined processes, and produce unbiased and evidence-based outcomes. Despite these significant benefits, the general trend on using these systematic review (SR) methodologies is not encouraging in SE research. The primary reasons emerging are twofold - a) SR methodologies are largely cited as time-consuming activities and b) lack of guidance to conduct systematic reviews. This tutorial discusses these concerns and describes an effective way of using SR methodologies for SE research.Objectives: Attendees will be introduced to the key concepts, methods and processes for conducting systematic literature reviews (SLR) and systematic mapping studies (SMS). The benefits, limitations, guidelines for using SR methodologies in an effective manner will discussed in the session. Attendees will be guided on the appropriate formulation of a research question and sub questions; the development of a review protocol such as inclusion criteria, exclusion criteria, quality criteria and classification structures; and execution of review protocol using digital libraries and syntheses of review data. A web based software tool1, for supporting the systematic literature review process will be demonstrated and attendees will get the opportunity to use the tool to conduct the review to help in identification of relevant research and extraction and synthesis of data.Method: We will use a blend of information presentation, interactive hands-on session and knowledge sharing session. The presentation will introduce the key concepts, benefits, limitations and how to overcome the limitations; hands on session will illustrate a review process with a case study, and finally the knowledge sharing session will discuss the experiences, best practices and the lesson learnt.",
author = "Tony Clark and Balbir Barn and Souvik Barat",
year = "2017",
month = "5",
day = "2",
doi = "10.1145/3021460.3021489",
language = "English",
isbn = "978-1-4503-4856-0",
pages = "212--213",
booktitle = "ISEC '17 Proceedings of the 10th Innovations in Software Engineering Conference",
publisher = "ACM",
address = "United States",

}

Clark, T, Barn, B & Barat, S 2017, Conducting Systematic Literature Reviews and Systematic Mapping Studies. in ISEC '17 Proceedings of the 10th Innovations in Software Engineering Conference. ACM, pp. 212-213, the 10th Innovations in Software Engineering Conference, 5/02/17. https://doi.org/10.1145/3021460.3021489

Conducting Systematic Literature Reviews and Systematic Mapping Studies. / Clark, Tony; Barn, Balbir; Barat, Souvik.

ISEC '17 Proceedings of the 10th Innovations in Software Engineering Conference. ACM, 2017. p. 212-213.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Conducting Systematic Literature Reviews and Systematic Mapping Studies

AU - Clark, Tony

AU - Barn, Balbir

AU - Barat, Souvik

PY - 2017/5/2

Y1 - 2017/5/2

N2 - Context: An essential part of conducting software engineering (SE) research is the ability to identify extant research on tools, technologies, concepts and methods in order to evaluate and make rational and scientific decisions. The domain from which such knowledge is extracted is typically existing research literature found in journals, conference proceedings, books and gray literature. Empirical approaches that include various systematic review (SR) methodologies such as systematic literature review (SLR) and systematic mapping study (SMS) are found to be effective in this context. They adopt rigorous planning, follow repeatable and well-defined processes, and produce unbiased and evidence-based outcomes. Despite these significant benefits, the general trend on using these systematic review (SR) methodologies is not encouraging in SE research. The primary reasons emerging are twofold - a) SR methodologies are largely cited as time-consuming activities and b) lack of guidance to conduct systematic reviews. This tutorial discusses these concerns and describes an effective way of using SR methodologies for SE research.Objectives: Attendees will be introduced to the key concepts, methods and processes for conducting systematic literature reviews (SLR) and systematic mapping studies (SMS). The benefits, limitations, guidelines for using SR methodologies in an effective manner will discussed in the session. Attendees will be guided on the appropriate formulation of a research question and sub questions; the development of a review protocol such as inclusion criteria, exclusion criteria, quality criteria and classification structures; and execution of review protocol using digital libraries and syntheses of review data. A web based software tool1, for supporting the systematic literature review process will be demonstrated and attendees will get the opportunity to use the tool to conduct the review to help in identification of relevant research and extraction and synthesis of data.Method: We will use a blend of information presentation, interactive hands-on session and knowledge sharing session. The presentation will introduce the key concepts, benefits, limitations and how to overcome the limitations; hands on session will illustrate a review process with a case study, and finally the knowledge sharing session will discuss the experiences, best practices and the lesson learnt.

AB - Context: An essential part of conducting software engineering (SE) research is the ability to identify extant research on tools, technologies, concepts and methods in order to evaluate and make rational and scientific decisions. The domain from which such knowledge is extracted is typically existing research literature found in journals, conference proceedings, books and gray literature. Empirical approaches that include various systematic review (SR) methodologies such as systematic literature review (SLR) and systematic mapping study (SMS) are found to be effective in this context. They adopt rigorous planning, follow repeatable and well-defined processes, and produce unbiased and evidence-based outcomes. Despite these significant benefits, the general trend on using these systematic review (SR) methodologies is not encouraging in SE research. The primary reasons emerging are twofold - a) SR methodologies are largely cited as time-consuming activities and b) lack of guidance to conduct systematic reviews. This tutorial discusses these concerns and describes an effective way of using SR methodologies for SE research.Objectives: Attendees will be introduced to the key concepts, methods and processes for conducting systematic literature reviews (SLR) and systematic mapping studies (SMS). The benefits, limitations, guidelines for using SR methodologies in an effective manner will discussed in the session. Attendees will be guided on the appropriate formulation of a research question and sub questions; the development of a review protocol such as inclusion criteria, exclusion criteria, quality criteria and classification structures; and execution of review protocol using digital libraries and syntheses of review data. A web based software tool1, for supporting the systematic literature review process will be demonstrated and attendees will get the opportunity to use the tool to conduct the review to help in identification of relevant research and extraction and synthesis of data.Method: We will use a blend of information presentation, interactive hands-on session and knowledge sharing session. The presentation will introduce the key concepts, benefits, limitations and how to overcome the limitations; hands on session will illustrate a review process with a case study, and finally the knowledge sharing session will discuss the experiences, best practices and the lesson learnt.

UR - http://dl.acm.org/citation.cfm?doid=3021460.3021489

U2 - 10.1145/3021460.3021489

DO - 10.1145/3021460.3021489

M3 - Conference contribution

SN - 978-1-4503-4856-0

SP - 212

EP - 213

BT - ISEC '17 Proceedings of the 10th Innovations in Software Engineering Conference

PB - ACM

ER -

Clark T, Barn B, Barat S. Conducting Systematic Literature Reviews and Systematic Mapping Studies. In ISEC '17 Proceedings of the 10th Innovations in Software Engineering Conference. ACM. 2017. p. 212-213 https://doi.org/10.1145/3021460.3021489