An intelligent decision support approach for reviewer assignment in R&D project selection

O. Liu, J. Wang, J. Ma, Y. Sun

Research output: Contribution to journalArticle

Abstract

In the process of Research and Development (R&D) project selection, experts play an important role because their opinions are the foundation on which to judge the potential value of a project. How to assign the most appropriate experts to review project proposals might greatly affect the quality of project selection, which in turn could affect the return on investment of the funding organization. However, in many funding organizations, current approaches to assigning reviewers are still based on simply matching the discipline area of the reviewers with that of the proposal, which could result in poor quality of project selection and poor future financial return. Additionally, these approaches might make it difficult to balance resources and resolve conflicts of interests between reviewers and applicants. Therefore, to overcome these problems, there is an urgent need for a systematic approach to support and automate the reviewer assignment process. This research aims at proposing an intelligent decision support approach for reviewer assignment and developing an Assignment Decision Support System (ADSS). In this approach, heuristic knowledge of expert assignment and techniques of operations research are integrated. The approach uses decision models to determine the best solution of reviewer assignment that maximizes the total expertise level of the reviewers assigned to proposals. It also balances the distribution of proposals at different grades and solves conflicts of interests between reviewers and applicants. Its application in the National Natural Science Foundation of China (NSFC) and the computational results of its effectiveness and efficiency are also described.
Original languageEnglish
Pages (from-to)1-10
JournalComputers in Industry
Volume76
Early online date4 Dec 2015
DOIs
Publication statusPublished - 1 Feb 2016

Fingerprint

Natural sciences
Operations research
Decision support systems

Cite this

@article{4c81ecd79c50455ea96c4ba520166f5e,
title = "An intelligent decision support approach for reviewer assignment in R&D project selection",
abstract = "In the process of Research and Development (R&D) project selection, experts play an important role because their opinions are the foundation on which to judge the potential value of a project. How to assign the most appropriate experts to review project proposals might greatly affect the quality of project selection, which in turn could affect the return on investment of the funding organization. However, in many funding organizations, current approaches to assigning reviewers are still based on simply matching the discipline area of the reviewers with that of the proposal, which could result in poor quality of project selection and poor future financial return. Additionally, these approaches might make it difficult to balance resources and resolve conflicts of interests between reviewers and applicants. Therefore, to overcome these problems, there is an urgent need for a systematic approach to support and automate the reviewer assignment process. This research aims at proposing an intelligent decision support approach for reviewer assignment and developing an Assignment Decision Support System (ADSS). In this approach, heuristic knowledge of expert assignment and techniques of operations research are integrated. The approach uses decision models to determine the best solution of reviewer assignment that maximizes the total expertise level of the reviewers assigned to proposals. It also balances the distribution of proposals at different grades and solves conflicts of interests between reviewers and applicants. Its application in the National Natural Science Foundation of China (NSFC) and the computational results of its effectiveness and efficiency are also described.",
author = "O. Liu and J. Wang and J. Ma and Y. Sun",
year = "2016",
month = "2",
day = "1",
doi = "10.1016/j.compind.2015.11.001",
language = "English",
volume = "76",
pages = "1--10",
journal = "Computers in Industry",
issn = "0166-3615",
publisher = "Elsevier",

}

An intelligent decision support approach for reviewer assignment in R&D project selection. / Liu, O.; Wang, J.; Ma, J.; Sun, Y.

In: Computers in Industry, Vol. 76, 01.02.2016, p. 1-10.

Research output: Contribution to journalArticle

TY - JOUR

T1 - An intelligent decision support approach for reviewer assignment in R&D project selection

AU - Liu, O.

AU - Wang, J.

AU - Ma, J.

AU - Sun, Y.

PY - 2016/2/1

Y1 - 2016/2/1

N2 - In the process of Research and Development (R&D) project selection, experts play an important role because their opinions are the foundation on which to judge the potential value of a project. How to assign the most appropriate experts to review project proposals might greatly affect the quality of project selection, which in turn could affect the return on investment of the funding organization. However, in many funding organizations, current approaches to assigning reviewers are still based on simply matching the discipline area of the reviewers with that of the proposal, which could result in poor quality of project selection and poor future financial return. Additionally, these approaches might make it difficult to balance resources and resolve conflicts of interests between reviewers and applicants. Therefore, to overcome these problems, there is an urgent need for a systematic approach to support and automate the reviewer assignment process. This research aims at proposing an intelligent decision support approach for reviewer assignment and developing an Assignment Decision Support System (ADSS). In this approach, heuristic knowledge of expert assignment and techniques of operations research are integrated. The approach uses decision models to determine the best solution of reviewer assignment that maximizes the total expertise level of the reviewers assigned to proposals. It also balances the distribution of proposals at different grades and solves conflicts of interests between reviewers and applicants. Its application in the National Natural Science Foundation of China (NSFC) and the computational results of its effectiveness and efficiency are also described.

AB - In the process of Research and Development (R&D) project selection, experts play an important role because their opinions are the foundation on which to judge the potential value of a project. How to assign the most appropriate experts to review project proposals might greatly affect the quality of project selection, which in turn could affect the return on investment of the funding organization. However, in many funding organizations, current approaches to assigning reviewers are still based on simply matching the discipline area of the reviewers with that of the proposal, which could result in poor quality of project selection and poor future financial return. Additionally, these approaches might make it difficult to balance resources and resolve conflicts of interests between reviewers and applicants. Therefore, to overcome these problems, there is an urgent need for a systematic approach to support and automate the reviewer assignment process. This research aims at proposing an intelligent decision support approach for reviewer assignment and developing an Assignment Decision Support System (ADSS). In this approach, heuristic knowledge of expert assignment and techniques of operations research are integrated. The approach uses decision models to determine the best solution of reviewer assignment that maximizes the total expertise level of the reviewers assigned to proposals. It also balances the distribution of proposals at different grades and solves conflicts of interests between reviewers and applicants. Its application in the National Natural Science Foundation of China (NSFC) and the computational results of its effectiveness and efficiency are also described.

UR - http://www.scopus.com/inward/record.url?eid=2-s2.0-84959317037&partnerID=MN8TOARS

UR - https://www.sciencedirect.com/science/article/pii/S0166361515300610?via%3Dihub

U2 - 10.1016/j.compind.2015.11.001

DO - 10.1016/j.compind.2015.11.001

M3 - Article

VL - 76

SP - 1

EP - 10

JO - Computers in Industry

JF - Computers in Industry

SN - 0166-3615

ER -