Discovering the preferences of physicians with regards to rank-ordered medical documents

Dympna O'Sullivan; Szymon Wilk; Wojtek Michalowski; Roman Słowiński; Roland Thomas; Ken Farion

doi:10.1007/978-3-642-31718-7_15

Discovering the preferences of physicians with regards to rank-ordered medical documents

Dympna O'Sullivan^*, Szymon Wilk, Wojtek Michalowski, Roman Słowiński, Roland Thomas, Ken Farion

^*Corresponding author for this work

Research output: Chapter in Book/Published conference output › Conference publication

Abstract

The practice of evidence-based medicine involves consulting documents from repositories such as Scopus, PubMed, or the Cochrane Library. The most common approach for presenting retrieved documents is in the form of a list, with the assumption that the higher a document is on a list, the more relevant it is. Despite this list-based presentation, it is seldom studied how physicians perceive the importance of the order of documents presented in a list. This paper describes an empirical study that elicited and modeled physicians' preferences with regard to list-based results. Preferences were analyzed using a GRIP method that relies on pairwise comparisons of selected subsets of possible rank-ordered lists composed of 3 documents. The results allow us to draw conclusions regarding physicians' attitudes towards the importance of having documents ranked correctly on a result list, versus the importance of retrieving relevant but misplaced documents. Our findings should help developers of clinical information retrieval applications when deciding how retrieved documents should be presented and how performance of the application should be assessed.

Original language	English
Title of host publication	Advances in computational intelligence
Subtitle of host publication	14th international conference on Information Processing and Management of Uncertainty in knowledge-based systems, IPMU 2012, Catania, Italy, July 9-13, 2012, proceedings, Part III
Editors	Salvatore Greco, Bernadette Bouchon-Meunier, Giulianella Coletti, et al
Place of Publication	Berlin (DE)
Publisher	Springer
Pages	142-150
Number of pages	9
ISBN (Electronic)	978-3-642-31718-7
ISBN (Print)	978-3-642-31717-0
DOIs	https://doi.org/10.1007/978-3-642-31718-7_15
Publication status	Published - 2012
Event	14th international conference on Information Processing and Management of Uncertainty in knowledge-based systems - Catania, Italy Duration: 9 Jul 2012 → 13 Jul 2012

Publication series

Name	Communications in computer and information science
Publisher	Springer
Volume	299
ISSN (Print)	1865-0929

Conference

Conference	14th international conference on Information Processing and Management of Uncertainty in knowledge-based systems
Abbreviated title	IPMU 2012
Country/Territory	Italy
City	Catania
Period	9/07/12 → 13/07/12

Keywords

Document Retrieval
Evidence-Based Medicine
Information Retrieval
Physician preferences
Rank-ordered Lists

Access to Document

10.1007/978-3-642-31718-7_15

http://www.mobiledss.uottawa.ca/fileadmin/publications/pdf/paper_ipmu_2012.pdf

Cite this

O'Sullivan, D., Wilk, S., Michalowski, W., Słowiński, R., Thomas, R., & Farion, K. (2012). Discovering the preferences of physicians with regards to rank-ordered medical documents. In S. Greco, B. Bouchon-Meunier, G. Coletti, & et al (Eds.), Advances in computational intelligence: 14th international conference on Information Processing and Management of Uncertainty in knowledge-based systems, IPMU 2012, Catania, Italy, July 9-13, 2012, proceedings, Part III (pp. 142-150). (Communications in computer and information science; Vol. 299). Springer. https://doi.org/10.1007/978-3-642-31718-7_15

O'Sullivan, Dympna ; Wilk, Szymon ; Michalowski, Wojtek et al. / Discovering the preferences of physicians with regards to rank-ordered medical documents. Advances in computational intelligence: 14th international conference on Information Processing and Management of Uncertainty in knowledge-based systems, IPMU 2012, Catania, Italy, July 9-13, 2012, proceedings, Part III. editor / Salvatore Greco ; Bernadette Bouchon-Meunier ; Giulianella Coletti ; et al. Berlin (DE) : Springer, 2012. pp. 142-150 (Communications in computer and information science).

@inproceedings{53ffbcb85ec44233b17ca9a070a52fad,

title = "Discovering the preferences of physicians with regards to rank-ordered medical documents",

abstract = "The practice of evidence-based medicine involves consulting documents from repositories such as Scopus, PubMed, or the Cochrane Library. The most common approach for presenting retrieved documents is in the form of a list, with the assumption that the higher a document is on a list, the more relevant it is. Despite this list-based presentation, it is seldom studied how physicians perceive the importance of the order of documents presented in a list. This paper describes an empirical study that elicited and modeled physicians' preferences with regard to list-based results. Preferences were analyzed using a GRIP method that relies on pairwise comparisons of selected subsets of possible rank-ordered lists composed of 3 documents. The results allow us to draw conclusions regarding physicians' attitudes towards the importance of having documents ranked correctly on a result list, versus the importance of retrieving relevant but misplaced documents. Our findings should help developers of clinical information retrieval applications when deciding how retrieved documents should be presented and how performance of the application should be assessed.",

keywords = "Document Retrieval, Evidence-Based Medicine, Information Retrieval, Physician preferences, Rank-ordered Lists",

author = "Dympna O'Sullivan and Szymon Wilk and Wojtek Michalowski and Roman S{\l}owi{\'n}ski and Roland Thomas and Ken Farion",

year = "2012",

doi = "10.1007/978-3-642-31718-7_15",

language = "English",

isbn = "978-3-642-31717-0",

series = "Communications in computer and information science",

publisher = "Springer",

pages = "142--150",

editor = "Salvatore Greco and Bernadette Bouchon-Meunier and Giulianella Coletti and {et al}",

booktitle = "Advances in computational intelligence",

address = "Germany",

note = "14th international conference on Information Processing and Management of Uncertainty in knowledge-based systems, IPMU 2012 ; Conference date: 09-07-2012 Through 13-07-2012",

}

O'Sullivan, D, Wilk, S, Michalowski, W, Słowiński, R, Thomas, R & Farion, K 2012, Discovering the preferences of physicians with regards to rank-ordered medical documents. in S Greco, B Bouchon-Meunier, G Coletti & et al (eds), Advances in computational intelligence: 14th international conference on Information Processing and Management of Uncertainty in knowledge-based systems, IPMU 2012, Catania, Italy, July 9-13, 2012, proceedings, Part III. Communications in computer and information science, vol. 299, Springer, Berlin (DE), pp. 142-150, 14th international conference on Information Processing and Management of Uncertainty in knowledge-based systems, Catania, Italy, 9/07/12. https://doi.org/10.1007/978-3-642-31718-7_15

Discovering the preferences of physicians with regards to rank-ordered medical documents. / O'Sullivan, Dympna; Wilk, Szymon; Michalowski, Wojtek et al.
Advances in computational intelligence: 14th international conference on Information Processing and Management of Uncertainty in knowledge-based systems, IPMU 2012, Catania, Italy, July 9-13, 2012, proceedings, Part III. ed. / Salvatore Greco; Bernadette Bouchon-Meunier; Giulianella Coletti; et al. Berlin (DE): Springer, 2012. p. 142-150 (Communications in computer and information science; Vol. 299).

Research output: Chapter in Book/Published conference output › Conference publication

TY - GEN

T1 - Discovering the preferences of physicians with regards to rank-ordered medical documents

AU - O'Sullivan, Dympna

AU - Wilk, Szymon

AU - Michalowski, Wojtek

AU - Słowiński, Roman

AU - Thomas, Roland

AU - Farion, Ken

PY - 2012

Y1 - 2012

N2 - The practice of evidence-based medicine involves consulting documents from repositories such as Scopus, PubMed, or the Cochrane Library. The most common approach for presenting retrieved documents is in the form of a list, with the assumption that the higher a document is on a list, the more relevant it is. Despite this list-based presentation, it is seldom studied how physicians perceive the importance of the order of documents presented in a list. This paper describes an empirical study that elicited and modeled physicians' preferences with regard to list-based results. Preferences were analyzed using a GRIP method that relies on pairwise comparisons of selected subsets of possible rank-ordered lists composed of 3 documents. The results allow us to draw conclusions regarding physicians' attitudes towards the importance of having documents ranked correctly on a result list, versus the importance of retrieving relevant but misplaced documents. Our findings should help developers of clinical information retrieval applications when deciding how retrieved documents should be presented and how performance of the application should be assessed.

AB - The practice of evidence-based medicine involves consulting documents from repositories such as Scopus, PubMed, or the Cochrane Library. The most common approach for presenting retrieved documents is in the form of a list, with the assumption that the higher a document is on a list, the more relevant it is. Despite this list-based presentation, it is seldom studied how physicians perceive the importance of the order of documents presented in a list. This paper describes an empirical study that elicited and modeled physicians' preferences with regard to list-based results. Preferences were analyzed using a GRIP method that relies on pairwise comparisons of selected subsets of possible rank-ordered lists composed of 3 documents. The results allow us to draw conclusions regarding physicians' attitudes towards the importance of having documents ranked correctly on a result list, versus the importance of retrieving relevant but misplaced documents. Our findings should help developers of clinical information retrieval applications when deciding how retrieved documents should be presented and how performance of the application should be assessed.

KW - Document Retrieval

KW - Evidence-Based Medicine

KW - Information Retrieval

KW - Physician preferences

KW - Rank-ordered Lists

UR - http://www.scopus.com/inward/record.url?scp=84868109755&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-31718-7_15

DO - 10.1007/978-3-642-31718-7_15

M3 - Conference publication

AN - SCOPUS:84868109755

SN - 978-3-642-31717-0

T3 - Communications in computer and information science

SP - 142

EP - 150

BT - Advances in computational intelligence

A2 - Greco, Salvatore

A2 - Bouchon-Meunier, Bernadette

A2 - Coletti, Giulianella

A2 - et al,

PB - Springer

CY - Berlin (DE)

T2 - 14th international conference on Information Processing and Management of Uncertainty in knowledge-based systems

Y2 - 9 July 2012 through 13 July 2012

ER -

O'Sullivan D, Wilk S, Michalowski W, Słowiński R, Thomas R, Farion K. Discovering the preferences of physicians with regards to rank-ordered medical documents. In Greco S, Bouchon-Meunier B, Coletti G, et al, editors, Advances in computational intelligence: 14th international conference on Information Processing and Management of Uncertainty in knowledge-based systems, IPMU 2012, Catania, Italy, July 9-13, 2012, proceedings, Part III. Berlin (DE): Springer. 2012. p. 142-150. (Communications in computer and information science). doi: 10.1007/978-3-642-31718-7_15

Discovering the preferences of physicians with regards to rank-ordered medical documents

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this