A framework for evaluating semantic metadata

Yuangui Lei, Victoria Uren, Enrico Motta

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Because poor quality semantic metadata can destroy the effectiveness of semantic web technology by hampering applications from producing accurate results, it is important to have frameworks that support their evaluation. However, there is no such framework developedto date. In this context, we proposed i) an evaluation reference model, SemRef, which sketches some fundamental principles for evaluating semantic metadata, and ii) an evaluation framework, SemEval, which provides a set of instruments to support the detection of quality problems and the collection of quality metrics for these problems. A preliminary case study of SemEval shows encouraging results.
Original languageEnglish
Title of host publicationK-CAP '07 - proceedings of the 4th international conference on Knowledge capture
EditorsDerek Sleeman, Ken Barker
Place of PublicationNew York, NY (US)
PublisherACM
Pages135-142
Number of pages8
ISBN (Print)978-1-59593-643-1
DOIs
Publication statusPublished - 28 Oct 2007
Event4th International Conference on Knowledge Capture - Whistler, BC, Canada
Duration: 28 Oct 200731 Oct 2007

Conference

Conference4th International Conference on Knowledge Capture
Abbreviated titleK-CAP'07
CountryCanada
CityWhistler, BC
Period28/10/0731/10/07

Fingerprint

Metadata
Semantics
Semantic Web

Cite this

Lei, Y., Uren, V., & Motta, E. (2007). A framework for evaluating semantic metadata. In D. Sleeman, & K. Barker (Eds.), K-CAP '07 - proceedings of the 4th international conference on Knowledge capture (pp. 135-142). New York, NY (US): ACM. https://doi.org/10.1145/1298406.1298431
Lei, Yuangui ; Uren, Victoria ; Motta, Enrico. / A framework for evaluating semantic metadata. K-CAP '07 - proceedings of the 4th international conference on Knowledge capture. editor / Derek Sleeman ; Ken Barker. New York, NY (US) : ACM, 2007. pp. 135-142
@inproceedings{6807b8415b5d4b92bdaa5c5d3f7d06b0,
title = "A framework for evaluating semantic metadata",
abstract = "Because poor quality semantic metadata can destroy the effectiveness of semantic web technology by hampering applications from producing accurate results, it is important to have frameworks that support their evaluation. However, there is no such framework developedto date. In this context, we proposed i) an evaluation reference model, SemRef, which sketches some fundamental principles for evaluating semantic metadata, and ii) an evaluation framework, SemEval, which provides a set of instruments to support the detection of quality problems and the collection of quality metrics for these problems. A preliminary case study of SemEval shows encouraging results.",
author = "Yuangui Lei and Victoria Uren and Enrico Motta",
year = "2007",
month = "10",
day = "28",
doi = "10.1145/1298406.1298431",
language = "English",
isbn = "978-1-59593-643-1",
pages = "135--142",
editor = "Derek Sleeman and Ken Barker",
booktitle = "K-CAP '07 - proceedings of the 4th international conference on Knowledge capture",
publisher = "ACM",
address = "United States",

}

Lei, Y, Uren, V & Motta, E 2007, A framework for evaluating semantic metadata. in D Sleeman & K Barker (eds), K-CAP '07 - proceedings of the 4th international conference on Knowledge capture. ACM, New York, NY (US), pp. 135-142, 4th International Conference on Knowledge Capture, Whistler, BC, Canada, 28/10/07. https://doi.org/10.1145/1298406.1298431

A framework for evaluating semantic metadata. / Lei, Yuangui; Uren, Victoria; Motta, Enrico.

K-CAP '07 - proceedings of the 4th international conference on Knowledge capture. ed. / Derek Sleeman; Ken Barker. New York, NY (US) : ACM, 2007. p. 135-142.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - A framework for evaluating semantic metadata

AU - Lei, Yuangui

AU - Uren, Victoria

AU - Motta, Enrico

PY - 2007/10/28

Y1 - 2007/10/28

N2 - Because poor quality semantic metadata can destroy the effectiveness of semantic web technology by hampering applications from producing accurate results, it is important to have frameworks that support their evaluation. However, there is no such framework developedto date. In this context, we proposed i) an evaluation reference model, SemRef, which sketches some fundamental principles for evaluating semantic metadata, and ii) an evaluation framework, SemEval, which provides a set of instruments to support the detection of quality problems and the collection of quality metrics for these problems. A preliminary case study of SemEval shows encouraging results.

AB - Because poor quality semantic metadata can destroy the effectiveness of semantic web technology by hampering applications from producing accurate results, it is important to have frameworks that support their evaluation. However, there is no such framework developedto date. In this context, we proposed i) an evaluation reference model, SemRef, which sketches some fundamental principles for evaluating semantic metadata, and ii) an evaluation framework, SemEval, which provides a set of instruments to support the detection of quality problems and the collection of quality metrics for these problems. A preliminary case study of SemEval shows encouraging results.

UR - http://dl.acm.org/citation.cfm?doid=1298406.1298431

U2 - 10.1145/1298406.1298431

DO - 10.1145/1298406.1298431

M3 - Conference contribution

SN - 978-1-59593-643-1

SP - 135

EP - 142

BT - K-CAP '07 - proceedings of the 4th international conference on Knowledge capture

A2 - Sleeman, Derek

A2 - Barker, Ken

PB - ACM

CY - New York, NY (US)

ER -

Lei Y, Uren V, Motta E. A framework for evaluating semantic metadata. In Sleeman D, Barker K, editors, K-CAP '07 - proceedings of the 4th international conference on Knowledge capture. New York, NY (US): ACM. 2007. p. 135-142 https://doi.org/10.1145/1298406.1298431