Automatic processing, quality assurance and serving of real-time weather data

Matthew Williams; Dan Cornford; Lucy Bastin; Richard Jones; Stephen Parker

doi:10.1016/j.cageo.2010.05.010

Automatic processing, quality assurance and serving of real-time weather data

Matthew Williams, Dan Cornford, Lucy Bastin, Richard Jones, Stephen Parker

Research output: Contribution to journal › Article › peer-review

Abstract

Recent advances in technology have produced a significant increase in the availability of free sensor data over the Internet. With affordable weather monitoring stations now available to individual meteorology enthusiasts a reservoir of real time data such as temperature, rainfall and wind speed can now be obtained for most of the United States and Europe. Despite the abundance of available data, obtaining useable information about the weather in your local neighbourhood requires complex processing that poses several challenges. This paper discusses a collection of technologies and applications that harvest, refine and process this data, culminating in information that has been tailored toward the user. In this case we are particularly interested in allowing a user to make direct queries about the weather at any location, even when this is not directly instrumented, using interpolation methods. We also consider how the uncertainty that the interpolation introduces can then be communicated to the user of the system, using UncertML, a developing standard for uncertainty representation.

Original language	English
Pages (from-to)	353-362
Number of pages	10
Journal	Computers and Geosciences
Volume	37
Issue number	3
Early online date	13 Oct 2010
DOIs	https://doi.org/10.1016/j.cageo.2010.05.010
Publication status	Published - Mar 2011

Bibliographical note

NOTICE: this is the author’s version of a work that was accepted for publication in Computers and Geosciences. Changes resulting from the publishing process, such as peer review, editing, corrections, structural formatting, and other quality control mechanisms may not be reflected in this document. Changes may have been made to this work since it was submitted for publication. A definitive version was subsequently published in Williams, M, Cornford, D, Bastin, L, Jones, R & Parker, S, 'Automatic processing, quality assurance and serving of real-time weather data' Computers and geosciences, vol. 37, no. 3 (2011) DOI http://dx.doi.org/10.1016/j.cageo.2010.05.010

Keywords

user-contributed data
UncertML
INTAMAP
data quality
interpolation

Access to Document

10.1016/j.cageo.2010.05.010

Automatic processing, quality assurance and serving
NOTICE: this is the author’s version of a work that was accepted for publication in Computers and Geosciences. Changes resulting from the publishing process, such as peer review, editing, corrections, structural formatting, and other quality control mechanisms may not be reflected in this document. Changes may have been made to this work since it was submitted for publication. A definitive version was subsequently published in Williams, M, Cornford, D, Bastin, L, Jones, R & Parker, S, 'Automatic processing, quality assurance and serving of real-time weather data' Computers and geosciences, vol. 37, no. 3 (2011) DOI http://dx.doi.org/10.1016/j.cageo.2010.05.010
Accepted author manuscript, 864 KB

Cite this

@article{19b1f27450c24414bdb27f560c2fb65a,

title = "Automatic processing, quality assurance and serving of real-time weather data",

abstract = "Recent advances in technology have produced a significant increase in the availability of free sensor data over the Internet. With affordable weather monitoring stations now available to individual meteorology enthusiasts a reservoir of real time data such as temperature, rainfall and wind speed can now be obtained for most of the United States and Europe. Despite the abundance of available data, obtaining useable information about the weather in your local neighbourhood requires complex processing that poses several challenges. This paper discusses a collection of technologies and applications that harvest, refine and process this data, culminating in information that has been tailored toward the user. In this case we are particularly interested in allowing a user to make direct queries about the weather at any location, even when this is not directly instrumented, using interpolation methods. We also consider how the uncertainty that the interpolation introduces can then be communicated to the user of the system, using UncertML, a developing standard for uncertainty representation.",

keywords = "user-contributed data, UncertML, INTAMAP, data quality, interpolation",

author = "Matthew Williams and Dan Cornford and Lucy Bastin and Richard Jones and Stephen Parker",

note = "NOTICE: this is the author{\textquoteright}s version of a work that was accepted for publication in Computers and Geosciences. Changes resulting from the publishing process, such as peer review, editing, corrections, structural formatting, and other quality control mechanisms may not be reflected in this document. Changes may have been made to this work since it was submitted for publication. A definitive version was subsequently published in Williams, M, Cornford, D, Bastin, L, Jones, R & Parker, S, 'Automatic processing, quality assurance and serving of real-time weather data' Computers and geosciences, vol. 37, no. 3 (2011) DOI http://dx.doi.org/10.1016/j.cageo.2010.05.010",

year = "2011",

month = mar,

doi = "10.1016/j.cageo.2010.05.010",

language = "English",

volume = "37",

pages = "353--362",

journal = "Computers and Geosciences",

issn = "0098-3004",

publisher = "Elsevier",

number = "3",

}

TY - JOUR

T1 - Automatic processing, quality assurance and serving of real-time weather data

AU - Williams, Matthew

AU - Cornford, Dan

AU - Bastin, Lucy

AU - Jones, Richard

AU - Parker, Stephen

N1 - NOTICE: this is the author’s version of a work that was accepted for publication in Computers and Geosciences. Changes resulting from the publishing process, such as peer review, editing, corrections, structural formatting, and other quality control mechanisms may not be reflected in this document. Changes may have been made to this work since it was submitted for publication. A definitive version was subsequently published in Williams, M, Cornford, D, Bastin, L, Jones, R & Parker, S, 'Automatic processing, quality assurance and serving of real-time weather data' Computers and geosciences, vol. 37, no. 3 (2011) DOI http://dx.doi.org/10.1016/j.cageo.2010.05.010

PY - 2011/3

Y1 - 2011/3

N2 - Recent advances in technology have produced a significant increase in the availability of free sensor data over the Internet. With affordable weather monitoring stations now available to individual meteorology enthusiasts a reservoir of real time data such as temperature, rainfall and wind speed can now be obtained for most of the United States and Europe. Despite the abundance of available data, obtaining useable information about the weather in your local neighbourhood requires complex processing that poses several challenges. This paper discusses a collection of technologies and applications that harvest, refine and process this data, culminating in information that has been tailored toward the user. In this case we are particularly interested in allowing a user to make direct queries about the weather at any location, even when this is not directly instrumented, using interpolation methods. We also consider how the uncertainty that the interpolation introduces can then be communicated to the user of the system, using UncertML, a developing standard for uncertainty representation.

AB - Recent advances in technology have produced a significant increase in the availability of free sensor data over the Internet. With affordable weather monitoring stations now available to individual meteorology enthusiasts a reservoir of real time data such as temperature, rainfall and wind speed can now be obtained for most of the United States and Europe. Despite the abundance of available data, obtaining useable information about the weather in your local neighbourhood requires complex processing that poses several challenges. This paper discusses a collection of technologies and applications that harvest, refine and process this data, culminating in information that has been tailored toward the user. In this case we are particularly interested in allowing a user to make direct queries about the weather at any location, even when this is not directly instrumented, using interpolation methods. We also consider how the uncertainty that the interpolation introduces can then be communicated to the user of the system, using UncertML, a developing standard for uncertainty representation.

KW - user-contributed data

KW - UncertML

KW - INTAMAP

KW - data quality

KW - interpolation

UR - http://www.scopus.com/inward/record.url?scp=79952195841&partnerID=8YFLogxK

U2 - 10.1016/j.cageo.2010.05.010

DO - 10.1016/j.cageo.2010.05.010

M3 - Article

VL - 37

SP - 353

EP - 362

JO - Computers and Geosciences

JF - Computers and Geosciences

SN - 0098-3004

IS - 3

ER -

Automatic processing, quality assurance and serving of real-time weather data

Abstract

Bibliographical note

Keywords

Access to Document

Other files and links

Fingerprint

Best Informatics paper award, Computers and Geosciences

Cite this

Automatic processing, quality assurance and serving of real-time weather data

Abstract

Bibliographical note

Keywords

Access to Document

Other files and links

Fingerprint

Prizes

Best Informatics paper award, Computers and Geosciences

Cite this