Automatic processing, quality assurance and serving of real-time weather data

Matthew Williams, Dan Cornford, Lucy Bastin, Richard Jones, Stephen Parker

Research output: Contribution to journalArticle

Abstract

Recent advances in technology have produced a significant increase in the availability of free sensor data over the Internet. With affordable weather monitoring stations now available to individual meteorology enthusiasts a reservoir of real time data such as temperature, rainfall and wind speed can now be obtained for most of the United States and Europe. Despite the abundance of available data, obtaining useable information about the weather in your local neighbourhood requires complex processing that poses several challenges. This paper discusses a collection of technologies and applications that harvest, refine and process this data, culminating in information that has been tailored toward the user. In this case we are particularly interested in allowing a user to make direct queries about the weather at any location, even when this is not directly instrumented, using interpolation methods. We also consider how the uncertainty that the interpolation introduces can then be communicated to the user of the system, using UncertML, a developing standard for uncertainty representation.
Original languageEnglish
Pages (from-to)353-362
Number of pages10
JournalComputers and Geosciences
Volume37
Issue number3
Early online date13 Oct 2010
DOIs
Publication statusPublished - Mar 2011

Fingerprint

Quality assurance
Interpolation
weather
Meteorology
Processing
Rain
interpolation
Availability
Internet
Monitoring
Sensors
meteorology
wind velocity
sensor
Temperature
rainfall
Uncertainty
quality assurance
temperature

Bibliographical note

NOTICE: this is the author’s version of a work that was accepted for publication in Computers and Geosciences. Changes resulting from the publishing process, such as peer review, editing, corrections, structural formatting, and other quality control mechanisms may not be reflected in this document. Changes may have been made to this work since it was submitted for publication. A definitive version was subsequently published in Williams, M, Cornford, D, Bastin, L, Jones, R & Parker, S, 'Automatic processing, quality assurance and serving of real-time weather data' Computers and geosciences, vol. 37, no. 3 (2011) DOI http://dx.doi.org/10.1016/j.cageo.2010.05.010

Keywords

  • user-contributed data
  • UncertML
  • INTAMAP
  • data quality
  • interpolation

Cite this

Williams, Matthew ; Cornford, Dan ; Bastin, Lucy ; Jones, Richard ; Parker, Stephen. / Automatic processing, quality assurance and serving of real-time weather data. In: Computers and Geosciences. 2011 ; Vol. 37, No. 3. pp. 353-362.
@article{19b1f27450c24414bdb27f560c2fb65a,
title = "Automatic processing, quality assurance and serving of real-time weather data",
abstract = "Recent advances in technology have produced a significant increase in the availability of free sensor data over the Internet. With affordable weather monitoring stations now available to individual meteorology enthusiasts a reservoir of real time data such as temperature, rainfall and wind speed can now be obtained for most of the United States and Europe. Despite the abundance of available data, obtaining useable information about the weather in your local neighbourhood requires complex processing that poses several challenges. This paper discusses a collection of technologies and applications that harvest, refine and process this data, culminating in information that has been tailored toward the user. In this case we are particularly interested in allowing a user to make direct queries about the weather at any location, even when this is not directly instrumented, using interpolation methods. We also consider how the uncertainty that the interpolation introduces can then be communicated to the user of the system, using UncertML, a developing standard for uncertainty representation.",
keywords = "user-contributed data, UncertML, INTAMAP, data quality, interpolation",
author = "Matthew Williams and Dan Cornford and Lucy Bastin and Richard Jones and Stephen Parker",
note = "NOTICE: this is the author’s version of a work that was accepted for publication in Computers and Geosciences. Changes resulting from the publishing process, such as peer review, editing, corrections, structural formatting, and other quality control mechanisms may not be reflected in this document. Changes may have been made to this work since it was submitted for publication. A definitive version was subsequently published in Williams, M, Cornford, D, Bastin, L, Jones, R & Parker, S, 'Automatic processing, quality assurance and serving of real-time weather data' Computers and geosciences, vol. 37, no. 3 (2011) DOI http://dx.doi.org/10.1016/j.cageo.2010.05.010",
year = "2011",
month = "3",
doi = "10.1016/j.cageo.2010.05.010",
language = "English",
volume = "37",
pages = "353--362",
journal = "Computers and Geosciences",
issn = "0098-3004",
publisher = "Elsevier",
number = "3",

}

Automatic processing, quality assurance and serving of real-time weather data. / Williams, Matthew; Cornford, Dan; Bastin, Lucy; Jones, Richard; Parker, Stephen.

In: Computers and Geosciences, Vol. 37, No. 3, 03.2011, p. 353-362.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Automatic processing, quality assurance and serving of real-time weather data

AU - Williams, Matthew

AU - Cornford, Dan

AU - Bastin, Lucy

AU - Jones, Richard

AU - Parker, Stephen

N1 - NOTICE: this is the author’s version of a work that was accepted for publication in Computers and Geosciences. Changes resulting from the publishing process, such as peer review, editing, corrections, structural formatting, and other quality control mechanisms may not be reflected in this document. Changes may have been made to this work since it was submitted for publication. A definitive version was subsequently published in Williams, M, Cornford, D, Bastin, L, Jones, R & Parker, S, 'Automatic processing, quality assurance and serving of real-time weather data' Computers and geosciences, vol. 37, no. 3 (2011) DOI http://dx.doi.org/10.1016/j.cageo.2010.05.010

PY - 2011/3

Y1 - 2011/3

N2 - Recent advances in technology have produced a significant increase in the availability of free sensor data over the Internet. With affordable weather monitoring stations now available to individual meteorology enthusiasts a reservoir of real time data such as temperature, rainfall and wind speed can now be obtained for most of the United States and Europe. Despite the abundance of available data, obtaining useable information about the weather in your local neighbourhood requires complex processing that poses several challenges. This paper discusses a collection of technologies and applications that harvest, refine and process this data, culminating in information that has been tailored toward the user. In this case we are particularly interested in allowing a user to make direct queries about the weather at any location, even when this is not directly instrumented, using interpolation methods. We also consider how the uncertainty that the interpolation introduces can then be communicated to the user of the system, using UncertML, a developing standard for uncertainty representation.

AB - Recent advances in technology have produced a significant increase in the availability of free sensor data over the Internet. With affordable weather monitoring stations now available to individual meteorology enthusiasts a reservoir of real time data such as temperature, rainfall and wind speed can now be obtained for most of the United States and Europe. Despite the abundance of available data, obtaining useable information about the weather in your local neighbourhood requires complex processing that poses several challenges. This paper discusses a collection of technologies and applications that harvest, refine and process this data, culminating in information that has been tailored toward the user. In this case we are particularly interested in allowing a user to make direct queries about the weather at any location, even when this is not directly instrumented, using interpolation methods. We also consider how the uncertainty that the interpolation introduces can then be communicated to the user of the system, using UncertML, a developing standard for uncertainty representation.

KW - user-contributed data

KW - UncertML

KW - INTAMAP

KW - data quality

KW - interpolation

UR - http://www.scopus.com/inward/record.url?scp=79952195841&partnerID=8YFLogxK

U2 - 10.1016/j.cageo.2010.05.010

DO - 10.1016/j.cageo.2010.05.010

M3 - Article

VL - 37

SP - 353

EP - 362

JO - Computers and Geosciences

JF - Computers and Geosciences

SN - 0098-3004

IS - 3

ER -