Fluxdata.org: Publication and Curation of Shared Scientific Climate and Earth Sciences Data
- 1 December 2009
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
Abstract
Many of today's large-scale scientific projects attempt to collect data from a diverse set of sources. The traditional campaign-style approach to ¿synthesis¿ efforts gathers data through a single concentrated effort, and the data contributors know in advance exactly who will use their data and why. At even moderate scales, the cost and time required to find, gather, collate, normalize, and customize data in order to build a synthesis dataset can quickly outweigh the value of the resulting dataset. By explicitly identifying and addressing the different requirements for each data role (author, publisher, curator, and consumer), our data management architecture for large-scale shared scientific data enables the creation of such synthesis datasets that continue to grow and evolve with new data, data annotations, participants, and use rules. We show the effectiveness of our approach in the context of the FLUXNET Synthesis Dataset, one of the largest ongoing biogeophysical experiments.Keywords
This publication has 6 references indexed in Scilit:
- CASA and LEAD: adaptive cyberinfrastructure for real-time multiscale weather forecastingComputer, 2006
- GridFS: Targeting Data Sharing in Grid EnvironmentsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2006
- A survey of data provenance in e-scienceACM SIGMOD Record, 2005
- FLUXNET: A New Tool to Study the Temporal and Spatial Variability of Ecosystem–Scale Carbon Dioxide, Water Vapor, and Energy Flux DensitiesBulletin of the American Meteorological Society, 2001
- The data grid: Towards an architecture for the distributed management and analysis of large scientific datasetsJournal of Network and Computer Applications, 2000
- Data management for large‐scale scientific computations in high performance distributed systemsCluster Computing, 2000