ICOS data levels and quality

ICOS data are quantitative or qualitative attributes of variables or sets of variables that have been gathered using ICOS-recommended sensors at validated ICOS stations. The measurements are standardised due to protocols mutually agreed upon.

On this page:

ICOS data comply to international standards

ICOS management of data follows the international developments and standardisation. ICOS data and data that describes the datasets (metadata) are Findable, Accessible, Interoperable, and Reusable, so called FAIR principles. In practice, the FAIR principles aim at giving the user sufficient tools to understand the meaning of the data before and after downloading them.

We follow the standards of the Infrastructure for Spatial Information in Europe (INSPIRE), which are based on the ISO 19115 metadata standard.

Data product levels

ICOS Data Portal has three levels of data and data products: these are represented by the numbers 0, 2 and 3. In addition, there are raw data and Level 0 data.

Please note that there are more data flow levels presented below that are available as data products:

Raw data

Raw data are information or objects directly ob-tained from human measurements or automated sensors that have not undergone any transforma-tion. They may provide quantitative or qualitative information about physical variables of the environ-ment and may be of various forms, such as images, text files or physical samples.

Level 0 data

Level 0 data are data in physical units either direct-ly provided by instruments or converted from engi-neering units (for example, mV, mA, Ω) to physical units at the Thematic Centre. They may have been filtered by a quality check (for example, thresholds).

Level 1 data

Level 1 Near Real Time data (L1_NRT): NRT data are generally developed for fast distribution using auto-mated quality control within 24 hours of the meas-urement. NRT data are defined as a high-quality dataset that will be distributed in the default way. These datasets have their own provenance metadata that describe the raw data used, the versions of the software and the scripts, the settings and the results of the automatic quality control.

Level 1 Internal Working data (L1_IW): Internal Working data are data that are generated as inter-mediate steps in the data processing of NRT or Level 2 data preparation, and for this reason they are not handled as persistent data and not shared outside the ICOS RI. The Level 1 data are used for internal quality checks, as in communication between Cen-tral Facilities and Principal Investigators. During the production of internal working data and following quality checks, important provenance information is generated that needs to become a part of the prov-enance metadata of Level 2 data.

Level 2 data: observational data

Level 2 data are the final, quality-checked ICOS RI dataset, published by the Central Facilities, to be distributed through the Carbon Portal.

Level 3 data: elaborated products

All kinds of products elaborated by scientific communities that rely partly or completely on ICOS data products are called Level 3 data. The Carbon Portal will provide resources to integrate and disseminate Level 3 products, which will be provided on a voluntary basis by the research community and/or, if agreed upon, by collaborative projects. Data products that are based on ICOS observational data can be presented at the Data Portal as an elaborated product. In this case, please contact info (at) icos-cp.eu for more information.
 

Metadata: information on measurements methods & data processing

Dataset that describe the data are called metadata, and they are very important for the usability and transparency of data. Although not yet fully operational, the metadata for each dataset at ICOS Data Portal will give access to information on how the variables were measured and processed.

The ICOS measurements methods are described in protocols and various datasets are supported by specific documentation. Description of instruments and measurement protocols are available through the Thematic Centres.