User Tools

Site Tools


the_capri_data_base

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision
Previous revision
the_capri_data_base [2020/08/02 07:04] – [Overview and data requirements for the national scale] matszthe_capri_data_base [2022/11/07 10:23] (current) – external edit 127.0.0.1
Line 135: Line 135:
 ** Table 4: Temporal coverage of national data by region ** ** Table 4: Temporal coverage of national data by region **
 ^ Member State ^ Range ^ ^ Member State ^ Range ^
-| EU15 Member States without Germany | 1984 – 2014 +| EU15 Member States without Germany | 1984 – 2018/2019 
-| Germany and (12) New Member States | 1989 – 2014 +| Germany and (12) New Member States | 1989 – 2018/2019 
-| Western Balkan (WB) Countries and Turkey | 1995 – 2014 +| Western Balkan (WB) Countries and Turkey | 1995 – 2018/2019 
-| Norway | 1984 – 2014 |+| Norway | 1984 – 2017 |
  
 === Eurostat data === === Eurostat data ===
Line 164: Line 164:
  
 ** Second step: data selection and code mapping ** ** Second step: data selection and code mapping **
 +
 The second step is data selection and code mapping performed by the GAMS program //‘coco_input.gms’.// Cross sets linking Eurostat codes to COCO codes define the subset of data series subsequently used. The second step is data selection and code mapping performed by the GAMS program //‘coco_input.gms’.// Cross sets linking Eurostat codes to COCO codes define the subset of data series subsequently used.
  
Line 171: Line 172:
   * //‘eurostat_ econfinc_mapping.gms’// for the tables from Eurostat’s “Economy and Finance” Statistics   * //‘eurostat_ econfinc_mapping.gms’// for the tables from Eurostat’s “Economy and Finance” Statistics
  
-Example from file //‘Eurostat _agriculture_mapping.gms’//+Example from file //‘Eurostat _agriculture_mapping.gms’//. The results of the program run are gdx-files loaded by files (e.g. coco/coco1_eurostat.gms) which are in turn loaded by coco1.gms or coco2.gms. 
 + 
 +<code fortran> 
 +SET EcoActMAP(ASS_COLS,ASS_ROWS,eco_act_ori_eurostat) "mapping"
 +EAAP.CERE. aact_eaa01_01000_PROD_PP_MIO_EUR 
 +EAAP.SWHE. aact_eaa01_01110_PROD_PP_MIO_EUR 
 +EAAP.DWHE. aact_eaa01_01120_PROD_PP_MIO_EUR /; 
  
-| SET AgriProdOriEurostat / \\ apro_acs_a_C1000_AR "CEREALS-EXCLUDING RICE-AREA"\\ apro_acs_a_C1110_AR "COMMON WHEAT AND SPELT - AREA" \\ \\ SET AgriProd_MAP(ASS_COLS,ASS_ROWS,AgriProdOriEurostat) / \\ CERE.LEVL. apro_acs_a_C1000_AR \\ SWHE.LEVL. apro_acs_a_C1110_AR | 
  
-The results of the program run are gdx-files loaded by files (e.g. coco/coco1_eurostat.gmswhich are in turn loaded by coco1.gms or coco2.gms.+SET AgriProdMAP(ASS_COLS,ASS_ROWS,agri_prod_ori_eurostat) "mapping" / 
 +CERE.LEVL.( apro_cpnh1_C1000_AR,apro_cpnh1_h_C1000_AR) 
 +SWHE.LEVL.( apro_cpnh1_C1110_AR,apro_cpnh1_h_C1110_AR) 
 +SWH1.LEVL.( apro_cpnh1_C1111_AR,apro_cpnh1_h_C1111_AR) /; 
 +</code>
  
 === Western Balkan Countries and Turkey === === Western Balkan Countries and Turkey ===
Line 196: Line 207:
 === Other additional input data === === Other additional input data ===
  
-COCO1: Biofuels+COCO1: Biofuels FIXME (most links are not working anymore, remove or re-link)
  
   * Production, market balance and feedstock quantities for biodiesel and bioethanol are collected from a multitude of sources:   * Production, market balance and feedstock quantities for biodiesel and bioethanol are collected from a multitude of sources:
Line 1018: Line 1029:
  
 After this last include file the completions in module COCO2 are finished and the main output file (coco2_output.gdx) is unloaded. This file is loaded in subsequent modules (main use in CAPREG, but also in CAPTRD for nowcasting and in CAPMOD for update of LULUCF coefficients).   After this last include file the completions in module COCO2 are finished and the main output file (coco2_output.gdx) is unloaded. This file is loaded in subsequent modules (main use in CAPREG, but also in CAPTRD for nowcasting and in CAPMOD for update of LULUCF coefficients).  
 +
 +
 +
 +====Annex: Code lists for the COCO database====
 +
 +This section includes detailed code lists, which are in use in the COCO database.
 +
 +**Table: Codes used for storing the original REGIO tables in the database and their description (rows)**
 +
 +^ Codes used in CAPRI REGIO tables ^ Original REGIO description ^
 +| TOTL | Territorial area |
 +| FORE | Forest land |
 +| AGRI | Utilized agricultural area |
 +| GARD | Private gardens |
 +| GRAS | Permanent grassland |
 +| PERM | Permanent crops |
 +| VINE | Vineyards |
 +| OLIV | Olive plantations |
 +| ARAB | Arable land |
 +| GREF | Green fodder on arable land |
 +| CERE | Cereals (including rice) |
 +| WHEA | Soft and durum wheat and spelt |
 +| BARL | Barley |
 +| MAIZ | Grain maize |
 +| RICE | Rice |
 +| POTA | Potatoes |
 +| SUGA | Sugar beet |
 +| OILS | Oilseeds (total) |
 +| RAPE | Rape |
 +| SUNF | Sunflower |
 +| TOBA | Tobacco |
 +| MAIF | Fodder maize |
 +| CATT | Cattle (total) |
 +| COWT | Cows (total) |
 +| DCOW | Dairy cows |
 +| CALV | Other cows |
 +| CAT1 | Total cattle under one year |
 +| CALF | Slaughter calves |
 +| CABM | Male breeding calves (\&lt;1 year) |
 +| CABF | Female breeding calves (\&lt;1 year) |
 +| BUL2 | Male cattle (1-2 years) |
 +| H2SL | Slaughter heifers (1-2 years) |
 +| H2BR | Female cattle (1-2 years) |
 +| BUL3 | Male cattle (2 years and above) |
 +| H3SL | Slaughter heifers (2 years and above) |
 +| H3BR | Breeding heifers |
 +| BUFF | Total buffaloes |
 +| PIGS | Total pigs (total) |
 +| PIG1 | Piglets under 20 kg |
 +| PIG2 | Piglets under 50 kg and over 20 kg |
 +| PIG3 | Fattening pigs over 50 kg |
 +| BOAR | Breeding boars |
 +| SOW2 | Total breeding sows |
 +| SOW1 | Sows having farrowed |
 +| GILT | Gilts having farrowed for the first time |
 +| SOWM | Maiden sows |
 +| GILM | Maiden gilts |
 +| SHEP | Sheep total) |
 +| GOAT | Goats (total) |
 +| EUQI | Equidae (total) |
 +| POUL | Poultry (total) |
 +| OUTP | Final production |
 +| CROP | Total crops production |
 +| DWHE | Durum wheat |
 +| PULS | Pulses |
 +| ROOT | Roots and tubers |
 +| INDU | Industrial crops |
 +| TEXT | Textile fibre plants |
 +| HOPS | Hops |
 +| VEGE | Fresh vegetables |
 +| TOMA | Tomatoes |
 +| CAUL | Cauliflowers |
 +| FRUI | Fresh fruit |
 +| APPL | Apples |
 +| PEAR | Pears |
 +| PEAC | Peaches |
 +| CITR | Citrus fruit (total) |
 +| ORAN | Oranges |
 +| LEMN | Lemons |
 +| MAND | Mandarins |
 +| GRAP | Table grapes |
 +| WINE | Wine |
 +| TABO | Table olives |
 +| OLIO | Olive oil |
 +| NURS | Nursery plants |
 +| FLOW | Flowers and ornamental plants |
 +| OCRO | Other crops |
 +| ANIT | Total animal production |
 +| ANIM | Animal |
 +| SHGO | Sheep and goats |
 +| ANIP | Animal products |
 +| MILK | Milk |
 +| EGGS | Eggs |
 +| INPU | Intermediate consumption (total) |
 +| FEED | Animal feeding stuffs |
 +| FDGR | Animal compounds for grazing livestock |
 +| FDPI | Animal compounds for pigs |
 +| FDPO | Animal compounds for poultry |
 +| FODD | Straight feeding stuffs |
 +| FERT | Fertilizers and enrichments |
 +| ENER | Energy and lubricants |
 +| INPO | Other inputs |
 +| GVAM | Gross value added at market prices |
 +| SUBS | Subsidies |
 +| TAXS | Taxes linked to production (including VAT balance) |
 +| GVAF | Gross value added at factor costs |
 +| DEPM | Depreciation |
 +| LABO | Compensation and social security contributions of employees |
 +| RENT | Rent and other payments |
 +| INTE | Interests |
 +| GFCF | Total of gross fixed capital formation |
 +| BUIL | Buildings and other structures |
 +| MACH | Transport equipment and machinery |
 +| GFCO | Other gross fixed capital formation |
 +
 +**Table: Codes used for storing the original REGIO tables in the data base and their description (columns)**
 +
 +^ Codes used in CAPRI REGIO tables ^ Original REGIO description ^
 +| LEVL | Herd size / Area / # of persons |
 +| LSUN | Live stock units |
 +| PROP | Physical production |
 +| YILD | Yield |
 +| VALE | EAA position in ECU |
 +| VALN | EAA position in NC |
 +
 +**Table: Connection between CAPRI and REGIO crop areas, crop production and herd sizes**
 +
 +^ SPEL-code ^ REGIO-code ^ REGIO-code ^ REGIO-code ^ REGIO-code ^ Description of SPEL activity ^
 +| SWHE | WHEA | CERE | ARAB | | Soft wheat |
 +| DWHE | WHEA | CERE | ARAB | | Durum wheat |
 +| RYE | | CERE | ARAB | | Rye |
 +| BARL | BARL | CERE | ARAB | | Barley |
 +| OATS | | CERE | ARAB | | Oats |
 +| MAIZ | MAIZ | CERE | ARAB | | Maize |
 +| OCER | | CERE | ARAB | | Other cereals (excl. rice) |
 +| PARI | RICE | CERE | ARAB | | Paddy rice |
 +| PULS | | | ARAB | | Pulses |
 +| POTA | POTA | | ARAB | | Potatoes |
 +| SUGB | SUGA | | ARAB | | Sugar beet |
 +| RAPE | RAPE | OILS | ARAB | | Rape and turnip rape |
 +| SUNF | SUNF | OILS | ARAB | | Sunflower seed |
 +| SOYA | | OILS | ARAB | | Soya beans |
 +| OLIV | | OLIV | PERM | | Olives for oil |
 +| OOIL | | OILS | ARAB | | Other oil seeds and oleaginous fruits |
 +| FLAX | | | ARAB | | Flax and hemp \*\*\* (faser) \*\*\* |
 +| TOBA | TOBA | | ARAB | | Tobacco, unmanufactured, incl. dried |
 +| OIND | | | ARAB | | Other industrial crops |
 +| CAUL | | | ARAB | | Cauliflowers |
 +| TOMA | | | ARAB | | Tomatoes |
 +| OVEG | | | ARAB | | Other vegetables |
 +| APPL | | | PERM | | Apples, pears and peaches |
 +| OFRU | | | PERM | | Other fresh fruits |
 +| CITR | | | PERM | | Citrus fruits |
 +| TAGR | | VINE | PERM | | Table grapes |
 +| TABO | | OLIV | PERM | | Table olives |
 +| TWIN | | VINE | PERM | | Table wine |
 +| OWIN | | VINE | PERM | | Other wine |
 +| NURS | | | PERM | | Nursery plants |
 +| FLOW | | | ARAB | | Flowers,ornamental plants, etc. |
 +| OCRO | | | ARAB | | Other final crop products |
 +| MILK | DCOW | | | | Dairy cows |
 +| BEEF | BUL2 | BUL3 | | | Bulls fattening |
 +| CALF | CALF | | | | Calves fattening (old VEAL) |
 +| PORK | PIG3 | PIG2 | PIG1 | | Pig fattening |
 +| MUTM | GOAT | SHEP | | | Ewes and goats |
 +| MUTT | GOAT | SHEP | | | Sheep and goat fattening |
 +| EGGS | POUL | | | | Laying hens |
 +| POUL | POUL | | | | Poultry fattening |
 +| OANI | | | | | Other animals |
 +| OROO | | | ARAB | | Other root crops |
 +| GRAS | GRAS | | | | Green fodder |
 +| SILA | GREF | | ARAB | | Silage |
 +| CALV | CALV | | | | Suckler cows |
 +| RCAL | CABM | CABF | | | Calves, raising |
 +| HEIF | H2SL | H2BR | H3SL | H3BR | Heifers |
 +| PIGL | SOW2 | | | | Pig breeding |
 +| FALL | | | FALL | | Fallow land |
 +
 +**Tables: Codes of the input allocation estimation**
 +
 +^FADN inputs (FI) ^Label  ^
 +| TOIN | total inputs |
 +| COSA | animal specific inputs |
 +| FEDG | self grown feedings |
 +| ANIO | other animal inputs |
 +| FEDP | purchased feedings |
 +| COSC | crop specific inputs |
 +| SEED | seeds |
 +| PLAP | plant protection |
 +| FERT | fertilisers |
 +| TOIX | other inputs (overheads) |
 +
 +
 +^CAPRI inputs (CI) used in the reconciliation ^label ^
 +| TOIN | total inputs |
 +| FEED | feedings |
 +| IPHA | other animal inputs |
 +| COSC | crop specific inputs |
 +| SEED | seeds |
 +| PLAP | plant protection |
 +| FERT | fertilisers |
 +| REPA | repairs |
 +| ENER | energy |
 +| SERI | agricultural services input |
 +| INPO | other inputs |
 +
 +1. The set of //Other// activities that had been omitted from the econometric estimation: 
 +
 +  * OTHER={OCER, OFRU, OVEG, OCRO, OWIN, OIND, OOIL, OFAR, OANI}
 +
 +2. The set of activity groups, and their elements, used in the replacement or missing/negative coefficients
 +
 +  * GROUPS = {YOUNG, VEGE, SETT, PULS, PIG, OILS, MILK, MEAT, INDS, HORSE, GOAT, FRU, FOD, FLOWER, DENNY, COW, CHICK1, CHICK2, CHICK3, CERE, ARAB}
 +  * YOUNG={YBUL, YCOW},
 +  * VEGE={TOMA},
 +  * SETT={SETA, NONF, FALL, GRAS},
 +  * PULS=PULS
 +  * PIG={PIGF, SOWS},
 +  * OILS={RAPE, SOYA, SUNF, PARI, OLIV},
 +  * INDS={TOBA, TEXT, TABO},
 +  * GOAT={SHGM, SHGF},
 +  * FRU={APPL, CITR, TAGR, TWIN},
 +  * FOD={ROOF, MAIF},
 +  * FLOWER={FLOW, NURS},
 +  * DENNY={PORK, SOWS},
 +  * COW={DCOW, SCOW, HEIF, HEIR, CAMF, CAFF, BULF, CAMR, CAFR},
 +  * CHICK1={HENS, POUF},
 +  * CERE={SWHE, DWHE, BARL, OATS, RYEM, MAIZ},
 +  * ARAB={POTA, SUGB}
 +
 +3. The sets of Northern European, Southern European countries:
 +
 +  * NEUR={NL000, UK000, AT000, BL000, DE000, DK000, FI000, FR000, SE000}
 +  * SEUR={El000, ES000, PT000, IT000, IR000}
 +
 +
 +** Table: Codes of land use classes (Set LandUse)**
 +
 +^Code  ^Label  ^
 +| OART | artificial |
 +| ARAO | (other) arable crops - all arable crops excluding rice and fallow (see also definition of ARAC below) |
 +| PARI | paddy rice (already defined) |
 +| GRAT | temporary grassland (alternative code used for CORINE data, definition identical to TGRA |
 +| FRCT | fruit and citrus |
 +| OLIVGR | Olive Groves |
 +| VINY | vineyard (already defined) |
 +| NUPC | nursery and permanent crops (Note: the aggregate PERM also includes flowers and other vegetables |
 +| BLWO | board leaved wood |
 +| COWO | coniferous wood |
 +| MIWO | mixed wood |
 +| POEU | plantations (wood) and eucalyptus |
 +| SHRUNTC | shrub land - no tree cover |
 +| SHRUTC | shrub land - tree cover |
 +| GRANTC | Grassland - no tree cover |
 +| GRATC | Grassland - tree cover |
 +| FALL | fallow land (already defined) |
 +| OSPA | other sparsely vegetated or bare |
 +| INLW | inland waters |
 +| MARW | marine waters |
 +| KITC | kitchen garden |
 +
 +
 +** Table: Codes of land use aggregates (Set LandUseAgg)**
 +
 +^Code  ^Label  ^
 +| OLND | other land - shrub, sparsely vegetated or bare |
 +| ARAC | arable crops |
 +| FRUN | fruits, nursery and (other) permanent crops |
 +| WATER | inland or marine waters |
 +| ARTIF | artificial - buildings or roads |
 +| OWL | other wooded land - shrub or grassland with tree cover (definition to be discussed) |
 +| TWL | total wooded land - forest + other wooded land |
 +| SHRU | shrub land |
 +| FORE | forest (already defined) |
 +| GRAS | grassland (already defined) |
 +| ARAB | arable (already defined) |
 +| PERM | permanent crops (already defined) |
 +| UAAR | utilizable agricultural area (already defined) |
 +| ARTO | total area - total land and inland waters |
 +| ARTM | total area including marine waters |
 +| CROP | crop area - arable and permanent |
 +
 +**Table: Codes of mutually exclusive subset adding up to total area - ARTO (Set LandUseARTO)**
 +
 +^Code  ^Label  ^
 +| OLND | other land - shrub, sparsely vegetated or bare |
 +| ARTIF | artificial - buildings or roads |
 +| FORE | forest |
 +| UAAR | utilizable agricultural area |
 +| INLW | Inland waters |
 +====Annex: Detailed description of Eurostat data processing in COCO (coco1_eurostat.gms)====
 +
 +The program starts by importing pre-processed data from Eurostat. The pre-processing includes simple data selection routines and also manual checks. The Eurostat domains are processed one by one, and the corrections are done for each Member State ((Eurostat offers data for Belgium and Luxembourg separately, whereas the database combines both countries to the model region "BL000" (Belgium and Luxembourg). The key reason is that Eurostat offers data mainly for the aggregate Belgium and Luxembourg up to the year 1999, especially for all market balances. Furthermore, Luxembourg has a rather small agricultural sector (2004 total output was about EUR 250 million) with some similarities to Belgium.))
 +
 +Below we discuss the specific data-processing tasks related to Eurostat table groups.
 +The first Eurostat Table Group is “p_AgriProd” covering market balances and activity levels. 
 +
 +//Corrections and complements for all MS://
 +
 +
 +  * The following  data are not anymore available form Eurostat, starting with the 2010 data extractionBeginning with Eurostat selection 2010 some data are missing from the Eurostat website: 
 +    * DWH1, RAP1, POT1, POT2, ROO1 and ROO2 are not longer supported 
 +    * data for slaughter heads and slaughter tons for calves are only available for recent years  
 +    * deliveries to dairy of RMLK missing for earlier years in selection starting with February 2018
 +For an Interim solution, data for the missing data points are collected from an earlier Eurostat selection (March 2010). 
 +  * UNFCCC data is included, here sheep and goats population, to prolong data of some countries where Eurostat data collection stopped 2008/2009.
 +  * Recent dairy sector data from Eurostat via DG supplements the ordinary dairy data downloaded from the website of Eurostat.
 +  * Sugar trade data from the market balances of Eurostat is extended with Comext (Eurostat) data.
 +  * For the milk products WMIO, SMIP, FRMI and COCM some market balance positionpositions are corrected: “industrial use” is added to “feed on market and “processing” is added to “human consumption.
 +  * COCO code "FRUI" is aggregated from auxiliary data for fruit trees, plus soft fruits, plus strawberries.
 +  * All activities for the aggregate ILAM are added up from SHEP and GOAT.
 +  * The units for wine balance sheets are converted from 1000hl to 10000hl=1000000l
 +  * A rice milled equivalent balance without paddy rice (separate product) is constructed.
 +  * Survey data on buffaloes are used to increase the bovine stock data to cover the whole cattle herd.
 +
 +//Corrections and complements for specific MS://
 +
 +Due to years of database updates, a number of corrections on input data are carried out. For special cases in some MS, data are read in from additional data sources:
 +
 +  * Belgium-Luxemburg: trade for potatoes (Eurostat: EU trade since 1988 by HS2-HS4 [DS-016894])
 +  * France: market balances for cereal products (Agreste, Direction générale des douanes et droits indirects (DGDDI))
 +  * Denmark: market balances for some cereal products (StatBank Denmark)
 +  * Finland: market balances for some cereal products (Natural Resources Institute Finland, Balance sheet for food commodities)
 +  * Germany: activity levels for textile crops (BMELF)
 +  * Ireland: trade for citrus fruits and some milk products (Eurostat: EU trade since 1988 by HS2-HS4 [DS-016894]) and activity levels for grass land (StatBank Ireland)
 +  * Austria: production of cow milk, fruit products and potatoes (Statistisches Amt Österreich)
 +  * Czechia: trade of life animals (Eurostat: EU trade since 1988 by CN8 [DS-016890])
 +  * Lithuania: human consumption cereal products (calculated from data from statistical yearbook 2018)
 +  * Slovenia: slaughtering (SiStat Slovenia)
 +  * Romania: data for the meat and in the milk sectors (Romanian experts)
 +  * Trade data for sugar are collected from Eurostat COMEXT data.
 +
 +
 +The remaining domains/table groups only require a few case-by-case corrections: 
 +
 +  * The second Eurostat Table Group is “p_ExchRate” covering exchange rates
 +  * The third Eurostat Table Group is “p_EcoAct” covering the economic accounts for agriculture. 
 +  * The fourth Eurostat Table Group is “p_AgriPri” covering agricultural producer prices.
 +
 +
 +
 +====Annex: Testing procedure and checking intermediate steps in COCO (biofuels)====
 +
 +The COCO module produces various reporting files on the intermediate data processing steps. These files can be used to trace back potential errors in the COCO database to their origin. These debugging files also contain meta-information on the input data and settings used for producing the COCO database. 
 +
 +The following example is a walk-through on the typical data processing steps, covering biofuels data preparation in France.
 +
 +The reporting file 'output/results/coco/biof_data_with_prep/chk_biof_data_with_prep_FR000000.gdx' reports on the data preparation for biofuels for France (FR000) in COCO1. The file includes the set ‘meta_prepare_biofuel_data’, with meta-information on the recent coco1 run (e.g. creation date of file, GAMS version used).
 +
 +{{coco_biof_1.png?nolink|}}
 +
 +The set //biofCheckItems// in the same reporting .gdx file shows all biofuel items potentially filled with numbers.
 +
 +{{coco_biof_2.png?nolink|}}
 +
 +The complete list of the biofuel items in //biofCheckItems// includes codes which are additional to the CAPRI activity codes (see Annex on code lists above). The full code list includes the following items: 
 +
 +| bioECere | Ethanol processed from cereals |
 +| bioESuga | Ethanol processed from sugar beets |
 +| bioETwin | Ethanol processed from wine |
 +| bioEFrui | Ethanol processed from fruits |
 +| bioEOcro | Ethanol processed from other agricultural crops |
 +| bioEExog | Ethanol processed from crops not explicit in biofuel modelling (fruits, potatoes, other crops) |
 +| bioARES | Biofuels processed from crops residues |
 +| bioORES | Biofuels processed from forest residues and waste material (municipal waste, waste oil, other waste) |
 +| SECG | Biofuel quantities from second generation |
 +| MAPRagr | Ethanol production from agricultural sources |
 +| EloBio | Biofuel production and demand data from DG Energy project EloBio |
 +| DG_Agri | Ethanol data from DGAgri website and supplementary files |
 +| ProdCom | Eurostat: PRODCOM ANNUAL SOLD (NACE Rev. 2.) [DS-066341] |
 +| EIA | Independent Statistics &amp; Analysis, US Energy Information Administration |
 +| comext | Eurostat: Comext |
 +| Energy_bal | Eurostat: Supply, transformation, consumption - renewable energies - annual data [nrg_107a] |
 +| Energy_dem | Eurostat: Supply, transformation, consumption - renewable energies - annual data [nrg_102a, nrg_1073a] |
 +| final | results of the calculations |
 +| ODOM | other domestic use (activity from biostock calculations |
 +| INDt | Sum of model results for BIOF and INDM |
 +| BIOi, INDi, DOMi | intermediate activities to save data from model initialisation for later documentation. |
 +
 +
 +Biofuels production (levels) are calculated for biodiesel (BIOD) and bioethanol (BIOE). Input data and final initialization values before the consistency models are run are documented on the parameter //p_prepare_biofuelsMS// (see examples below). The results of the consistency models m_bioFitD (BIOD) and m_bioFitE (BIOE) are documented on the parameter //p_biofDatatMS// (see examples below).
 +
 +
 +
 +**Example 1: Bioethanol**
 +
 +The screenshot demonstrates the input data and final initialization values collected on parameter //p_prepare_biofuelsMS//. The first column of the table indicates the data source, respectively the processing status of the data. Data sources for bioethanol (BIOE) include data from EloBio, DG_Agri, ProdCom, EIA, Engergy_bal and Energy_dem. The second column of the table shows the activity.
 +
 +{{coco_biof_3.png?nolink|}}
 +
 +The results of the model m_bioFitE (BIOE) are documented on the parameter p_biofDatatMS.
 +
 +{{coco_biof_4.png?nolink|}}
 +
 +We take soft wheat (SWHE) as an example for biofuel feedstock, and walk through the initialization and consistency model results. From data input (Eurostat and FAO) we received in 2002 an industrial use of 894 1000t, saved on INDi. For production of bio-ethanol 631 1000t were initialized, saved on BIOi. The results of the breakdown by use for bio-ethanol and others industrial use, are saved on BIOF and INDM. BIOE shows the yield of soft wheat for bio-ethanol.
 +
 +
 +
 +**Example 2: Biodiesel**
 +
 +
 +The first dimension of the reporting parameter //p_prepare_biofuels// shows the data source (processing status). 
 +The second dimension of the parameter shows the activity.
 +
 +{{coco_biof_5.png?nolink|}}
 +
 +For Bio-diesels, PRIMES model results are used as an additional data source. 
 +
 +^Data source code ^Data source description ^
 +|Primes |PRIMES MODEL, EC3MLAB of ICCS, National University of Athens|
 +
 +{{coco_biof_6.png?nolink|}}
 +
 +The parameter //p_biofDataMS// reports on production (MAPR), trade (import:IMPT, export:EXPT), production from non-agricultural sources (NAGR), prices (UVAD, UVAP) and consumer taxes (CTAX). The distribiution of total biodiesel processing to the feedstock is also reported, for rapeseed oil (RAPO), sunflower oil (SUNO), soya oil (SOYO) and palm oil (PLMO).
 +
 +
 +
 +====Annex: Testing procedure and checking intermediate steps in COCO (dairy)====
 +
 +The following three examples show how to use the intermediate reporting files to trace the data preparation steps. Screenshots demonstrate the arrangement of the reporting parameters by using the CAPRI Graphical User Interface. COCO automatically produces the reporting files in the folder // results/coco/res_estima/ //
 +
 + 
 +**Example 1: Production of cow (COMI) and sheep (SGMI) milk**
 +
 +In order to document the procedure of data consolidation and rebooking, we look at the reporting file for France “chk_estima_FR000.gdx”.
 +
 +{{:wiki:coco_dairy_1.png?nolink|}}
 +
 +The codes in the rows show the activity code, the product code and its status. For activity codes see Annex 1: Code list.
 +
 +Status codes:
 +
 +  * INI: initial value
 +  * COCO1: estimation value
 +
 +The initialization of the production of COMI and SGMI is done in the module //coco1_milk.gms// (see section 3.1.3). Additional remarks to better understand the example:
 +
 +  * COMI: Milk from cows (CMLK) and buffaloes (BMLK) is added up. 
 +  * SGMI: Milk from ewes (EMLK) and goats (GMLK) is added up. 
 +  * If data on cow or sheep and goat milk is not available separately, but total milk production (RMLK) is available, then production of COMI is set equal to total milk production. 
 +  * Only COMI and SGMI are included in the estimation in //coco1_estima.gms//
 +  * The production of RMLK and its components CMLK, BMLK, EMLK and GMLK are only copied from raw data tables into this check parameter for documentation purposes.
 +
 +
 +** Example 2: data consolidation for cow milk**
 +
 +The procedure of data consolidation and rebooking of all activities for the CAPRI product “COMI” (cow milk) is shown in the following screenshot (only part of the reporting parameter p_estimAnimMS is shown, but the full scope of the table is visible in the GUI).
 +
 +{{:wiki:coco_dairy_2.png?nolink|}}
 +
 +
 +The codes in the rows show the activity code and its status. For activity codes see Annex 1: Code list.
 +Additional codes for status include the following.
 +
 +^Status code   ^Status code description  ^
 +|StdeData |Final (small) Stde (standard deviation) attached to priors from raw data |
 +|StdeScale |Final (large) Stde attached to priors from trends but not from raw data  |
 +|Upplim |Soft upper limits triggering extra penalties if violated                 |
 +|Lowlim |Soft lower limits triggering extra penalties if violated                 |
 +|Supps |Prior value = support: comes from raw data or trends plus HP filter      |
 +|Err2rev |Original error term from preest: to steer speed of bound opening         |
 +
 +
 +Under activity dairy cows (DCOW) the following items are reported: yield, total production (GROF), feed use (FEDM) and losses on market (LOSM). Eurostat’s //National Accounts of Agriculture (EAA)// only supply data for the aggregate milk (MILK). The equation //e_EAAMLK// in the consolidation model //AnimNSSQ// ensures the consistency of EAA values for MILK, as they are split up between cow milk (COMI) and sheep and goat milk (SGMI).
 +
 +<code fortran>
 +e_EAAMLK("%MS%000",T) 
 +     $ (p_NobsP("%MS%000","EAAP","MILK") AND ESTR("MILK") and 
 +        (p_NobsP("%MS%000","EAAP","COMI") or p_NobsP("%MS%000","EAAP","SGMI"))) ..
 +*
 +        v_EstimY("%MS%000","EAAP","MILK",T) =E=
 +                             v_EstimY("%MS%000","EAAP","COMI",T) $ p_NobsP("%MS%000","EAAP","COMI")
 +                           + v_EstimY("%MS%000","EAAP","SGMI",T) $ p_NobsP("%MS%000","EAAP","SGMI") ;  
 +
 +</code>
 +
 +Finally. the producer prices (UVAP) are calculated directly from the monetary EEA values and production. 
 +The following picture shows the data processing steps (states) for the EAA values for milk.
 +
 +{{:wiki:coco_dairy_3.png?nolink|}}
 +
 +From the example for COMI above you can also understand the influence of the standard deviation from raw data (e.g. FEDM.StdeData), and standard deviation from trends (e.g. FEDM.StdeScale) Standard deviations are calculated both for raw data and the trends. For years where FEDM.StdeData is given, the results are very close to the prior values FEDM.Supps, whereas they are deviating sizeably for years where only FEDM.StdeScale is available.
 +
 +The first initialisation of //StdeData// and //StdeScale// is done in module coco1_preest.gms, which is a pre-step for the data consolidation models (crops, animals, market balances), using a Hodrick-Prescott filter to smooth the combination of given values and trend line. Both standard deviations enter the objective function (see chapter 3.1.4).
 +
 +
 +
 +**Example 3: data consolidation for cow dairy cow activity (DCOW)**
 +
 +The procedure of data consolidation and booking intermediate data processing results for the dairy cow activity (DCOW) is demonstrated in the following screenshot. 
 +
 +{{:wiki:coco_dairy_4.png?nolink|}}
 +
 +The rows of the table show the product item code for the production activity DCOW, and the data processing steps (status). The first two lines show the coco1 results for slaughtering. The items starting with Y and I stand for the output and input of calves. The initialization, the estimation steps and the final results are all documented on the reporting parameter //p_estimAnimMS//. Items COMI and BEEF show the yields for cow milk and beef. Item DAYS is the process length, initialized by 365 days (equals one year). Finally, the item HERD models the herd size of dairy cows.
 +
  
 ===== The Regionalised Data Base (CAPREG) ===== ===== The Regionalised Data Base (CAPREG) =====
Line 1699: Line 2205:
  
 |  **Ex-post**  |  **Ex-ante**  | |  **Ex-post**  |  **Ex-ante**  |
-|**Given:**\\ -Herd sizes\\  => Manure output\\ -Crop areas and yields\\  => Export with harvest\\ -National anorganic application\\ **Estimated:**\\ -Regional anorganic application\\ -Factor for Fertilization beyond N export\\ -Manure availability |**Model result:**\\ -Herd sizes\\  => manure output\\ -Crop areas and yields\\ => Export with harvest\\ -National and Regional anorganic application\\ **Given:** \\ -Factor for Fertilization beyond export (trended)\\ -Manure availability (trended)|+|**Given:**|**Model result:**
 +|-Herd sizes|-Herd sizes| 
 +| => Manure output|=> manure output
 +|-Crop areas and yields|-Crop areas and yields| 
 +|=> Export with harvest|=> Export with harvest| 
 +|-National anorganic application|-National and Regional anorganic application
 +|**Estimated:**|**Given:**
 +|-Regional anorganic application|-Factor for Fertilization beyond export (trended)
 +|-Factor for Fertilization beyond N export|-Manure availability (trended)
 +|-Manure availability| |
  
 A good overview on how the Nitrogen balances are constructed and can be used for analysis can be found in: Leip A., Britz W., de Vries W. and Weiss F. (2011): Farm, land, and soil nitrogen budgets for agriculture in Europe calculated with CAPRI, Environmental Pollution 159(11), 3243-3253 and Leip, A., Weiss, F. and Britz, W. (2011): Agri-Environmental Nitrogen Indicators for EU27, in: Flichman G. (ed.), Bio-Economic Models applied to Agricultural Systems, p. 109-124, Springer, Netherlands. A good overview on how the Nitrogen balances are constructed and can be used for analysis can be found in: Leip A., Britz W., de Vries W. and Weiss F. (2011): Farm, land, and soil nitrogen budgets for agriculture in Europe calculated with CAPRI, Environmental Pollution 159(11), 3243-3253 and Leip, A., Weiss, F. and Britz, W. (2011): Agri-Environmental Nitrogen Indicators for EU27, in: Flichman G. (ed.), Bio-Economic Models applied to Agricultural Systems, p. 109-124, Springer, Netherlands.
Line 1869: Line 2384:
 |::: |Manure management|CH4Man| |::: |Manure management|CH4Man|
 |::: |Rice production|CH4Ric| |::: |Rice production|CH4Ric|
-|::: |Land use change emissions from\\ biomass burning|CH4bur|+|::: |Land use change emissions from biomass burning|CH4bur|
 |**Nitrous Oxide**|Manure management|N2OMan| |**Nitrous Oxide**|Manure management|N2OMan|
 |::: |Manure excretion on grazings|N2OGra| |::: |Manure excretion on grazings|N2OGra|
Line 1875: Line 2390:
 |::: |Application of manure|N2OApp| |::: |Application of manure|N2OApp|
 |::: |Crop residues|N2OCro| |::: |Crop residues|N2OCro|
-|::: |Indirect emissions from ammonia \\ losses|N2OAmm| +|::: |Indirect emissions from ammonia losses|N2OAmm| 
-|::: |Indirect emissions from leaching \\ and runoff|N2OLea|+|::: |Indirect emissions from leaching and runoff|N2OLea|
 |::: |Cultivation of histosols|N2Ohis| |::: |Cultivation of histosols|N2Ohis|
-|::: |Land use change emissions from the \\ burning of biomass|N2Obur|+|::: |Land use change emissions from the burning of biomass|N2Obur|
 |**Carbon dioxide**|Cultivation of histosols|CO2his| |**Carbon dioxide**|Cultivation of histosols|CO2his|
 |::: |Applicaton of ureum|CO2urea| |::: |Applicaton of ureum|CO2urea|
 |::: |Liming|CO2lim| |::: |Liming|CO2lim|
-|::: |Land use change emissions from above \\ and below ground biomass|CO2bio| +|::: |Land use change emissions from above and below ground biomass|CO2bio| 
-|::: |Land use change emissions from soil \\ carbon changes|CO2soi| \\ Source: CAPRI Modelling System+|::: |Land use change emissions from soil carbon changes|CO2soi| \\ Source: CAPRI Modelling System
  
 For a detailed analysis of these single emission sources refer to Pérez 2006: Greenhouse Gases: Inventories, Abatement Costs and Markets for Emission Permits in European Agriculture -A Modelling Approach and Leip et al 2010: Evaluation of livestock sector’s contribution to the RU greenhouse gas emissions (GGELS). For a detailed analysis of these single emission sources refer to Pérez 2006: Greenhouse Gases: Inventories, Abatement Costs and Markets for Emission Permits in European Agriculture -A Modelling Approach and Leip et al 2010: Evaluation of livestock sector’s contribution to the RU greenhouse gas emissions (GGELS).
Line 1955: Line 2470:
  
 |  Region  |  crop or aggregate  |  Econometric estimation  |||  HPD solution including  ||| |  Region  |  crop or aggregate  |  Econometric estimation  |||  HPD solution including  |||
-|:::| |  regional  |  national- \\ including yield  |  national - \\ without yield  |  regional, \\ national, crop \\ aggregates  |  + expert assumption  |  + regional \\ labour supply  |+|:::| |  regional  |  national- including yield  |  national - without yield  |  regional, national, crop  aggregates  |  + expert assumption  |  + regional labour supply  |
 |Belgium (BL24)|Soft wheat| 31.49| 31.26| 31.49| 24.99| 32.73| 53.88| |Belgium (BL24)|Soft wheat| 31.49| 31.26| 31.49| 24.99| 32.73| 53.88|
 |:::|Sugar beet |  76.25| 77.39| 76.25| 62.19| 48.27| 68.36| |:::|Sugar beet |  76.25| 77.39| 76.25| 62.19| 48.27| 68.36|
the_capri_data_base.1596351896.txt.gz · Last modified: 2022/11/07 10:23 (external edit)

Except where otherwise noted, content on this wiki is licensed under the following license: CC0 1.0 Universal
CC0 1.0 Universal Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki