Differences

This shows you the differences between two versions of the page.

--- capri:get-capri [2019/06/17 09:26] – Publishing STAR 2.4 torbjornj
+++ capri:get-capri [2020/04/30 09:22] – Updating with simplified table of download links and releas notes from documentation. torbjornj
@@ Line 7: / Line 7: @@
 The model consists of (a) the model code including raw data and (b) the compiled data base including calibrated baselines. The model is really self contained in (a), since all software and raw data needed to compile the data bases and construct the baselines is found there. Albeit (b), the databases, can be derived from (a), doing so is a somewhat complicated process. Therefore, we provide (b) as a shortcut. Furthermore, it turns out that generating (b) may generate slightly different results on different hardware/software combinations, and therefore it is convenient to use a common versioned database release.
-==== Public releases of code and input data ====
+===== Download the current release =====
-Using the links below here, you can access a zip archive with model code and raw data, referred to as (a) above. Please refer to the [[capri:star|release notes]] for more information about each release. Older releases are provided, but we always recommend using the latest release (highest version number)
-[[https://1drv.ms/u/s!Aj7_RXyD8q-MgtQmzmdEn_3FuNaqyA|Star 2.4]]
+From 2016, the CAPRI model was made more accessible to the scientific community by the provision of supported stable releases. The stable releases are tagged and “frozen” versions of the model that can be referenced to and that will not change. The bug fixes and other code updates result in new releases with updated revision numbers. The release versions have been subjected to extensive testing, ensuring that all supported features technically work under different hardware/software settings.
-[[https://1drv.ms/u/s!Aj7_RXyD8q-MgsQbUFRIdCWpq30mVw|Star 2.3]]
+The stable release consists of (a) the model code including raw data and (b) the compiled data base including calibrated baselines. The model is really self contained in (a), since all software and raw data needed to compile the data bases and construct the baselines is found there. Albeit (b), the databases, can be derived from (a), doing so is a somewhat complicated process. Therefore, we provide (b) as a shortcut. Furthermore, it turns out that generating (b) may generate slightly different results on different hardware/software combinations, and therefore it is convenient to use a common versioned database release.
-[[https://1drv.ms/u/s!Aj7_RXyD8q-MgqhHqK5aEPuSt3R0uQ|Star 2.2]]
+The current release and selected previous releases can be downloaded as compressed (zipped) archives using the links in the following table. Note that the item "SVN-tag" only are available to developers with a an account in the SVN database. Information about each release is found in the release notes (below) and in each release's code base.
-[[https://1drv.ms/u/s!Aj7_RXyD8q-MgpkA6-HTyVx2y_AThw|Star 2.1]]
+^ Release   ^  Item        ^   Link                                                           ^
+| STAR 2.5  |  Code        | [[https://1drv.ms/u/s!Aj7_RXyD8q-Mg4BDjQ4AbWbXXzY1_g?e=NvyyLT]]  |
-[[https://1drv.ms/u/s!Aj7_RXyD8q-MgpA1P5ynFvpeGSD60A|Star 2.0]]
+| :::       |  Database    | [[https://1drv.ms/u/s!Aj7_RXyD8q-Mg4BBF3d-lsULH9gH3A?e=fIIFOd]]  |
+| :::       |  SVN-tag     | [[https://svn1.agp.uni-bonn.de/svn/capri/tags/star/2.5]]         |
-[[https://1drv.ms/u/s!Aj7_RXyD8q-MgpgRyPwElFGkhK5QJw|Star 1.4]]
+| STAR 2.4  |  Code        | [[https://1drv.ms/u/s!Aj7_RXyD8q-MgtQmzmdEn_3FuNaqyA]]           |
+| :::       |  Database    | [[https://1drv.ms/u/s!Aj7_RXyD8q-MgtQlHdUSz6F5Uv_Sgw]]           |
-[[https://1drv.ms/u/s!Aj7_RXyD8q-MgbwiGb1wdkSQbFLf4Q|Star 1.3]]
+| :::       |  SVN-tag     | [[https://svn1.agp.uni-bonn.de/svn/capri/tags/star/2.4]]         |
+| STAR 1.4  |  Code        | [[https://1drv.ms/u/s!Aj7_RXyD8q-MgpgRyPwElFGkhK5QJw]]           |
-[[https://1drv.ms/u/s!Aj7_RXyD8q-MgaRpc1hXqLo_c-SIfQ|Star 1.2]]
+| :::       |  Database    | [[https://1drv.ms/u/s!Aj7_RXyD8q-MgpgSo2ebWO0Y-c3oXA]]           |
+| :::       |  SVN-tag     | [[https://svn1.agp.uni-bonn.de/svn/capri/tags/star/1.4]]         |
-[[https://1drv.ms/u/s!Aj7_RXyD8q-MgaN0ym3yQlb0-1YtDA|Star 1.1]]
-[[https://1drv.ms/u/s!Aj7_RXyD8q-MgaMh3VqmVlQgrR8DoQ|Star 1.0]]
-==== Code and inputs for registered users of the CAPRI SVN system ====
-CAPRI developers with an account in the CAPRI SVN system can also access the releases using their SVN client and regular credentials. The following links point to each release:
-^ Version                              ^ Link to SVN tag                                          ^
-| STAR 2.4                             | https://svn1.agp.uni-bonn.de/svn/capri/tags/star/2.4     |
-| STAR 2.3                             | https://svn1.agp.uni-bonn.de/svn/capri/tags/star/2.3     |
-| STAR 2.2                             | https://svn1.agp.uni-bonn.de/svn/capri/tags/star/2.2     |
-| STAR 2.1                             | https://svn1.agp.uni-bonn.de/svn/capri/tags/star/2.1     |
-| STAR 2.0                             | https://svn1.agp.uni-bonn.de/svn/capri/tags/star/2.0     |
-| STAR 1.4                             | https://svn1.agp.uni-bonn.de/svn/capri/tags/star/1.4     |
-| STAR 1.3                             | https://svn1.agp.uni-bonn.de/svn/capri/tags/star/1.3     |
-| STAR 1.2                             | https://svn1.agp.uni-bonn.de/svn/capri/tags/star/1.2     |
-| STAR 1.1                             | https://svn1.agp.uni-bonn.de/svn/capri/tags/star/1.1     |
-| STAR 1.0                             | https://svn1.agp.uni-bonn.de/svn/capri/tags/star/1.0     |
-==== Part B: Databases ====
-The model code contains all raw data and routines for building the CAPRI data sets needed to run the system. However, doing so can be tedious, technical and error prone. Here, we therefore provide a standard data base for selected releases. Please extract the contents of the zipped files into the *results* directory of your model installation (by default .\output\results). Use the data base with the same release number as the model code. Novel in STAR 2.4 is that we put an html file in the root of the results folder (batch.html), showing the output of the batch program that generated that data set, for a documentation of the settings used.
-**Note: The current database (2.4) is calibrated for 2030 and 2015, using the policy "cap_after_2014\ref", assuming EU-composition = BREXIT**.
-[[https://1drv.ms/u/s!Aj7_RXyD8q-MgtQlHdUSz6F5Uv_Sgw|Database and results for STAR 2.4]]
-[[https://1drv.ms/u/s!Aj7_RXyD8q-MgsQcQvPEwaczptl0lg|Database and results for STAR 2.3]]
-[[https://1drv.ms/u/s!Aj7_RXyD8q-MgqhGv9NXynxojXeHww|Database and results for STAR 2.2]]
-[[https://1drv.ms/u/s!Aj7_RXyD8q-MgpkDAAsVcbaZey8BXg|Database and results for STAR 2.1]]
-[[https://1drv.ms/u/s!Aj7_RXyD8q-MgpgSo2ebWO0Y-c3oXA|Results from STAR 1.4, including scenarios for use with the CAPRI tutorial (2018 training session material)]]
-[[https://1drv.ms/u/s!Aj7_RXyD8q-MgpctJSulPT65BgFOVQ|Results from STAR 1.3]]
 ===== System requirements =====
-CAPRI requires that you have a windows computer with Java runtime environment (64-bit) and GAMS (distribution 24.7 or later, http://www.gams.com) installed. You need a license for the CONOPT solver.
+CAPRI requires that you have a windows computer with Java runtime environment (64-bit) and GAMS (http://www.gams.com) installed. We recommend distribution 28.2 or later. You need a license for the CONOPT solver.
 ===== Installation instructions =====
@@ Line 94: / Line 54: @@
   - Wait for the program to finish (hours, days).
   - Click "Open HTML report" and verify that all steps were completed without errors (RC=0).
+The current batch execution file (STAR 2.5) does not take over the path to your GAMS installation as entered in the settings dialogue during installation, but you will have to open the text file and enter the appropriate path manually.
+===== Release notes (cumulative) =====
+=== STAR 2.5 ===
+Several modifications of the premium payments, for the Basic Payment Schemes, where the results were found not to fit observations.
+=== STAR 2.4 ===
+This maintenance release addresses ...
+  * Pillar 1 payments of the CAP were missing for "new" member states when running CAP 2014-2020 for a year before 2020.
+  * Several minor tweaks and fixes.
+=== STAR 2.3 ===
+This maintenance release addresses stability of feeding, reporting for fertilizers, and also includes some cleaning up of code:
+  * The feed distribution was revised to become more stable under repeated starts (P. Witzke)
+  * Several options were removed from the GUI with respect to the estimation of GHG emission trends
+  * A large pack of updates to the GHG emission estimations were imported from the development branch ClipByFood
+  * The inner fertilizer allocation model can be turned OFF in simulations (on by default)
+  * The GUI now reports a decomposition of the NUTNED_ equation, accessible under the theme "Fertilization"
+  * Some items were excluded from checks in COCO to make the program run through with GAMS 25.0 and 25.1
+  * The legacy data set on ghg emissions from EDGAR was removed.
+=== STAR 2.2 ===
+This maintenance release resolves several important calibration issues.
+  * The market model did not calibrate properly due to an inconsistently included "BREXIT" policy
+  * The supply models did not calibrate properly due to missing parameters for manure trade
+  * The stability tests did not give true results due to an inconsistent use of results_in and results_out, essentially mixing fertilizer parameters of two runs
+  * Several minor bug fixes, e.g. in linking supply and demand and scaling of NMIN
+  * A final overhaul of feeding is still due in Maintenance Release 2.3.
+=== STAR 2.1 ===
+This maintenance release implements the revised treatment of fertilizers and feed. For fertilizers, a bi-level programming approach has been implemented, where the flows of fertilizers are modelled as a Bayesian estimator ensuring an interior solution that is "close to" the calibrated flows when simulating and close to a prior distribution when calibrating. For feed, the distribution of feeding stuffs to animals was revised to improve plausibility and stability, but without principal changes of the way the model works.
+In addition to the feed and fertilizer modifications, the following bugs or minor issues were addressed:
+  * Changing the order of work steps and tasks in the GUI to reflect the order in which the steps can be carried out (e.g. FAOSTAT first)
+  * An issue with price experiments in Threads-mode was resolved
+  * Start at an infrastructure to report the results of the fertilizer allocation to DATAOUT (reports\fert_dist_results.gms)
+  * Relaxing the winter cover requirement in one Finnish region to avoid infeasibility in baselines.
+  * The income computations for EAA had inconsistent prices for FODDER, so that the regional farms had costs <> revenues for fodder, which should not be possible.
+  * The Dual Analysis of the supply models had not updated versions of some constraints, so that there were an "unexplained rest". (sugar beet and greening restrictions)
+Finally, the testing routines were augmented and slightly revised, to include individual testing of simulations with supply and market models standalone.
+=== STAR 2.0 ===
+This new series of releases contains two key modifications:
+  * It calibrates to the CAP post 2014 instead of the old MTR scenario. This required adding the first-order conditions of the greening restrictions in the PMP algorithm, which was not trivial.
+  * It includes the possibility to set BREXIT ON when building the database. This allows the user to build a model where the UK is a separate market model region with bilateral trade instruments with the EU. This is now the standard setting, albeit it implements free trade between UK and EU27.
+Some modifications that were scheduled for this release were not included, because they were not sufficiently stable in testing at the key date for the release. In particular, the following components are essentially unchanged from STAR 1.3 but scheduled for inclusion in a subsequent release.
+  * Revision of the fertilizer distribution. This was found to be numerically unstable in STAR 1.0, and is still so as testing revealed.
+  * Revision of the feed distribution to give more stable results and a more plausible allocation of feeding stuffs.
+Finally, this release has some known issues in addition to the points mentioned above:
+  * New Norwegian data was made available but not in time to complete the testing phase.
+  * There are occasional problems to reproduce the baseline in 2030 when market and supply are allowed to interact. The precise circumstances causing this to happen are still unclear.
+=== STAR 1.3 ===
+A maintenance release addressing the following issue in STAR 1.2:
+  * Including the most recent Graphical User Interface (GUI)
+  * A bug with the Basic Payment Scheme in Greece led to missing payments in several Greek regions.
+  *Changing the way the grassland maintenance requirement works in Greening (lower bound on grass land)
+  *Modified reporting for EU28
+  *Modified report tables for the GUI
+It was observed that when the GUI batch execution file "build_database_and_baseline.txt" was executed with this model version, the baseline calibration of the market model sometimes failed.In that case, a manual re-start of that task directly from the GUI using the default settings worked.
+Furthermore, it was observed that the baseline reproduction run (i.e. calibrating to mtr_rd_cal and then simulating mtr_rd_ref) resulted in small changes in some of the "new" member states, in particular Serbia.
+=== STAR 1.2 ===
+A maintenance release addressing two minor problems encountered in STAR 1.1.
+  *A bug fix in the rural development policy logic (gams\policy\rd_logic.gms). The bug may have caused problems when building a regionalized database if a particular folder (results_out\capmod) was missing.
+  *A bug in the batch execution file "build_database_and_baseline.txt" that prevented the farm type databases from being built.
+=== STAR 1.1 ===
+This is a maintenance release addressing some issues that surfaced since STAR 1.0 was published.
+  *The scaling of Japanese prices was wrong, leading to biased results in the market model
+  *Several issues relating to the implementation of the second pillar payments, causing them to be missing or wrong in CAPMOD (simulation) and also CAPREG (regional database)
+  *Renaming all the standard scenario files in the folder pol_input\CAP_AFTER_2014, so that the (CAPMOD) result file names become shorter and more instructive
+  *A randomly appearing issue with farm type trends. GAMS had problems deleting grid computing handles under full system load (parallel computing)
+  *A bug in the user interface that caused the batch execution (e.g. build_database_and_baseline.txt) to launch Turkey (only!) in the wrong way
+  *Setting the default number of processors in the "build_database_and_baseline.txt" batch to "4", so that it is fairly safe to start without any modification.
+=== STAR 1.0 ===
+This release attempts to provide a CAPRI model where a wide selection of tasks from baseline construction to simulation can be carried out.
+With other versions of CAPRI, it has been a general feature that when some tasks were maintained, others ceased to work, so that there were
+multiple model versions where some problems had been resolved but where not everything worked properly.
+Since it is utopic to aspire that all mechanisms ever built into CAPRI would work simultaneously, a selection of "supported features" was created.
+Features of the model that are not "supported" are simply not tested, and so they may or may not perform as intended. The list of supported features is
+documented in programmatic form in the GUI batch execution file "supported_features.txt".
+Some features that should be supported still fail to work properly. In particular, we note that the following technical problems persist:
+  *"Generate GAMS child processes on different threads", causing many procedures in the model to run in parallel as gams child processes if set ON, is not entirely stable. Recommendation is to keep OFF for reproducibility.
+  *"Dampening of high activity level elasticities" must still be kept OFF. It is unclear whether this feature will survive or rather be replaced by some general adaptation of elasticities for long run experiments in combination with a revised calibration procedure
+  *Numerical instability of the calibration of fertilizer distribution among crops. Repeated runs do not give identical results.
+  *Numerical instability of the calibration of animal feed to various animals. Repeated runs do not give identical results.
+  *Occasional failure of task "Generate farm type trends" for random regions. Remedy: Re-run "Build regional time series" and "Build regional database" for that country, for nuts2 and farm types, and redo all tasks from "Build global database" onwards.
+The release has not been systematically tested from a content point of view. Nevertheless, release candidates have been used in a few applications,
+where some issues have surfaced. In particular, the distribution of rural development funds needs to be revised. Such revision has partially been done
+already in various projects, but the modifications need to be consolidated and integrated into a maintenance release. Similar improvements have accumulated
+in the areas of market model tariff data and greenhouse gas emissions, also foreseen to be integrated in a future maintenance release, after thorough testing.

CAPRI Modelling System

Common Agricultural Policy Regionalised Impact Modelling System

Differences