This shows you the differences between two versions of the page.
Both sides previous revisionPrevious revisionNext revision | Previous revision | ||
capri:get-capri [2018/12/19 10:52] – [Part B: Databases] Hint about baseline settings. torbjornj | capri:get-capri [2022/11/07 10:23] (current) – external edit 127.0.0.1 | ||
---|---|---|---|
Line 7: | Line 7: | ||
The model consists of (a) the model code including raw data and (b) the compiled data base including calibrated baselines. The model is really self contained in (a), since all software and raw data needed to compile the data bases and construct the baselines is found there. Albeit (b), the databases, can be derived from (a), doing so is a somewhat complicated process. Therefore, we provide (b) as a shortcut. Furthermore, | The model consists of (a) the model code including raw data and (b) the compiled data base including calibrated baselines. The model is really self contained in (a), since all software and raw data needed to compile the data bases and construct the baselines is found there. Albeit (b), the databases, can be derived from (a), doing so is a somewhat complicated process. Therefore, we provide (b) as a shortcut. Furthermore, | ||
- | ==== Public releases of code and input data ==== | + | ===== Download the current release ===== |
- | Using the links below here, you can access a zip archive with model code and raw data, referred to as (a) above. Please refer to the [[capri: | + | |
- | [[https:// | + | From 2016, the CAPRI model was made more accessible to the scientific community by the provision of supported stable releases. The stable releases are tagged and “frozen” versions of the model that can be referenced to and that will not change. The bug fixes and other code updates result in new releases with updated revision numbers. The release versions have been subjected to extensive testing, ensuring that all supported features technically work under different hardware/software settings. |
+ | The stable release consists of (a) the model code including raw data and (b) the compiled data base including calibrated baselines. The model is really self contained in (a), since all software and raw data needed to compile the data bases and construct the baselines is found there. Albeit (b), the databases, can be derived from (a), doing so is a somewhat complicated process. Therefore, we provide (b) as a shortcut. Furthermore, | ||
- | [[https:// | + | The current release and selected previous releases can be downloaded as compressed (zipped) archives using the links in the following table. Note that the item "SVN-tag" only are available to developers with a an account in the SVN database. Information about each release is found in the release notes (below) and in each release' |
+ | ^ Release | ||
+ | | STAR 2.5 | Code | [[https:// | ||
+ | | ::: | ||
+ | | ::: | ||
+ | | STAR 2.4 | Code | [[https:// | ||
+ | | ::: | ||
+ | | ::: | ||
+ | | STAR 1.4 | Code | [[https:// | ||
+ | | ::: | ||
+ | | ::: | ||
- | [[https://1drv.ms/ | + | ===== System requirements ===== |
+ | CAPRI requires that you have a windows computer with Java runtime environment (64-bit) and GAMS (http://www.gams.com) installed. We recommend distribution 28.2 or later. You need a license for the CONOPT solver. | ||
+ | ===== Installation instructions ===== | ||
+ | Using CAPRI requires extensive knowledge of how the system works. Please look out for CAPRI training courses on the page of [[capri: | ||
- | [[https://1drv.ms/ | + | - Create an installation folder to hold **model source files** on your local hard drive such that the path does not contain spaces. Thus, it will not work to install the model in "My Documents" |
+ | - Extract the files of the compressed archive into the folder you just created. | ||
+ | - Go to the subfolder GUI, double-click " | ||
+ | - In the menu **settings**, | ||
+ | - In the first tab: enter your name | ||
+ | - In the second tab: verify that the paths to result and restart folders are set to **..\output\results** and **..\output\restart**. The GAMS directory should read **..\gams** and the data directory should read **..\dat**. | ||
+ | | ||
+ | - In the fourth tab: do nothing. | ||
+ | - In the final tab: do nothing. | ||
+ | - Click "Save in caprinew.ini" | ||
+ | - Close the GUI, then start it again (using start_capri.bat), | ||
+ | ===== Build databases and baselines ===== | ||
+ | If you do not use one of the data bases provided above, or for some other reason want to build all databases yourself, then you can follow the steps below. This takes a long time to execute. Depending on the hardware you use, it can take up to a day. | ||
- | [[https:// | + | - In the GUI, choose the workstep " |
+ | - In the GUI, choose the menu GUI --> Batch execution | ||
+ | - In the dialogue, choose the file "< | ||
+ | - Uncheck the option "Only compile the GAMS programs" | ||
+ | - Click "Start batch execution" | ||
+ | - Wait for the program to finish (hours, days). | ||
+ | | ||
+ | The current batch execution file (STAR 2.5) does not take over the path to your GAMS installation as entered in the settings dialogue during installation, | ||
- | [[https:// | ||
+ | ===== Release notes (cumulative) ===== | ||
- | [[https:// | + | === STAR 2.5 === |
+ | Several modifications of the premium payments, for the Basic Payment Schemes, where the results were found not to fit observations. | ||
- | [[https:// | ||
+ | === STAR 2.4 === | ||
- | [[https:// | + | This maintenance release addresses ... |
+ | * Pillar 1 payments of the CAP were missing for " | ||
+ | * Several minor tweaks and fixes. | ||
- | ==== Code and inputs for registered users of the CAPRI SVN system ==== | ||
- | CAPRI developers with an account in the CAPRI SVN system can also access the releases using their SVN client and regular credentials. The following links point to each release: | ||
+ | === STAR 2.3 === | ||
- | ^ Version | + | This maintenance release addresses stability of feeding, reporting for fertilizers, |
- | | STAR 2.3 | https:// | + | |
- | | STAR 2.2 | https:// | + | |
- | | STAR 2.1 | https:// | + | |
- | | STAR 2.0 | https:// | + | |
- | | STAR 1.4 | https:// | + | |
- | | STAR 1.3 | https:// | + | |
- | | STAR 1.2 | https:// | + | |
- | | STAR 1.1 | https:// | + | |
- | | STAR 1.0 | https:// | + | |
+ | * The feed distribution was revised to become more stable under repeated starts (P. Witzke) | ||
+ | * Several options were removed from the GUI with respect to the estimation of GHG emission trends | ||
+ | * A large pack of updates to the GHG emission estimations were imported from the development branch ClipByFood | ||
+ | * The inner fertilizer allocation model can be turned OFF in simulations (on by default) | ||
+ | * The GUI now reports a decomposition of the NUTNED_ equation, accessible under the theme " | ||
+ | * Some items were excluded from checks in COCO to make the program run through with GAMS 25.0 and 25.1 | ||
+ | * The legacy data set on ghg emissions from EDGAR was removed. | ||
- | ==== Part B: Databases ==== | ||
- | The model code contains all raw data and routines for building the CAPRI data sets needed to run the system. However, doing so can be tedious, technical and error prone. Here, we therefore provide a standard data base for selected releases. Please extract the contents of the zipped files into the *results* directory of your model installation (by default .\output\results). Use the data base with the same release number as the model code. | + | === STAR 2.2 === |
- | **Note: The current database (2.3) is calibrated for 2030, using the policy " | + | This maintenance release resolves several important calibration issues. |
- | [[https:// | + | * The market model did not calibrate properly due to an inconsistently included " |
+ | * The supply models did not calibrate properly due to missing parameters for manure trade | ||
+ | * The stability tests did not give true results due to an inconsistent use of results_in and results_out, | ||
+ | * Several minor bug fixes, e.g. in linking supply | ||
+ | * A final overhaul of feeding is still due in Maintenance Release | ||
- | [[https:// | + | === STAR 2.1 === |
- | [[https:// | + | This maintenance release implements the revised treatment of fertilizers and feed. For fertilizers, |
- | [[https:// | + | In addition to the feed and fertilizer modifications, the following bugs or minor issues were addressed: |
- | [[https:// | + | * Changing the order of work steps and tasks in the GUI to reflect the order in which the steps can be carried out (e.g. FAOSTAT first) |
+ | * An issue with price experiments in Threads-mode was resolved | ||
+ | * Start at an infrastructure to report the results of the fertilizer allocation to DATAOUT (reports\fert_dist_results.gms) | ||
+ | * Relaxing the winter cover requirement in one Finnish region to avoid infeasibility in baselines. | ||
+ | * The income computations for EAA had inconsistent prices for FODDER, so that the regional farms had costs <> revenues for fodder, which should not be possible. | ||
+ | * The Dual Analysis of the supply models had not updated versions of some constraints, | ||
- | ===== System requirements ===== | + | Finally, the testing routines were augmented and slightly revised, to include individual testing of simulations with supply and market models standalone. |
- | CAPRI requires that you have a windows computer with Java runtime environment (64-bit) and GAMS (distribution 24.7 or later, http:// | + | |
- | ===== Installation instructions | + | === STAR 2.0 === |
- | Using CAPRI requires extensive knowledge of how the system works. Please look out for CAPRI training courses on the page of [[capri: | + | |
- | - Create an installation folder to hold **model source files** on your local hard drive such that the path does not contain spaces. Thus, it will not work to install the model in "My Documents" | + | This new series |
- | - Extract the files of the compressed archive into the folder you just created. | + | |
- | - Go to the subfolder GUI, double-click " | + | |
- | - In the menu **settings**, | + | |
- | - In the first tab: enter your name | + | |
- | - In the second tab: verify that the paths to result and restart folders are set to **..\output\results** and **..\output\restart**. The GAMS directory should read **..\gams** and the data directory should read **..\dat**. | + | |
- | - In the third tab: enter the complete path to the GAMS executable. Probably it is something like **c: | + | |
- | - In the fourth tab: do nothing. | + | |
- | - In the final tab: do nothing. | + | |
- | - Click "Save in caprinew.ini" | + | |
- | - Close the GUI, then start it again (using start_capri.bat), | + | |
- | ===== Build databases and baselines ===== | + | * It calibrates to the CAP post 2014 instead |
- | If you do not use one of the data bases provided above, or for some other reason want to build all databases yourself, then you can follow | + | * It includes the possibility |
- | - In the GUI, choose | + | Some modifications that were scheduled for this release were not included, because they were not sufficiently stable in testing at the key date for the release. In particular, the following components are essentially unchanged from STAR 1.3 but scheduled for inclusion in a subsequent release. |
- | | + | |
- | | + | * Revision of the fertilizer distribution. This was found to be numerically unstable in STAR 1.0, and is still so as testing revealed. |
- | | + | * Revision of the feed distribution to give more stable results and a more plausible allocation of feeding stuffs. |
- | | + | |
- | | + | Finally, this release has some known issues in addition to the points mentioned above: |
- | - Click "Open HTML report" and verify | + | |
+ | * New Norwegian data was made available but not in time to complete the testing phase. | ||
+ | * There are occasional problems to reproduce the baseline in 2030 when market | ||
+ | |||
+ | |||
+ | === STAR 1.3 === | ||
+ | A maintenance release addressing the following issue in STAR 1.2: | ||
+ | |||
+ | | ||
+ | * A bug with the Basic Payment Scheme in Greece led to missing payments in several Greek regions. | ||
+ | | ||
+ | *Modified reporting for EU28 | ||
+ | *Modified report tables for the GUI | ||
+ | |||
+ | It was observed that when the GUI batch execution file " | ||
+ | Furthermore, it was observed that the baseline reproduction run (i.e. calibrating to mtr_rd_cal and then simulating mtr_rd_ref) resulted in small changes in some of the "new" member states, in particular Serbia. | ||
+ | |||
+ | === STAR 1.2 === | ||
+ | A maintenance release addressing two minor problems encountered in STAR 1.1. | ||
+ | |||
+ | *A bug fix in the rural development policy logic (gams\policy\rd_logic.gms). The bug may have caused problems when building a regionalized database if a particular folder (results_out\capmod) was missing. | ||
+ | *A bug in the batch execution file "build_database_and_baseline.txt" | ||
+ | |||
+ | === STAR 1.1 === | ||
+ | This is a maintenance release addressing some issues that surfaced since STAR 1.0 was published. | ||
+ | |||
+ | | ||
+ | *Several issues relating to the implementation of the second pillar payments, causing them to be missing or wrong in CAPMOD (simulation) and also CAPREG (regional database) | ||
+ | *Renaming all the standard scenario files in the folder pol_input\CAP_AFTER_2014, | ||
+ | *A randomly appearing issue with farm type trends. | ||
+ | | ||
+ | *Setting the default number of processors in the " | ||
+ | |||
+ | === STAR 1.0 === | ||
+ | This release attempts to provide a CAPRI model where a wide selection of tasks from baseline construction to simulation can be carried out. | ||
+ | With other versions of CAPRI, it has been a general feature that when some tasks were maintained, others ceased to work, so that there were | ||
+ | multiple model versions where some problems had been resolved but where not everything worked properly. | ||
+ | |||
+ | Since it is utopic to aspire that all mechanisms ever built into CAPRI would work simultaneously, | ||
+ | Features of the model that are not " | ||
+ | documented in programmatic form in the GUI batch execution | ||
+ | |||
+ | Some features that should be supported still fail to work properly. In particular, we note that the following technical problems persist: | ||
+ | |||
+ | | ||
+ | | ||
+ | *Numerical instability of the calibration of fertilizer distribution among crops. Repeated runs do not give identical results. | ||
+ | *Numerical instability of the calibration of animal feed to various animals. Repeated runs do not give identical results. | ||
+ | *Occasional failure of task " | ||
+ | |||
+ | The release has not been systematically tested from a content point of view. Nevertheless, | ||
+ | where some issues have surfaced. In particular, the distribution of rural development funds needs to be revised. Such revision has partially been done | ||
+ | already in various projects, but the modifications need to be consolidated and integrated into a maintenance release. Similar improvements have accumulated | ||
+ | in the areas of market model tariff data and greenhouse gas emissions, also foreseen to be integrated in a future maintenance release, after thorough testing. | ||