4 |
Notes on tags used in MITgcmUV |
Notes on tags used in MITgcmUV |
5 |
============================== |
============================== |
6 |
|
|
7 |
|
o verification/lab_sea: |
8 |
|
- overhaul of the forward model experiments. The main motivation |
9 |
|
for this revision is that lab_sea has proven quite fragile (when |
10 |
|
changing the sea-ice code, and switching platforms) to a point |
11 |
|
when failures were very hard to attribute to specific code problems. |
12 |
|
- the suspected reason for this fragility is noise amplification by evp so, |
13 |
|
to start with, we decided to replace evp with lsr in the main experiment. |
14 |
|
- the input.lsr experiment thus became obsolete and was removed. |
15 |
|
- it was replaced with the input.fd experiment that uses an |
16 |
|
analytical "free drift" solution as the ice velocity field. |
17 |
|
- Taken together, input (lsr), input.fd (free drift) and input.hb87 (evp) |
18 |
|
will hopefully allow us to discriminate problems due to dynamic solvers |
19 |
|
from problems due to the thermodynamic code. input.salt_plume (lsr) allows |
20 |
|
us to test additional options, along with the salt plume package. |
21 |
|
- Finally a pickup was generated (at the end of a one year run) to |
22 |
|
make the tests more representative of an actual model run. Previously |
23 |
|
the tests starting point was a 1m thickness of ice everywhere. |
24 |
|
o pkg/seaice: |
25 |
|
- introducing S\R seaice_freedrift.F that compute the |
26 |
|
analytical solution to an approximate ice momentum |
27 |
|
equation (i.e. the simple stress/coriolis balance). |
28 |
|
- define SEAICE_ALLOW_FREEDRIFT to trigger the computation |
29 |
|
of the free drift velocity field, and enable its use. |
30 |
|
To actually use the free drift solution as the model ice |
31 |
|
velocity field set SEAICEuseFREEDRIFT to .TRUE. in data.seaice. |
32 |
|
o move "useOASIS" from PARAMS.h to EEPARAMS.h and read it from "eedata" |
33 |
|
|
34 |
|
checkpoint62l (2010/10/04) |
35 |
|
o pkg/seaice: |
36 |
|
-fix the USE_ORIGINAL_SBI version (for variable freezing point); |
37 |
|
-use "celsius2K" in SEAICE_VARIABLE_FREEZING_POINT and in new |
38 |
|
version (with USE_ORIGINAL_SBI undef); |
39 |
|
o add hooks for new packages OASIS, the package will follow |
40 |
|
(hooks exclude the seaice pkg for now) |
41 |
|
o pkg/autodiff: ALLOW_AUTODIFF_WHTAPEIO |
42 |
|
Option to use mdsio_read_whalos.F/mdsio_write_whalos.F, |
43 |
|
rather than mdsio_readvector.F/mdsio_writevector.F, within |
44 |
|
adread_adwrite.F to read/write adjoint-related tapes to disk. |
45 |
|
o eesupp and pkg/mdsio: ALLOW_WHIO |
46 |
|
Option to write/read 2D fields to files including tiles halos. |
47 |
|
The main purpose is for adjoint related "tape I/O". |
48 |
|
The secondary purpose is for debugging phases. |
49 |
|
A word on those rather specifically intended purposes. |
50 |
|
The code was meant to be stripped down to the bare minimum. |
51 |
|
Typically, there is a unique and basic mapping to the global |
52 |
|
buffer (tile by tile, then proc by proc, then level by level), and |
53 |
|
byteswaps and meta-files are omitted. Indeed the (*_WH*) code is not |
54 |
|
meant to generate user friendly outputs of various shapes and forms. |
55 |
|
Rather it is intended, for the knowledgeabale developers, |
56 |
|
to be largely independent of the many mdsio options, to allow |
57 |
|
outputs of tiles+halos in debugging phases and in adjoint runs, |
58 |
|
and to allow some flexibility in tuning (adoint) I/O depending on each |
59 |
|
file system behavior. With regard to tuning, most of the potential knobs |
60 |
|
(to leave files open, to allocate the I/O indep. of usesinglecpuio, |
61 |
|
to specify directories, to specify the typical size of I/O calls, etc.) |
62 |
|
are not yet included, and will be added if they prove useful. |
63 |
|
o pkg/seaice: |
64 |
|
fix uninitialised arrays in USE_ORIGINAL_SBI version of seaice_solve4temp.F |
65 |
|
o pkg/seaice: |
66 |
|
new S/R seaice_solve4temp.F: this is the merged version of Ian Fenty |
67 |
|
code (seaice_budget_ice_if.F) which enable to recover old standard |
68 |
|
code (seaice_budget_ice.F) when option USE_ORIGINAL_SBI is defined. |
69 |
|
temporary: add "#define USE_ORIGINAL_SBI" at the top of seaice_solve4temp.F. |
70 |
|
o model/src (rStar): |
71 |
|
use simple average (not area weighted) of rStarFac at U,V point when using |
72 |
|
vectorInvariant and selectKEscheme=1,3 (consistent with mom. vertical advection) |
73 |
|
update output of exp. fizhi-cs-32x32x40 and fizhi-cs-aqualev20. |
74 |
|
|
75 |
|
checkpoint62k (2010/09/17) |
76 |
|
o adjoint |
77 |
|
* changed verification/global_ocean.cs32x15 ; adjoint now tests |
78 |
|
Adams-Bashforth 3 + NLFS + RSTAR |
79 |
|
* some more modifs required for ECCO-GODAE v4 |
80 |
|
o pkg/seaice |
81 |
|
add SEAICE_AGE_VOL option to use volume instead of area for |
82 |
|
integrating SEAICE_AGE |
83 |
|
o model/src: |
84 |
|
first check-in of sigma & hybrid-sigma coordinate code ; also includes |
85 |
|
non-linear free-surface parts ; but pressure-gradient not yet coded. |
86 |
|
o pkg/ptracers: |
87 |
|
option for ptracer to convert Salt Relax into additional EmP. |
88 |
|
tested in exp. global_ocean.90x40x15.dwnslp (update output) |
89 |
|
|
90 |
|
checkpoint62j (2010/08/25) |
91 |
|
o pkg/ggl90: |
92 |
|
other minor changes: remove 3-D temp array gTKE (+ add argument myIter) |
93 |
|
o pkg/dic: car_flux.F, phos_flux.F |
94 |
|
- reduce number of exp-calls in order to improve performance |
95 |
|
- clean up a little (replace fields by their macros, etc., fix |
96 |
|
typo in CPP-flag) |
97 |
|
o pkg/ggl90: minor changes |
98 |
|
- GGL90diffKrS was removed --> always use GGL90diffKr |
99 |
|
- GGL90viscAr was removed --> replaced with GGL90viscArU, GGL90viscArV |
100 |
|
- hack of mxlMaxFlag=2 --> ensure mixing between first and second level |
101 |
|
(commented out for now) |
102 |
|
- change in max/min operations to ensure that smoothing is ok |
103 |
|
- smoothing of GGL90viscAr was moved to ggl90_calc.F (as done for GGL90diffKr) |
104 |
|
- always use diffKrNrT as background profile (i.e. never use diffKr field) |
105 |
|
o pkg/cfc: bug fix, AREA(i,j,1,bi,bj) -> AREA(i,j,bi,bj) |
106 |
|
o pkg/dic: |
107 |
|
- model/src/impldiff.F: if TARGET_NEC_SX, extend loop ranges for better |
108 |
|
vectorization |
109 |
|
- small bug fix in insol for the unlikely case of a cartesian grid |
110 |
|
- towards vectorizing the dic package: bio_export.F, car_flux.F, phos_flux.F |
111 |
|
+ now vectorize, which also removes adjoint recomputations; |
112 |
|
+ replace integer maksp1 by _RL maskp1 |
113 |
|
+ replace a**x by exp(x*log(a)) in phos_flux.F for speed |
114 |
|
|
115 |
|
checkpoint62i (2010/07/21) |
116 |
|
o pkg/flt: |
117 |
|
- with OBCS: stop floats which enter the OB region |
118 |
|
o model/src: |
119 |
|
- use tempVertAdvScheme & saltVertAdvScheme (instead of horizontal ones) |
120 |
|
for implicit vertical advection. |
121 |
|
o pkg/seaice: |
122 |
|
- account for melting in seaice age evolution. |
123 |
|
- remove double counting of seaice ridging effect on seaice age. |
124 |
|
|
125 |
|
checkpoint62h (2010/06/18) |
126 |
|
o pkg/exch2: |
127 |
|
- remove exch2_*xy_rx files: call was replaced with exch2_*3d_rx(myNz=1). |
128 |
|
o tools/genmake2 |
129 |
|
- remove "-pdefault" option: redundant with the use of "packages.conf"; |
130 |
|
- remove file pkg/pkg_default : set the default as a pkg group |
131 |
|
("default_pkg_list") defined in pkg/pkg_groups; |
132 |
|
- fix for case pkg/pkg_depend is missing (was hanging before); |
133 |
|
- add option "-pgroups" to specify a different pkg_groups than the default. |
134 |
|
o verification/adjustment.cs-32x32x1: |
135 |
|
add a "minimal" set-up test (code_min & input_min) which only compiles |
136 |
|
eesupp/src and the 2 pkgs (exch2 & debug) which don't need model/src & inc. |
137 |
|
o tools/genmake2 |
138 |
|
- extend pkg_depend rules to model & eesupp (e.g., if model depend on [pkg])) |
139 |
|
- fix details of checking for mnc & profile pkg when NetCDF is unavailable. |
140 |
|
o pkg/exf: merge exf_bulk_largeyeager04 into exf_bulkformulae because these |
141 |
|
files are nearly the same anyway. |
142 |
|
Step 1: make exf_bulkformulae look like exf_bulk_largeyeager04: |
143 |
|
- redefinition of tau(i,i) (by a factor of ustar) |
144 |
|
- 1./exf(Const/T) -> exf(-Const/T) (big change in the results) |
145 |
|
- replace rhonil by rhoConstFresh in computation of evap (bug fix) |
146 |
|
- replace u/vstress=tau*rd*ws*cw by tau*rd*u/vwind (changes results) |
147 |
|
- replace |
148 |
|
rd(i,j)= rdn(i,j)/(exf_one - rdn(i,j)/karman*psimh ) |
149 |
|
shn = sh(i,j,bi,bj)*rd(i,j)/rdn(i,j) |
150 |
|
by |
151 |
|
shn = sh(i,j,bi,bj)/(exf_one - rdn(i,j)/karman*psimh ) |
152 |
|
(changes results) |
153 |
|
-> exf_bulkformulae v1.22, |
154 |
|
update verification experiments lab_sea, offline_exf_seaice, seaice_obcs |
155 |
|
(lab_sea: output.hb87.txt 1.11, output.lsr.txt 1.25, output.salt_plume.txt 1.13, |
156 |
|
output.txt 1.63 |
157 |
|
offline_exf_seaice: output.seaicetd.txt 1.7 |
158 |
|
seaice_obcs: output.txt 1.10) |
159 |
|
Step 2: do the actual merge and remove exf_bulk_largeyeager04.F |
160 |
|
-> exf_bulkformulae v1.23, |
161 |
|
unfortunately requires updating lab_sea.salt_plume (6 matching digits), |
162 |
|
and global_ocean.cs32x15.icedyn (only 11 matching digits) |
163 |
|
Also update output_adm of exp. lab_sea (all 4) and offline_exf_seaice. |
164 |
|
o adjoint of exch-1: |
165 |
|
- pass high-level EXCH S/R through TAF (eesupp/src/exch_ad_diff.list) |
166 |
|
(note: was already like this when using EXCH-2) and remove flow dir |
167 |
|
and hand-written AD version of high-level EXCH S/R (pkg/autodiff); |
168 |
|
- provide flow-dir for low-level exch1 S/R (eesupp/src/exch1_ad.flow); |
169 |
|
- update pkg/exch2 diff list. |
170 |
|
|
171 |
|
checkpoint62g (2010/05/19) |
172 |
|
o eesupp/src (exch-1): |
173 |
|
- split exch_rx.F into Forward S/R (exch1_rx.F) and Adjoint S/R (exch1_rx_ad.F) |
174 |
|
and remove argument "simulationMode"; same thing for all exch_*rx_cube.F |
175 |
|
(renamed to exch1_*rx_cube.F). |
176 |
|
- change accordingly exch_*_rx.template and AD version in pkg/autodiff |
177 |
|
to call new exch1 S/R ; update Makefile and .cvsignore. |
178 |
|
- replace call to exch2_xy_rx S/R with exch2_*3d_rx(myNz=1) (will remove |
179 |
|
exch2_xy_rx later) |
180 |
|
Note: after updating your code, need to run "make clean" in eesupp/src |
181 |
|
o test experiment bottom_ctrl_5x5: |
182 |
|
new output_adm.txt with fewer grdchk & less monitor output. |
183 |
|
o model/src: |
184 |
|
remove the call to ini_cori in initialise_varia.F (just keep the usual one |
185 |
|
in initialise_fixed.F). More consistent with coriolis & horizontal grid |
186 |
|
beeing treated in the same way (ini_grid is not called a 2nd time). |
187 |
|
o pkg/exf: |
188 |
|
- rewrite exf_bulk_largeyeager04.F for better vectorization, changes |
189 |
|
global_ocean.cs32x15/input.icedyn (11 digits of agreement), updated |
190 |
|
- fix adjoint (used worked for ALLOW_ATM_WIND defined, works for this now) |
191 |
|
- cosmetic changes to exf_bulkformulae.F to make it look more like |
192 |
|
exf_bulk_largeyeager04.F |
193 |
|
o eesupp/src (exch-1): |
194 |
|
- Fix AD EXCH code for 2-D domain special cases (Nx=1 or Ny=1). |
195 |
|
- Separate buffer filling and MPI sending: allow EXCH-1 to work for local |
196 |
|
array (non-shared) when using MPI+MTH. Also reduces number of BARRIER |
197 |
|
(even without using MPI). |
198 |
|
- Message mode: move RecvAck setting (indicator of buffer being ready) |
199 |
|
from send_put to recv_get S/R (was useless before, but not sure if |
200 |
|
it's much more useful now); |
201 |
|
- Switch the order of sync: MPI-proc 1rst and then threads; |
202 |
|
- take out spin-waiting code (#undef EXCH_USE_SPINNING), use BARRIER instead. |
203 |
|
- fix AD code for communication mode ='get' (but not used). |
204 |
|
o model/src: |
205 |
|
initialise dPhiHydX,dPhiHydY inside calc_grad_phi_hyd.F (so that TAF does |
206 |
|
not drop it in S/R mddynamics, producing NaN in hs94.1x64x5 AD-test exp). |
207 |
|
o utils/matlab/rdmnc.m: adapt to be able to use the generic matlab netcdf API |
208 |
|
o pkg/ctrl: require a specific set of control variables and exf-flags for |
209 |
|
adjoint of seaice (stop in ctrl_check.F if conditions are not satisfied) |
210 |
|
o model/src: |
211 |
|
a) 1rst version of a new driver S/R to turn-off output freq and flags after the |
212 |
|
1rst forward sweep, to avoid over-writing output files during recomputations |
213 |
|
recomputations (& grdchk); called from cost_final.F (& ctrl_init_ctrlvar.F ?) |
214 |
|
b) 2nd version: |
215 |
|
- add specific pkg S/R for seaice & ptracers (called from S/R TURNOFF_MODEL_IO); |
216 |
|
- switch-off more output flags (exf_monFreq, chkPtFreq, dumpInitAndLast, |
217 |
|
writePickupAtEnd) + seaice & ptracers output; |
218 |
|
- do not switch off MNC flags (otherwise, won't get admonitor netcdf file) |
219 |
|
o model/src: |
220 |
|
- new S/R rotate_uv2en_rl (..._rs) that rotates vector fields. |
221 |
|
o pkg/exch2: |
222 |
|
- remove "simulationMode" from arg. list of S/R EXCH2_RX1,2_CUBE ; |
223 |
|
- add argument "signOption" to EXCH2_RX1_CUBE (will be needed for SM exch). |
224 |
|
o pkg/autodiff & exch2: |
225 |
|
process exch_uv_agrid_3d_rx.f & exch2_uv_agrid_3d_rx.f through TAF |
226 |
|
(for now, only if ALLOW_EXCH2 is defined). |
227 |
|
o pkg/autodiff: |
228 |
|
- include PACKAGES_CONFIG.h in exch*ad.flow & exch*ad.F |
229 |
|
(not supposed to be in CPP_OPTIONS.h) to get ALLOW_EXCH2 defined correctly. |
230 |
|
+ clean-up comments (_RS is not always real*4) |
231 |
|
- fix bug in ADEXCH_UV_3D_RX (without EXCH2, was calling the forward exch S/R) |
232 |
|
- add a stop in ADEXCH_UV_AGRID_3D_RX if trying to use it with EXCH2: |
233 |
|
was calling a forward exch2, which is wrong ; used in SEAICE & EXF pkgs. |
234 |
|
o testreport (AD-tests): |
235 |
|
no longer link files from dir "../input" (1rst link files from |
236 |
|
"../input_ad.[xx]" if secondary test "xx" and then from "../input_ad") |
237 |
|
|
238 |
|
checkpoint62f (2010/04/29) |
239 |
|
o model/src/the_main_loop.F: |
240 |
|
adjust store directives for seaice evp and multicategory according to |
241 |
|
pkg/ecco/the_main_loop.F |
242 |
o adjoint: |
o adjoint: |
243 |
global_sum_ad was incomplete (noted many times by many people ;) |
global_sum_ad was incomplete (noted many times by many people ;) |
244 |
nice description by Jean U. as follows: |
nice description by Jean U. as follows: |
245 |
* allreduce(var) in global_sum.F can be interpreted as |
* allreduce(var) in global_sum.F can be interpreted as |
246 |
reduce(sum) followed by broadcast of sum. |
reduce(sum) followed by broadcast of sum. |
247 |
* The adjoint of that is |
* The adjoint of that is |
248 |
sum(adjoint) followed by broadcast(summed adjoint value) |
sum(adjoint) followed by broadcast(summed adjoint value) |
249 |
or in other words, allreduce(sum, adjoint vars) |
or in other words, allreduce(sum, adjoint vars) |
250 |
We were missing the sum(adjoint)! |
We were missing the sum(adjoint)! |
251 |
Benign, except(!) for "global" scalars appearing in tile loops (bi,bj) |
Benign, except(!) for "global" scalars appearing in tile loops (bi,bj) |