/[MITgcm]/MITgcm/doc/tag-index
ViewVC logotype

Diff of /MITgcm/doc/tag-index

Parent Directory Parent Directory | Revision Log Revision Log | View Revision Graph Revision Graph | View Patch Patch

revision 1.363 by edhill, Thu Oct 7 19:31:14 2004 UTC revision 1.1200 by jmc, Tue Nov 24 19:21:55 2009 UTC
# Line 1  Line 1 
1  $Header$  $Header$
2    $Name$
3    
4      Notes on tags used in MITgcmUV      Notes on tags used in MITgcmUV
5      ==============================      ==============================
6    
7    o update output of exp. global_ocean.cs32x15.icedyn after removing
8      #define SEAICE_OLD_AND_BAD_DISCRETIZATION from SEAICE_OPTIONS.h
9    o add entry points for Gianmaria's Nesting pkgs (from Contrib/nesting_sannino)
10    o mnc: add horizontal grid coordinates (XC,YC) and (XG,YG) to netcdf output
11      for complex grids, for now only to "state", "adstate", "adexf", "adseaice"
12    o model: add Christopher Wolfe's implemetation of the single reduction cg2d
13      (d'Azevedo, Eijkhout, and Romine, 1999) with CPP-flag ALLOW_SRCG and
14      runtime flag useSRCGSolver. Modify verification experiment global_with_exf
15      to test this code
16    o pkg/cd_code:
17      Change defaut D-grid time-stepping to get the same for D-grid momentum as for
18       C-grid momentum. D-grid velocity used to be stepped forward in time with
19       Adams-Bashforth only on surface pressure term. Tests show that using AB on
20       D-grid coriolis term improves stability (as expected from CD-scheme paper).
21      To reproduce old results, add 2 options (in CD_CODE_OPTIONS.h).
22      Update results of exp: global_with_exf (x2), ideal_2D_oce, isomip (x2),
23       lab_sea (3 Fwd +3 AD), natl_box (x2), tutorial_global_oce_biogeo (Fwd+AD),
24       tutorial_global_oce_latlon, tutorial_global_oce_optim & tutorial_tracer_adjsens.
25      Keep old results by adding CD_CODE_OPTIONS.h in exp: cfc_example, exp2,
26           lobal_ocean.90x40x15(+AD), global_ocean_ebm(+AD) and OpenAD.
27    o pkg/obcs:
28     - fix bug in initialisation (broken since Oct 1rst modification)
29       for useOBCSprescribe without useEXF.
30    
31    checkpoint61y
32    o pkg/seaice
33     - change (once again) the discretization for the evp solver: rather than
34       squaring the averages of strain rates, average the squares to give
35       a better approximation to VP behavior (in simple test); this breaks
36       verification experiments that use EVP (lab_sea and lab_sea.hb87)
37        --> update outputs
38    o add CPP-flag (in mom_calc_visc.F) and TAF directive (in gmredi_slope_limit)
39      to improve vectorization of adjoint code on TARGET_NEC_SX
40    o verification/vermix:
41      - change vermix to a more "classical" 1d column with high vertical
42        resolution, seasonal heat flux forcing and constant wind forcing
43        --> update outputs
44    o pkg/seaice
45     - fix diagnostics of principal stress components for EVP
46     - add optional diagnostics of non-linear convergence for LSOR solver
47     - make maximum zeta a runtime parameter
48    o model/src (3-d solver):
49      Undo modif from Dec 12, 2005 (solve_for_pressure.F cvs version v.49),
50       which consisted in removing the Surf. Non-Hydrostatic pressure from the
51       whole column and adding it to Eta (inspired from Casualli, 1999):
52       Only affects 3-D solver initial guess and only if using ExactConserv,
53       but tests did show a degradation of solver convergence. For this reason,
54       decide to disable this piece of code.
55       to recover previous version, just set zeroPsNH = exactConserv (line 78).
56      Update output of exp. global_ocean.cs32x15.viscA4 & hs94.cs-32x32x5.impIGW
57    o pkg/ggl90:
58     - fix previous modif (unfortunatly has not been documented here).
59    o pkg/seaice/autodiff:
60     - add CPP flag to include clipping of zeta in EVP code;
61       although clipping of zeta is not necessary for EVP and not recommended
62       it was done by default, now clipping is disabled by default
63     - modify computation and store zetaC/Z in seaice_evp for TAF
64     - add CPP-flag SEAICE_ALLOW_CLIPVELS (undefined by default)
65     - change seaice_calc_viscosities/strainrates for better
66       vectorization after AD by TAF
67     - rearrange common blocks in SEAICE.h once again for easier dumps of
68       adjoint output, adjust adcommon.h and g_common.h
69     - change flux form of default advection scheme for better vectorization
70       of adjoint code
71     - modify lab_sea/input.lsr to test the flux form of default advection
72       scheme
73    o autodiff: fix seaice fields in g_common.h (left over from 3 to 1 level
74      transition in checkpoint61r)
75    
76    checkpoint61x
77    o adjoint: adding two new verification experiments
78      * tutorial_global_biogeo: an online dic sensitivity experiment
79        (work with G. Forget)
80      * tutorial_dic_adjoffline: an offline dic sensitivity experiment
81        (an update of the Dutkiewicz et al., 2006 paper)
82      Both use the same CO2FLUX cost function, but different controls
83      Gradient checks look good, but some recomp. could still be traightened out
84      Should add xx_dic control variable to test at some point
85    o model/src:
86      add run-time parameters to check and/or mask initial Temp & Salt
87    o pkg/ptracers:
88      apply zonal filter (if used) to all passive tracers
89    
90    checkpoint61w
91    o adjoint:
92      * update and finish work on adjoint of dic package (G. Forget)
93      * start adjoint of offline package
94      * bug fix for cube-sphere TLM code (active_file_g.F)
95    o tutorial_global_oce_optim:
96      now tested with 4 tiles (change data.grdchk and update output_adm.txt)
97      and add SIZE.h_mpi for MPI testing
98    o pkg autodiff
99     - fix bug in autodiff_restore
100     - make genmake2 remove comments and empty lines from ad_input_code.f in
101       order to reduce file size (new script file remove_comments_sed)
102    o allows to specify vertical profile of vertical viscosity (viscArNr)
103    o pkg autodiff
104      autodiff_ini_model_io: comment out writing of grid information to netcdf
105      files, because at this time the grid fields are a bunch of zeros
106      (this is analogous to ini_mnc_vars.F)
107    o pkg seaice/autodiff:
108     left-over from removing the 3-time-level fields:
109     - small rearrangement of common blocks (SEAICE.h)
110     - fix field declaration in order to get meaningful output in
111       adseaice.*.nc (adcommon.h)
112    o pkg obcs:
113     - go through NH code only if nonHydrostatic=T
114     - fix restart for Orlanski (Hydrostatic; still to fix NH+Orlanski restart)
115     - move call to OBCS_CALC before SEAICE_MODEL which needs seaice-obc fields
116       => Update output of experiment seaice_obcs
117     - useOBCSbalance: code is wrong with multi-tile / proc: add a stop.
118     - fix NH+Orlanski restart (add wvel OBC value in pickup file)
119     - fix restart for useOBCSprescribe + useEXF
120    o pkg ctrl
121     - make obcs as control parameter work also with useSingleCPUio
122     - replace a few sny and snx by Ny and Nx to be consistent with
123       ctrl_set_globfld_x/yz.F
124    o pkg seaice
125     - re-introduce global field frWtrAtm for the case of
126       ALLOW_MEAN_SFLUX_COST_CONTRIBUTION defined (SEAICE.h, seaice_growth.F)
127     - catch the case of an empty filename in seaice_cost_init_fixed.F
128    o pkg ecco:
129     - small bug fixes in the_main_loop
130      . fix order of monitor arguments
131      . change SEAICE_MULTILEVEL to SEAICE_MULTICATEGORY
132      . move include DYNVARS.h up outside the ALLOW_AUTODIFF_TAMC block so
133        that ALLOW_ECCO_FORWARD_RUN works with NONLIN_FRSURF
134     - replace cos(yc*deg2rad) by _rA in cost_mean_heat/saltflux.F, fix the
135       imbalance diagnostics for wmean_h/sflux = 0
136     - add actual values to f_obcsn/s/w/e in ecco_cost_final.F
137     - catch the case of empty filenames in ecco_cost_init_fixed.F
138       and ecco_readparms.F
139     - fix the logic of wsalt=0.and.wsalt2=0 to wsalt=0.or.wsalt2=0 (and theta)
140       to make this statement meaningfull in ecco_cost_weights.F
141    o pkg zonal_filt:
142      - change ZONAL_FILTER S/R interface (allows to filter 2-D fields)
143      - when using rStar, filter uVel*hFacW instead of uVel
144       (tested without topography: fix a Pb of growing instability with NLFS)
145    o pkg/aim/thsice:
146     -Add capacity to read a Q-Flux to be applied in slab-mixed layer thsice_slab_ocean.F
147      (works as SST restoring)
148    o pkg/thsice:
149     -add specific parameter for salt restoring in slab mixed-layer
150       (by default equal to the temperature restoring)
151    
152    checkpoint61v
153    o pkg/kpp:
154     -add double diffusive contributions as a hack, turned off by default
155      for now, and the code can be excluded with a CPP-flag
156      EXCLUDE_KPP_DOUBLEDIFF just as EXCLUDE_KPP_SHEAR_MIX
157     -add a verification experiments to "vermix" to test this code
158    o pkg/mom_common:
159      Move computation of length scales to mom_init_fixed.F (avoid recomputation
160      at each time-steps*levels).
161    o pkg/layers:
162      Created a new package for computing volume fluxes in temperature or
163      [not yet implemented] density layers, e.g. for calculating residual
164      overturning circulations.
165    o pkg/diagnostics:
166      implement a RS type version for the set of DIAGNOSTICS-FILL subroutines
167    o fix few RS/RL type mismatch (check with ifort 11.1 "-warn all" option)
168    o pkg/mdsio (& pkg/rw): rework high level S/R interface:
169      To avoid mixing type (RS/RL) of input/output array argument,
170      replace single mixed-type array with a pair from each type (RS/RL).
171    o setting pickupSuff force to start from a pickup (even if nIter0=0): this
172      is now implemented for all pkgs (previously only done for the main pickup)
173    
174    checkpoint61u
175    o pkg/obcs:
176      - change OB?eta from _RS to _RL and put them into a separate commen block
177      - add code to read OB?eta from a file via obcs_prescribe_read: the code
178        compiles and does not destroy any other experiments, the data is read
179        properly, but the code is not tested in actual applications
180    o ini_mnc_vars.F: if available (ALLOW_CAL), use startTime_1 and 2 to
181      create a meaningful unit attribute for the time coordinate variable
182    o pkg/ebm: add plenty of missing "_d 0" ;
183       update results of experiment global_ocean_ebm (fwd + adjoint tests)
184      Notes: several pieces of code only works for (very) specific set up
185       (domain size, lat range, etc ...); should be documented & stop if one
186       of those assumptions is not meet.
187    o pkg/seaice: add missing "_d 0" in HSNOW initialisation
188       update results of experiments: lab_sea (3 fwd tests + 2 adjoint tests)
189          and offline_exf_seaice (seaicetd + adjoint).
190    o add missing "_d 0" in ShortWave flux penetration (S/R SWFRAC):
191       update results of experiments: lab_sea (4 fwd tests + 3 adjoint),
192        seaice_obcs, global_ocean.cs32x15 (icedyn & thsice) and natl_box (x2).
193    o few changes to pass when compiling with strick checking of arguments
194       across S/R (allow to find few bugs in S/R calls).
195    o pkg/seaice:
196     - seaice_evp: move if-statement out of loop (TEM) at the cost of 11 new
197       2d-fields, for slightly better performance
198    
199    checkpoint61t
200    o pkg/seaice:
201     - remove unused variables in seaice_evp
202     - reduce number of SQRT in seaice_evp and seaice_calc_viscosities
203    o eeset_parms.F, open_copy_data_file.F & ini_parms.F:
204       named file replacing SCRATCH files (for TARGET_BGL & TARGET_CRAYXT):
205       each processor opens a different file (a fix from Matt).
206    o cg2d:
207       use simple EXCH (overlap size = 1 and ignore corners), like in cg3d.F :
208       this reduces number of EXCH calls by 2 when using exch2.
209       For now, keep previous size array for gc2d_nsa.F to avoid Pb with store
210       directives and missing simple EXCH (exch_s3d_rx) adjoint code.
211    o pkg/thsice:
212       add code for Near Infra-Red albedo (from Jeff)
213       (turned on with run-time flag: thSIce_calc_albNIR, in data.ice).
214    o ini_model_io:
215       move (from packages_readparms.F & initialise_fixed.F) to ini_model_io.F
216       MNC & MONITOR initialisation calls; move MNC calls from {pkg}_readparms.F
217       to {pkg}_init_fixed.F for {pkg}= kpp, seaice & shelfice.
218    
219    checkpoint61s
220    o pkg/exch2 (exch2_rxN_cube*):
221       remove last BARRIER (no need to synchronise after getting data from shared
222       buffer (get) as long as any change to buffer (put,recv) is between BARRIER)
223    o change tiling of natl_box (from 2 to 4 tiles) to get it tested with MPI+MTH
224      and generate new output (for the 2 tests) using default rotationPeriod.
225    o pkg/exch2:
226      - always call exch2_*_cube, not exch-1 anymore, if useCubedSphereExchange=F
227        (was already the case with AUTODIFF_EXCH2 defined)
228      - add bj in exch2 arrays and S/R.
229      - can now use pkg/exch2 for regular (non CS) set-up; switch test experiment
230        MLAdjust to exch2 (identical results except with MPI -> truncation diff);
231    o add pkg/longstep for ptracer timestep a multiple of U/V/T/S timestep
232      - adds deltaT argument to the subroutines TIMESTEP_TRACER DWNSLP_APPLY
233        GAD_ADVECTION GAD_CALC_RHS GAD_IMPLICIT_R GAD_SOM_ADVECT
234      - verification experiment natl_box.longstep
235    o build_options: ifort+mpi_aces optfile (following Constantinos advise):
236      allow different versions of ifort (8 or 9) and different versions
237       of mpi (mpich or mpich2) to be used with the same optfile.
238      requires to load a netcdf module and set MPI_INC_DIR (see comments inside
239       optfile). Change testing scripts (example_scripts/ACESgrid) accordingly.
240    o pkg/seaice:
241      fix previous modif (3-level field removed) for old-pickup reading
242    
243    checkpoint61r
244    o pkg/seaice:
245     - clean up the 3-time levels of UICE,VICE,HEFF,AREA in three steps:
246      1. introduce fields for time step (N-1)
247      2. do not use levels 2 and 3 anymore (but keep them)
248      3. replace 3D versions of UICE,VICE,HEFF,AREA by 2D versions. This
249         includes changes to pkg/thsice/thsice_get_velocity.F,
250         model/src/external_forcing_surf.F, pkg/obcs/obcs_apply_seaice.F, and
251         pkg/obcs/obcs_apply_uvice.F.
252     - completely remove code for leap-frog time stepping for second order
253       advection
254     - adjusted adjoint accordingly;
255       gradient checks have improved by an order of magnitude!
256    
257    checkpoint61q
258    o pkg/seaice: fix bug in free slip boundary conditons for LSOR solver
259     - the boundary conditions along open boundaries are unclear, because the
260       associated masks are set to zero and are thus treated as closed when
261       applying the slip-boundary conditions.
262     - move initialisation of grid variables from seaice_init_varia to _fixed
263    o adding doc/diags_changes.txt
264    o model/src:
265      do_the_model_io: rename few pkg S/R which are called from do_the_model_io,
266       to avoid "_diags" naming if no relation to pkg/diagnostics.
267      ini_theta,ini_salt: fix (at least compile the code) reading from NetCDF
268       file and only call PLOT_FIELD_XYZ if debugMode=T.
269      remove few PLOT_FIELD_XY calls outside initialisation.
270      remove few unnecessary BARRIER.
271    o pkg/salt_plume: add SaltPlumeSouthernOcean to allow disabling
272      of salt_plume package in Southern Ocean
273    o pkg/thsice:
274     - fix hOceMxL in overlap (needed for sea-ice advection);
275       update output of experiment global_ocean.cs32x15.icedyn.
276    o pkg/seaice:
277     - make the (placeholder-)tracer IceAge a little more meaningful
278      by avoiding ridging of age due to convergent ice flow
279     - add diagnostics for surface temperature, atmospheric and oceanic
280       heat flux, and atmospheric and oceanic ice growth
281    
282    checkpoint61p
283    o eesupp (global_max & global_sum):
284     - add one more element to buffer (start at index 0) for GL_MAX/SUM output;
285     - remove starting & endding barrier (no longer needed)
286    o pkg/mdsio, writelocal:
287       works also in multi-threaded when LOCBIN_IO_THREAD_SAFE is undefined
288       (remove the STOP): uses shared buffer IO to store data from all threads
289       and then let master-thread write nThreads tiles.
290    o pkg/mdsio (read/write field):
291     - tiled IO done in 1 piece (all levels at a time);
292     - new header file "MDSIO_BUFF_3D.h" with 3-D buffers.
293     - multi-threaded: allow to read/write local (non-shared) array
294       (was already working with singleCpuIO ; now works also without);
295       => no longer needs barrier call after reading a file (added inside
296       mds_read/write field).
297     - move barrier calls outside gather/scatter_2d to mds_read/write_field
298    o pkg/obcs/exf
299      - exf_getffieldrec.F: add a few ". _d 0" and
300                            add code to catch the case fldperiod = 0.  
301      - obcs_precribe_read.F: change if statements so that they match
302                              the variable type (_RL)
303      - add a separate exf_iprec_obcs to exf_set_obcs (by default equal to
304        exf_iprec) as part of namelist EXF_NML_01
305    o pkg/mdsio:
306      - read/write tiled (local) files: read/write 1-level tile chunk at a time
307        (instead of segment of length sNx); expected to speed up tiled IO.
308    o pkg/exch2:
309      - take buffer copy from/to array out of S/R exch2_send/recv into new
310        S/R exch2_put/get ; Exch of local variable now works with MPI+MTH
311        (tested by removing commom block statement in SOLVE_FOR_PRESSURE.h).
312      - ad version of send/recv no longer needed (but needs exch2_ad_put/ad_get)
313      - simplify argument list of S/R exch2_get_uv_bounds and exch2_get_scal_bounds
314        (which replaces exch2_get_recv_bounds & exch2_get_send_bounds) by
315        including Topology header file (and common blocks).
316      - implement EXCH_IGNORE_CORNERS in scalar exchange (rx1);
317        remove 2nd exch call in exch2_s3d_rx (no longer needed).
318      - document S/R arg. list (+ update some comments)
319    o pkg/seaice:
320      - added SEAICE_CLIM_AIR code, which permits modulation of surface air
321        temperature and humidity over sea ice based on climatological values.
322      - clean up computation of Hibler+Bryan (1987) stress coupling for the case
323        of LSR (this change is expected to change the results slightly because now
324        it uses slightly difference moduli from the second last LSR solution, but
325        that is more consistent with the stress computations; this part of the code
326        is not tested in the verification experiments)
327      - fix diagnostics for flux of ice in case of B-grid
328      - turn strain rates eij and press into global fields within global
329        common block in SEAICE.h for more straighforward diagnostics
330      - fix diagnostics for principal stress components, press, zeta, eta
331        to give something meaning full
332    o change tiling of global_ocean.cs32x15 (12 tiles, 32x16) and generate
333      new output (all 4 tests) using default rotationPeriod.
334    o pkg KPP:
335      - add flag (LimitHblStable) to avoid limiting BL depth under stable conditions
336      - fix vertical indices in RI_IWMIX (match between KPP grid from 0 to Nr+1
337        and normal grid from 1 to Nr)
338    o Fix computations of L4rdt in mom_calc_visc.F
339    o eesupp:
340      new S/R ALL_PROC_DIE (like EEDIE, without irrelevant threads err msg):
341      should be called before a "stop" if we know that all process are going
342      to stop; if one Proc does call this S/R, will hang in MPI_FINALISE.
343    
344    checkpoint61o
345    o pkg/exch2: change check_depths to issue just a warning (instead of error+stop)
346    o model/src/ini_curvilinear_grid.F:
347       compute angleSin/CosC when they are not read from a file
348    o pkg/seaice:
349       add pseudo time stepping for LSOR
350    o pkg/exch2:
351       temporary fix for exch2_s3d_rx; update results of exp. hs94.cs-32x32x5.impIGW
352    o pkg/seaice:
353       Adding separate sea ice albedo, drag coefficients, and HO in Southern
354       Ocean from those in Arctic Ocean.  See *_south in SEAICE_PARAMS.h
355    o SingleCpuIO:
356       fix bug put before chkp61n (May 11), when more than 2 MPI cpu are used.
357    o pkg/seaice:
358       put exchanged variable in (local) common block for MPI+Multi-Threads
359       to work (necessary with exch1, and for now with exch2 too).
360    o verification: to get more experiments tested with mpi, mth and mpi+mth,
361      change tiling of:
362       aim.5l_Equatorial_Channel, aim.5l_LatLon, dome, exp4, global_ocean.90x40x15,
363       hs94.cs-32x32x5, MLAdjust, offline_exf_seaice & tutorial_plume_on_slope
364      update output of exp:
365       exp4, global_ocean.90x40x15(+.dwslp), MLAdjust(all 5),
366       tutorial_plume_on_slope and hs94.cs-32x32x5 (use default rotationPeriod)
367      + ideal_2D_ocean: use default rotation period + test Global_Sum_SINGLECPU
368                       (note: output.txt generated on faulks using only 1 tile)
369    o eesupp & mdsio (SingleCpuIO):
370     - remove MISSING_TILE_IO (from MDSIO_OPTIONS.h), replaced by run-time
371       parameter "W2_useE2ioLayOut" (read from file "data.exch2").
372       Note: was not effective for globalFile & useSingleCpuIO=F; now fixed.
373     - move MDSIO_SCPU.h (pkg/mdsio) to EEBUFF_SCPU.h (eesupp/inc).
374     - fix GLOBAL_SUM_SINGLECPU when using Exch2; re-use same buffers and same
375       gather/scatter S/R as with SingleCpuIO (=> 1 less 2D global RL array).
376    o pkg/exch2:
377     - new code to set-up W2-Exch2 topology (replace matlab-topology-generator):
378       read parameter file "data.exch2" if it exists; otherwise try default regular
379       cube without blank-tile; new header file "W2_EXCH2_SIZE.h";
380     - update matlab-topology-generator (exch2_setup_cs6_print.m) to be compatible
381       with new code (not to be used, just as a backup solution).
382     - add examples (e.g., for lat-lon-cap_120) of parameter file "data.exch2"
383       in utils/exch2/input.
384    
385    checkpoint61n
386    o eesupp & mdsio (SingleCpuIO):
387      - move mapping to global io-buffer inside gather_2d/scater_2d: this save
388        memory (1 less 2D global RL array); skip 1 buffer copy; and only send/
389        receive real*4 array (instead of real*8) to read/write 32.bit files.
390        (new template for gather_2d/scater_2d, new set of S/R MDS_PASS_R4,8toRL,S
391         and remove new mapping S/R)
392    o pkg/mdsio: in preparation for topology-generator within pkg/exch2:
393      - Change declaration of SingleCpuIO buffer, reduced to only 1 dim.:
394        xyBuffer_size, which is set to W2_ioBufferSize from W2_EXCH2_PARAMS.h
395        when using exch2. Add S/R to map global io-buffer to global model array.
396      - uses exch2_global_Nx,y instead of exch2_domain_nxt,nyt.
397    
398    checkpoint61m
399    o write_utils : change WRITE_1D_R8 to WRITE_1D_RL
400      and add 3 other S/R for other types (R4,R8,RS).
401      Change calls to WRITE_0D/1D_R[4,8,S,L] to match the type of argument.
402    o eesupp/inc/CPP_EEMACROS.h (EXCH & GLOBAL_SUM/MAX macros):
403     - ensure suffix (_R4,_R8,_RS,_RL) correspondance between macro and S/R ;
404     - reduce number of macro definitions (keep only those which are used);
405       can always call directly the corrresponding S/R if needed.
406     - everywhere in the code: change macros (EXCH & GLOBAL_SUM/MAX) suffix
407       _R4/_R8 to _RS/_RL when applied to _RS/_RL variable.
408     Fixed wrong type of arg in:
409       atm2d/put_ocnvars.F cheapaml/cheapaml.F ocn_compon_interf/ocn_apply_import.F
410       ctrl/ctrl_map_ini_ecco.F seaice/seaice_do_diags.F seaice/seaice_model.F
411     To fix: global_sum of var in common block is wrong (multi-threaded) in:
412       dic/dic_atmos.F ebm/ebm_area_t.F ebm/ebm_zonalmean.F sbo/sbo_calc.F
413     To fix: aim_v23/aim_do_co2.F (BARRIER & GLOBAL_SUM within bi,bj loops)
414    o adjustment.cs-32x32x1: test "blank tiles" when compiling with mpi; 2nd
415      "nlfs" mpi test is going to stop when checking for unconnected tile egdes.
416    o eesupp/src: new S/R to stop everyone when 1 (or more) Proc. find an error
417    o pkg/exch2: new S/R EXCH2_CHECK_DEPTHS to check that unconnected tile
418      edges are closed (zero depth); might happen with "blank tiles";
419      for now, disabled if using OBCS.
420    o tools/gemake2: delete modifs from March 27-29 2009 (with option "-mpi":
421      link *_mpi files from "MODS" dir) to return to a strait-forward behavior.
422    o move read_write.F to write_utils.F ; new parameter (maxLengthPrt1D)
423      to reduce length of 1.D array print in STDOUT.
424    o adjustment.cs-32x32x1: changed to oceanic test with 1 continent
425      + use 48 tiles (16x8): this will allow to test "blank tiles".
426    o start to test MPI + multi-threaded (change testreport to skip tests
427      where number of tiles do not match).
428    o genmake2: add option "-omp" to turn on Open-MP ;
429      passed to testreport (if using -mth) ; merge few (*+mth) optfiles.
430    o pkg/exch2 (+ utils/exch2): ignore blank tiles (instead of removing them)
431      and keep the original tile numbering. Note: compatible with old
432      W2_EXCH2_TOPOLOGY.h & w2_e2setup.F topology files.
433    
434    checkpoint61l
435    o Overlaps had been forgotten in calculating ijk keys : fixed
436    o fix cyrus makedepend for gcc 4.4
437    o experiment fizhi-cs-aqualev20:
438      switching to new version of S/R GETPWHERE (#define TRY_NEW_GETPWHERE)
439      and generate new output. Note: new output is much closer to the old
440      one (v1.8) generated with pgf77 -O2 on Mar 14 2007 than it is from
441      the previous one (v1.9) generated with pgf77 -O0 on Jun 13 2007.
442    o pkg/fizhi:
443     - change to avoid indices going deliberately over array-bounds
444     - remove unnecessary MPI stuff
445     - perpetual spring equinox with "#define FIZHI_USE_FIXED_DAY"
446     - new version of S/R GETPWHERE available with #define TRY_NEW_GETPWHERE:
447       does not go over array-bounds and therefore returns reliable output.
448     - in fizhi_driver.F & fizhi_turb.F, fix "get_alarm" calls:
449       this S/R has 4 output arguments, which are used inside "get_alarm";
450       when it is called with the same variable "ndum" in place of several
451       output arguments, this produces weird side effect inside "get_alarm"
452      (e.g., datein=dates(n) is overwritten by timein=times(n) since both
453       datein & timein, resp. 2nd and 3rd arg., are pointed to the same "ndum"
454       address) and produces error.
455    o tools/gemake2: (March 27-29 2009)
456      with option "-mpi": link *_mpi files from "MODS" dir (this is what
457      testreport does).
458    o lab_sea experiment: change from 2x1 tiles to 2x2 tiles and regenerate output
459    o pkg/seaice: fix bug in new version of S/R SEAICE_LSR.F:
460       update lab_sea.lsr & lab_sea.salt_plume results
461    o pkg/seaice:
462      Major overhaul of the LSOR solver: change discretization from original
463      finite differences to finite volume. The old routine is still in the
464      file seaice_lsr.F and can be turned on with the CPP-flag
465      SEAICE_OLD_AND_BAD_DISCRETIZATION
466      Along with this change, the discretization of the strain rates is changed.
467      The same flag turns on the old discretization in seaice_calc_strainrates.F
468      All verification experiments with seaice are affected (except for
469      seaice_exf_offline); global_ocean.cs32x15/input.icedyn recovers the old
470      results by setting the above flag.
471      Further changes involve changes in defaults:
472      - ALLOW_FLOODING is defined and turned on by default
473      - SEAICEadvSnow = .true. is now the default
474      - SEAICEadvSalt = .true. is now the default
475      - SEAICEadvAge  = .true. is now the default
476      - SEAICE_clipVelocities  = .false. is now the default
477                                         (as per J. Zhang's recommendation)
478      - B-grid, and thus not tested: SEAICE_TEST_ICE_STRESS_1/EXPLICIT_SSH_SLOPE
479        is defined, SEAICE_TEST_ICE_STRESS_1 is renamed into SEAICE_BICE_STRESS
480      - seaice_growth: replace computation of UG by a simple copy from wspeed
481    
482    checkpoint61k
483    o pkg/seaice: a few bug fixes mostly concerning the metric terms:
484      seaice_lsr: fixed a few metric terms,
485                  affects lab_sea.lsr, lab_sea.salt_plume, seaice_obcs
486                  add more debugging diagnostics
487      seaice_evp: removed superfluous many metric terms of FV discretization
488                  of stress divergence
489                  affects lab_sea, lab_sea.hb87
490      seaice_ocean_stress: removed superfluous many metric terms of FV discretization
491                  of stress divergence for non-evp solver
492                  (this part is not tested anywhere)
493      seaice_calc_strainrates: fixed a bug in no-slip boundary conditions,
494                  they were effectively only half slip
495                  affects lab_sea.hb87
496      updated all relevant verification experiments (except lab_sea//output_adm.txt
497        which was left over, but fails at level 7 & 6)
498    
499    checkpoint61j
500    o pkg/seaice: turn a few hard wired parameters into run time parameters
501    o pkg/seaice/exf/monitor: turn netcdf coordinate variable T into model
502      time in seconds as promised by the usints in seaice_monitor and exf_monitor
503    o pkg/mnc: fix the coordinate variables for multi-tile curvi-linear grids
504      that are not cubed-sphere grids
505    o pkg/seaice: fix a bug for the rare case of SEAICE_VECTORIZE_LSR
506    o pkg/ctrl:
507      fix bug in ctrl_depth_ini.F (EXCH_XYZ was applied to 2-D field xx_r_low)
508    o non-hydrostatic (calc_gw.F):
509      fix viscA4 on CS-grid + fix diagnostics: Wm_Diss & Wm_Advec
510      update output of exp. global_ocean.cs32x15.viscA4
511    o remove backward compatibility for thetaMin,phiMin
512      (replaced by xgOrigin,ygOrigin on Jan 27, 2009)
513    o pkg/exf: fix a serious bug in exf_set_uv.F: do a rotation of the
514      interpolated wind field not only for curvilineargrid=.true., but also
515      for a rotated grid (rotateGrid=.true.)
516    o pkg/exf: add capability to bypass interpolation for runoff
517      by setting yet another CPP-flag
518    o eesupp/src, B-grid exchange:
519      add simple (6 tiles, non MPI) CS exch + standard interface S/R.
520    o autodiff
521      new CPP option ALLOW_TAMC_SINGLEPREC_COMLEV
522      allows to switch to single-prec common blocks;
523      corresponding switch occurs in tamc.h, integer isbyte
524      TAF store directivs "byte" and "kind" seem equivalent;
525      Most tamc.h have been updated correspondingly.
526    
527    checkpoint61i
528    o autodiff:
529      fix autodiff_sore/_restore indices for obcs
530      (spotted by I. Hoteit, M. Mazloff)
531    o pkg/autodiff, pkg/ctrl:
532      Add flag to reduce all tapelev I/O to single-prec.
533      In data.ctrl set
534        doSinglePrecTapelev = .TRUE.
535    o model/src/ini_curvilinear_grid.F, new grid-file format without EXCH2:
536      check in hack for SX8 compiler (for dxV, dyU); remove it afterwards.
537    o pkg/shelfice: fix bug with SHELFICEconserve flag, prepare for
538      real fresh water flux (not yet)
539    o pkg/mdsio & rw:
540     - add argument & option to S/R MDS_WRITEVEC_LOC (avoid Open/Close & write-meta)
541     - add simple interface S/R to MDS_WRITEVEC_LOC in pkg/rw: WRITE_GLVEC_RX.
542    o pkg/flt:
543     - replace FLT_INIT by 3-steps standard initialization S/R: readparms,
544       init_fixed & ini_varia.
545     - clean-up & simplify linear interpolation S/R:
546       move flt_bilinear.F -> flt_interp_linear.F ; add arg. myThid.
547     - fix some indices (mainly vertical index) ; add IMPLICIT NONE.
548     - more efficient I/O, using new options of MDS_WRITEVEC_LOC S/R.
549     - add vert. coordinate & horiz. indices to output files.
550     - change vertical position in initial condition, from index to depth [m].
551     - store horizontal (decimal) indices i,j in common block (instead of coord. x,y)
552       (easier to get to a curvilinear grid) ; delX,delY no longer used.
553    o pkg/ggl90: a few modifications:
554     - fix bottom boundary condition, and interpolation of KappaE
555       near top and bottom
556     - use same set of viscosity/diffusivity for TKE/momnetum/tracer
557     - add smoothing option as in Blanke and Delecluse (1993) (--> ALLOW_GGL90_SMOOTH)
558     - add a few options for mixing-length upper limit (--> mxlMaxFlag)  
559    o rename thetaMin,phiMin -> xgOrigin,ygOrigin
560      (maintain temporary backward compatibility, until next checkpoint)
561    
562    checkpoint61h
563    o pkg/diagnostics with "periodic averaging diagnostics":
564      fix S/R DIAGNOSTICS_COUNT ; hack diagnostics_out.F to get NetCDF output.
565    o pkg/my82: add missing "_d 0" ; update output of exp. vermix.my82
566    o pkg/obcs: fix loop ranges for balancing code
567    o pkg/flt:
568     - improve criteria for finding which tile owns a float.
569     - fix FLT_EXCH for case without MPI ; apply cyclic BC + fix also the MPI case.
570    o Add well-mixed CO2 box in aim_v23 (which includes changes in pkg
571      aim_compon_interf, ocn_compon_interf, gchem, and dic to get coupling
572      with ocean biogeo)
573    o pkg/flt:
574     - do some cleaning and fix the restart ;
575     - add output.txt in flt_example/results to get this pkg tested.
576    o genmake2: add an EXTENDED_SRC option and flag.
577       for now, cannot be turned on on command line (only through genmake_local)
578    o pkg/mdsio: read/write vector:
579     - singleCpuIO: fix RL/RS in MDSWRITEVECTOR by calling new S/R MDS_BUFFERtoRL/RS
580     - singleCpuIO=F: fix arrType & filePrec & _BYTESWAPIO in both MDSREADVECTOR
581       & MDSWRITEVECTOR by calling new S/R MDS_RD/WR_VEC_RL/RS.
582     - affects gradient of test-exp "bottom_ctrl_5x5" (not due to _BYTESWAPIO)
583      (drop to 4 digits matching for grad). But this test does not look very
584      reliable (was already failling on eddy, fc5, at 6.digits). Update output.
585    
586    checkpoint61g
587    o pkg/flt:
588      - move FLT_CPPOPTIONS.h to FLT_OPTIONS.h (standard name)
589       + make OPTIONS file more standard.
590      - rename S/R MDSREADVECTOR_FLT to FLT_MDSREADVECTOR (to mach src file name)
591      - fix _BYTESWAPIO CPP-Flag
592      - standard reading of file-parameter "data.flt"
593      - fix argument list of S/R FLT_RESTART
594      still need to fix _BYTESWAPIO in pkg/mdsio/mdsio_writevector.F
595    o pkg/obcs: fix a CPP-flag, bug reported by Jeff Blundell
596    o gather_2d.F/scatter_2d.F: suppress vectorisation on NEC SX in respond to
597      a still unfixed compiler/optimization bug
598    
599    checkpoint61f
600    o pkg/seaice, LSR solver: fix bug in GLOBAL_MAX calls ;
601      update results of global_ocean.cs32x15.icedyn test.
602    o move getcon.F from model/src to pkg/fizhi.
603    o pkg/exf: add parameter for extrapolation of temp up to the surface
604       and option to prevent negative evap (in bulk_largeyeager04 only).
605    o Prather Advection scheme: fix tracer conservation for divergent flow
606      (e.g., when using NonLin Free-Surface).
607    o kpp: retire KPPmld diagnostics --> use MXLDEPTH instead
608    o gmredi (Visbeck-variable-K):
609     - add more parameters to Visbeck-variable-K.
610     - use a 5 points average for dSigmaR in Visbeck-K calculation
611       (more "homogenous": same stencil and same weights as in dSigmaH)
612     - update output of ideal_2D_oce experiment.
613    o fix CPP-flag REAL4_IS_SLOW, when _RS expands into real*4
614      (#undef REAL4_IS_SLOW)
615     - pkg/mnc/mnc_cw_cvars.F: write _RS-grid variable as netcdf-real*4
616       coordinate variable
617     - pkg/monitor/monitor.F: call mon_printstats_rs for _RS variables
618       (surface forcing fields), removes some of the functionality
619     - model/src/write_grid.F: write _RS variables as RS-netcdf variables
620     - model/src/diags_oceanic_surf_flux.F: fix a few diagnostics, but
621       probably not all: copy _RS surface flux fields to RL field before
622       calling DIAGNOSTICS_FILL
623     - model/inc/CPP_EEMACROS.h: make the _EXCH_*_RS macros expand into
624       real*4 (CALL EXCH_*_RS) versions.
625     - tested in 2 experiments: inverted_barometer & solid-body.cs-32x32x1
626       (generate new output).
627    
628    checkpoint61e
629    o gmredi (Visbeck-variable-K):
630      - fix the "OLD_VISBECK_CALC" option + move the #undef to GMREDI_OPTIONS.h
631      - change computation of Visbeck-K where Slope > Smax :        
632        now: N*min(Slope,Smax) (similar to OLD_VISBECK_CALC with gkw91 taperFct)
633        previously was: M*sqrt(min(Slope,Smax)) ; update ideal_2D_oce output.
634    o bottom-drag in P-coord.: change units of bottomDragLinear & bottomDragQuadratic
635      to be the same as with Z-coord. (i.e., m/s & no-units respectively).
636    o calc_viscosity: fix index range (was wrong for CD-Scheme & explicit Visc)
637    o pkg gmredi, linear & fm07 tapering: put an upper limit on Slope^2 so that Kwz
638      does not become too large (to avoid precision problems in implicit-diffusion
639      solver); update ideal_2D_oce output.
640    o pkg ggl90:
641      - in ggl90_cal.F: compute only one set of visc/diff, used to
642        step forward TKE/T/S/momentum
643      - default value of GGL90viscMax/GGL90diffMax larger and equal (to
644        have Prandlt =1)
645    o gmredi (fm07):
646      - add lower limit on Transition layer thickness + lower limit on 1/lambda
647      - allow to set few more params from data.gmredi
648    o pkg ggl90:
649          - add missing sqrt(2) factor in computation of mixing length
650            scale in ggl90_calc.F
651            (see Eq. (2.35) in Blanke and Delecluse, JPO, 1993)
652    
653    checkpoint61d
654    o adjoint modifs
655      - adapt to new field rhoInSitu
656      - allow to revert from StoreDynVars2D, StoreDynVars3D
657        to individual fields
658        (switches AUTODIFF_USE_OLDSTORE_2D, AUTODIFF_USE_OLDSTORE_3D)
659    o store 3-D (in-situ) density in commom block (DYNVARS.h)
660     - save 1 rho computation.
661     - no longer modify T & S inland when using down_slope pkg.
662    o gad_som : allow to switch to SOM advection for T & S without corresponding
663      pickup files (using new S/R: MDS_CHECK4FILE).
664    o keep removing _BEGIN/_END_MASTER between MDSIO S/R call
665      (for useSingleCpuIO to work in multi-threaded)
666    o pkg/shelfice:
667     - disentangle parameters: retire shelfIceFile in data/PARM05 and substitute
668       with SHELFICEtopoFile in data.shelfice
669     - move code for reading ice shelf topography and modifying hFacC into separate
670       subroutines of the shelfice package
671     - separate initialisation of "fixed" and "variable" variables
672     - kTopC is not (yet) replaced by kSurfC, although this is possible
673    o fix broken diagnostic SIatmFW and changed the units from m/s to kg/m^2/s
674    o add initialisation of deepFac if using Pcoords (new S/R set_grid_factors)
675      and rename:
676      ini_phiref.F          --> set_ref_state.F  (+ set anelastic factors)
677      ini_reference_state.F --> load_ref_files.F (- set anelastic factors)
678    o change FIND_RHO_SCALAR : return rho (instead of rho - rhoConst)
679    
680    checkpoint61c
681    o add option ALLOW_ADDFLUID and run-time selector "selectAddFluid"
682      to add mass source/sink of fluid in the interior (3-D generalisation
683      of oceanic real-fresh water flux).
684    o pkg/monitor: fix recip_dr argument in mon_advcflw2 call (-> advcfl_W_hf_max)
685    o vermix test experiment: switch from LINEAR EOS to MDJWF (not tested before)
686    o new pkg: down_slope
687      density-driven downsloping flow parameterisation (Tellus, 1999, 412-430).
688      - presently, modify T & S inland (dwnslp_calc_rho.F).
689        can be avoided if rho was stored in common bloc and used in calc_phi_hyd.
690      - implementation for ocean in P-coords not tested.
691      - add secondary test to global_ocean.90x40x15 (input.dwnslp) to check this pkg.
692    o move kSurfC,kSurfW & kSurfS from SURFACE.h to GRID.h (next to kLowC)
693      (to facilitate conversion of oceanic pkg to p-coordinate).
694    o change FIND_RHO to FIND_RHO_2D :
695      pass arguments tFld & sFld as local (tile) 2D-arrays ; +fix EOS_CHECK.
696    o new pkg: cheapaml
697    
698    checkpoint61b
699    o exch2:
700      change index bounds in rx2_cube exchanges (new S/R: EXCH2_GET_UV_BOUNDS)
701      - no longer depend on the order sequence (N,S,E,W).
702      - 3rd exchange no longer needed (tested with 24 tiles).
703      - same modif to hand-written adjoint S/R (global_ocean.cs32x15: zero diff)
704      - exch_UV_A-grid readily available (but not yet tested).
705      comment out 3rd exch call and remove copy of V to U at SE & NE face-corners
706      (both are no longer needed) in exch_uv: no effect in forward run; but
707       get truncation error differences with adjoint exch.
708    o exch2:
709     - change index-bounds storage (moved from target to local tile,
710       more intuitive this way) ; rename/remove some variables.
711     - change utils/exch2/matlab-topology-generator & code_mods accordingly.
712    
713    checkpoint61a
714    o exch2/matlab-topology-generator:
715      fix bug in index bounds for N-S internal exchange (hard to tell if this
716      had any effect on the solution).
717    o pkg/mnc: small fix in mnc_handle_err: make sure that length of msgbuf
718      is exceeded
719    o testreport: modify syntax of awk, so that it works also with
720      awk, and not only with nawk and gawk
721    
722    checkpoint61
723    o autodiff
724      Change default for TAF usage by removing argument '-nonew_arg'
725      This changes TAF subroutine argument list (ordering of active var.)
726      Omission of this flag leads to incompatibility w.r.t. TAMC
727      To restore TAMC-compatibility, need following modifs:
728      * use adoptfile tools/adjoint_options/adjoint_tamc_compatibility
729      * use CPP option #define AUTODIFF_TAMC_COMPATIBILITY
730      Tested TAF version is 1.9.22
731      N.B.: exch2 hand-written adjoint code currently not TAMC compatible
732    
733    checkpoint60
734    --->>> This is the last checkpoint for which generating the adjoint
735    --->>> is done via the TAMC-compatibility TAF-flag "-nonewarg"
736    --->>> by default.
737    --->>> Future checkpoints will ommit this flag by default.
738    o pkg/generic_advdiff, os7mp: simplify and avoid division by zero.
739    o pkg/grdchk: Add gradient check to etan0 perturbations.
740    o pkg/exf: read ice area from file (#ifdef ALLOW_ICE_AREAMASK).
741    o pkg/autodiff: more flexibility in zeroadj.
742      model/src: modifying do_oceanic_phys.F accordingly.
743    o pkg/ctrl: Bounds for (kapgm,kapredi,eddypsi) parameter estimation.
744    o model/src and pkg/gmredi: GMREDI_WITH_STABLE_ADJOINT CPP option
745      special setup of gmredi for which the adjoint is stable
746      enough for parameter optimization.
747    o bridging the gap between eddy stress and GM.
748      -> eddyTau is replaced with eddyPsi (eddyTau = f x rho0 x eddyPsi)
749          along with a change in CPP option (now ALLOW_EDDYPSI).
750      -> when using GM w/ GM_AdvForm:
751          The total eddy streamfunction (Psi = eddyPsi + K x Slope)
752          is applied either in the tracer Eq. or in momentum Eq.
753          depending on data.gmredi (intro. GM_InMomAsStress).
754      -> ALLOW_EDDYPSI_CONTROL for estimation purpose.
755      The key modifications are in model/src/taueddy_external_forcing.F
756      pkg/gmredi/gmredi_calc_*F pkg/gmredi/gmredi_*transport.F
757    
758    checkpoint59r
759    o new S/R (pkg/mdsio/mdsio_facef_read.F) reading of sNx+1 x sNy+1 array
760      from per-face file (take S/R READSYMTILE_RS out of ini_curvilinear_grid.F);
761      fix option to read coriolis(@ cell-corner) from files with CS-grid.
762    o pkg/mnc: add some attributes to standard 1D-coordinate variables
763    o pkg/diagnostics: enforce missing_value attribute for scalar variables at
764      mass points, when using mnc for output
765      - add runtime parameter (missing_value, missing_value_int) to override
766        default (which is the value of getcon('UNDEF'))
767    o pkg/mnc: prepare mnc for the actual use of missing values with the
768      diagnostics package: small fix in mnc_cw_readwrite.template and more
769      initialisation of never used fields
770      - replace mnc_common.h and mnc_id_header.h with corresponding upper case
771      versions
772    o pkg/thsice/thsice_ini_vars.F added default initial values so that
773      thermodynamics sea ice solver does not blow up when some initial fields
774      are missing.
775    o move from external_forcing_surf.F to ini_forcing.F
776      the p-coord. hack consisting in using pLoad to set phi0surf ;
777      update output of tutorial_global_oce_in_p (affected @ truncation level).
778    o Freshen up a bit hs94.1x64x5, notably:
779      remove rotationPeriod and tRef=5*0. (adjoint only), and add
780      exactConserv=.TRUE.
781    o pkg/generic_advdiff:
782      change option GAD_ALLOW_SOM_ADVECT to GAD_ALLOW_TS_SOM_ADV which only
783      applies to files where Temperature & Salinity 2nd Order moments are used.
784    o pkg/ptracers: add second-order moment advection schemes (80 and 81);
785      this uses a dynamically allocated internal state data structure
786      (#define PTRACERS_ALLOW_DYN_STATE in PTRACERS_OPTIONS.h)
787      and requires a fortran 90 compiler
788    
789    checkpoint59q
790    o pkg/mom_vecinv: Add energy & enstrophy conserving scheme (selectVortScheme=3)
791       (from Sadourny, described by Burridge & Haseler, ECMWF Rep.4, 1977)
792    o Refresh tutorial_global_oce_biogeo, notably:
793      - change bathymetry (put back seamounts in ACC, use hFacs)
794      - change EOS (POLY3 --> JMD95Z)
795      - use Bryan-Lewis vertical diffusivity
796      - use multidimensional advection
797      - remove old virtual virtual in dic pkg, now done through ptracer pkg
798      - change a couple of parameters in dic pkg
799    o pkg/ctrl: change formula in adctrl_bound.F and add a parameter to ctrl_map_ini_gen.F
800    o pkg/obcs: change default to OBCSfixTopo = .true.,
801      - set OBCSfixTopo=.false. in exp4/input/data.obcs to reproduce old result
802      - replace "debugMode" with "debugLevel .GE. debLevB"
803    o implementation of TAF directives for gchem,cfc,dic
804    o remove "exp5" (replaced by tutorial_deep_convection).
805    o pkg/obcs: add code to fix topography gradients normal to open boundaries;
806      this requires computing the index fields OB_Jn/Js/Ie/Iw in obcs_readparms;
807      the code can be turned on by setting OBCSfixTopo = .true. in data.obcs
808      --> changes results in exp4, seaice_obcs
809    o tutorial_deep_convection :
810      update the set-up and increase resolution and domain size ; start
811      from pseudo initial conditions = output at t=120mn in order to see
812      something happening when running testreport.
813    o pkg/seaice: add os7mp as an advection scheme
814                  add check for advection schemes
815                  add a flag for restoring T and S underneath sea ice
816    o pkg/my82: add netcdf-support and diagnostics
817    o thsice pkg:
818      - Now hsMax limits snow height by turning it into ice following
819        flooding scheme (and now conserving energy)
820      - Slight rewriting of the formula in thsice_calc_thick.F
821      - Parameter rhowi eliminated to be replaced by floodFac = (rhosw-rhoi)/rhos
822      --> changes results of global_ocean.cs32x15.icedyn and global_ocean.cs32x15.thsice
823    
824    checkpoint59p
825    o gchem / dic / cfc :
826      - add useDIC, useCFC , read from "data.gchem" (& hold in GCHEM.h);
827      - add new parameter files: "data.dic" & "data.cfc" ;
828      - various re-arrangement in initialisation & header file ;
829      - fix tutorial_global_oce_biogeo for multi-threaded test.
830    o pkg/dic: test for "pickup_dic" file when restarting ;
831      if no pickup-file, can restart with a re-initialised pH (same as it did
832      before) providing pickupStrictlyMatch is set to False.
833    o change argument list of S/R PTRACERS_WRITE_PICKUP & MYPACKAGE_WRITE_PICKUP
834      + fix call to S/R GGL90_WRITE_PICKUP & DIC_WRITE_PICKUP
835    o add a "warning" (to Error msg file) when an Active Tracer is not using AB-2
836      and staggerTimeStep is off (needed for stability of Internal-wave dynamics).
837    o move out of PARAMS.h & data the last pieces of old-ptracer code: tauTr1ClimRelax,
838     & lambdaTr1ClimRelax ; put those 2 params in PTRACERS_PARAMS.h & data.ptracers
839       (note: not clear to me what lambdaTr1ClimRelax is still used for ...)
840    o pkg/mom_vecinv: - new parameter "selectVortScheme" to select which
841       scheme to use for vorticty-term ;
842     - compute upwindVorticity=T case within mom_vi_u/v_coriolis_c4.F
843       (with default selectVortScheme, return to original discretisation)
844     - remove weird combination (e.g.: upwindVorticity & highOrderVorticity)
845    o pkg/seaice: add a line to the summary to indicate grid type (B/C)
846    o in mom_calc_visc, fix average value of viscAh_W & viscA4_W next to the
847      bottom ; only used with variable horizontal viscosity and non-hydrostatic.
848      also fix diagnostics VISCAHW & VISCA4W.
849    
850    checkpoint59o
851    o dome/code/obcs_calc.F: avoid division by zero (detected using gfortran).
852    o change the loop ordering in most gad_*_adv_x.F to improve vectorization:
853      move a few statemens out the main loop into separate loops
854    o pkg/shelfice:
855      - sort out freshwater flux; convert freshwater fluxes to mass fluxes
856        (kg/m^2/s), does not break tests, because in verification/isomip,
857        rhoConstFresh=rhoConst (by accident)
858      - rearrange computation of tLoc, sLoc, pLoc to make code more efficient
859      - move S/R find_rho_scalar, pkg/ecco/sw_ptmp.F, pkg/ecco/sw_adtg.F into
860        new file model/src/seawater.F, so that they are available for all pkgs.
861      - convert potential temperature into in-situ temperature. This changes the
862        isomip tests => update tests
863    o add a flag writePickupAtEnd (default=true) to be able to suppress
864      writing a pickup at the last timestep
865    o tools/mpack-1.6 :
866      - disable automake (not working) and autoconf (not needed).
867      - update to version 1.6.4 which fix MD5 code on some 64 bits platforms
868        also cleaner with much less compilation warnings.
869    o pkg/profiles:
870      rename profiles_interp_mean_genericgrid as profiles_interp_mean_gg
871      (for "less than 32 characters name" compiler requirement)
872    o pkg/obcs and pkg/exf: added capability to specify seaice open boundary
873      conditions that have a different sampling frequency than S/T/U/V obcs
874    o pkg/diagnostics (stats-diags):
875      - fix global Min/Max in case 1 processor get only empty tiles
876    o genmake2: replace (4 times)
877         make genmake_tc_1.o >> genmake_warnings 2>&1
878      with
879         COMM="$CC $CFLAGS -c genmake_tc_1.c"
880         echo $COMM >> genmake_warnings
881         $COMM >> genmake_warnings 2>&1
882      to make genmake2 always see the value of CC as specified in the optfile.
883    o generic_advdiff: - prather advection scheme (SOM) coded for CS-grid.
884      - add diagnostics for 1srt & 2nd Order moments and sub-grid variance.
885      - modify verification advect_cs test to test SOM-advection on CS-grid.
886    o pkg/ctrl:
887      - Rewrite of ctrl_map_ini_ecco.F,
888        introducing a generic routine (ctrl_map_ini_gen.F).
889      - Modification of ctrl_bound/adctrl_bound handling control vector bounds.
890    
891    checkpoint59n
892    o pkg/diagnostics: for large number of diagnostics, store diagnostic mate
893      number in dedicate array "hdiag":
894      - new version of S/R DIAGNOSTICS_ADD2LIST : DIAGNOSTICS_ADDTOLIST
895        with 1 more argument (mate number); modify old version DIAGNOSTICS_ADD2LIST.
896      - many small changes (integer format) for large number of diagnostics
897      - start to use DIAGNOSTICS_ADDTOLIST (necessary for diagnostics with
898        a counter mate) in pkg diagnostics, ptracers, thsice & aim_v23.
899    o add parameter rotateGrid and Euler angles EulerPhi/Theta/Psi. For
900      usingSphericalGrid, this allows to define the rotated grid coordinates
901      via phiMin/thetaMin/dxSpacing/dySpacing, etc., but then re-compute the
902      geographical coordinates according to the inverse of the rotation defined
903      by the Euler angles, so that Coriolis parameter and online-interpolation by
904      exf works with the geographical coordinates on XC/YC/XG/YG.
905      Naturally, this feature does not work with all packages, so some
906      combinations are prohibited in config_summary (flt, flt_zonal, ecco,
907      profiles), because there the coordinates are assumed to be regular
908      spherical grid coordinates.
909    o pkg/gmredi,ctrl,ecco,autodiff,grdchk and model/src,inc:
910      - introduce isopycnal diffusion coefficient control.
911    o tools/adjoint_options:
912      - additional control vector components.
913    o pkg/mnc: have mnc create marginally meaning full coordinate variables
914      (that is the grid indices) if usingCurvilinearGrid and NOT EXCH2
915    o pkg/mypackage:
916      - add example of read/write pickup for state-var ;
917      - add entry points to the main code for state-vars diags & write-pickup.
918    o pkg/exf: rewrite of exf_getffieldrec.F to properly deal with year
919      transitions for useExfYearlyFields
920      - add new subroutine that determines the file to read from for
921        use*YearlyFields = .TRUE. and .FALSE.
922      - add a verification experiment to global_with_exf that tests
923        useExfYearlyFields with USE_EXF_INTERPOLATION defined
924    o pkg/obcs/exf: add useOBCSYearlyFields (=.FALSE.) to obcs with exf in
925      analogy to useExfYearlyFields; rearrange obcs_prescribe_read: two new
926      subroutines (which could be generated from a template, because they are
927      almost identical), for now they are included in obcs_prescribe_read.F for
928      simplicity
929    o pkg/exf:
930      - add a little more diagnostic to exf_interp_read (in analogy to
931        mds_read_field, can be turned off with debugLevel < debugLevA=1)
932      - improve vectorizability of exf_interp for TARGET_NEC_SX, makes code
933        ugly but fast by unrolling short inner loops, inserting a unroll=8
934        directive in routine lagran, and splitting a loop and making do while the
935        outermost loop (the latter requires the intoduction of index arrays)
936    o pkg/obcs: replace obcs_apply_area/heff/hsalt/hsnow with obcs_apply_seaice
937    o pkg/seaice: moved DIFFERENT_MULTIPLE from seaice_model to seaice_dynsolver
938      http://forge.csail.mit.edu/pipermail/mitgcm-devel/2008-January/003173.html
939    o verification/seaice_obcs: updated for restart test and latest options
940    o pkg/seaice: add a new flag SEAICEuseTEM to use a slightly different
941      ice rheology (so-called truncated ellipse, that gets rid of tensile stress);
942      for now this is only available for the C-grid code and also within
943      #ifdef SEAICE_ALLOW_TEM, because this option may slow down the EVP code
944    
945    checkpoint59m
946    o pkg/seaice: use different time constant for melting (SEAICE_gamma_t)
947      and freezing (SEAICE_gamma_t_frz) ice due to mixed layer temperature
948    o gad_som : fix flux output (& diagnostics) to have same units as other  
949      advection scheme fluxes (was previously multiplied by deltaT).  
950    o added verification/seaice_obcs both to test seaice open boundaries
951      and to provide an example matlab scrpt for generating them
952    o added verification/lab_sea/input.salt_plume for testing pkg/salt_plume
953    o pkg/salt_plume: clean up salt_plume_frac.F to
954      remove redundancy in PlumeMethod 1 and 4
955    o pkg/kpp: added saltplume diagnostics
956    o pkg/obcs and pkg/seaice:
957      - do not set uice and vice to zero when OB*icefile are unspecified
958      - OBCS_SEAICE_AVOID_CONVERGENCE is undefined by default
959      - moved seaice tracer obcs after call to seaice_growth
960    o pkg/salt_plume: added various options for salt plume depth
961      criterion and for vertical distribution of the salt
962    
963    checkpoint59l
964    o pkg/ptracers: new version of ptracers pickup:
965      read meta file and write only fields which are needed to restart.
966      ( same logic as main pickup file ; also using pickupStrictlyMatch )
967    o pkg/seaice:
968      - add timescale for melting due to warm mixed layer as a means of
969        setting SEAICE_availHeatFrac more conveniently
970      - add a CPP-flag/runtime parameter check for flooding algorithm
971      - reformulated availHeat in seaice_growth.F to be independent of AREA
972    o change units attribute of EmPmR netcdf variables to kg/m^2/s to reflect recent
973      unit changes
974    o pkg/obcs: added OBCS_SEAICE_AVOID_CONVERGENCE constraint
975    o cg2d.F: add 3 compiler directives that speed up this routine by 30% on a NEC
976      SX vector computer.
977    o pkg/seaice:
978      - removed SEAICE_FFIELDS.h and seaice_get_forcing.F
979        seaice forcing fields can now be read only through pkg/exf
980      - removed some unused halos
981    o no longer write pickup from THE_MODEL_MAIN but always from FORWARD_STEP
982    o pkg/exf: added useRelativeWind EXF_PARAM.h option for subtracting U/VVEL
983      or U/VICE from U/VWIND before computing U/VSTRESS
984    
985    checkpoint59k
986    o pkg/seaice: ICE2WATR=SEAICE_rhoIce/rhoConst for consistency between
987      dynamics and thermodynamics. Set ICE2WATR=0.92 to reproduce older results.
988    o fix un-initialised variable problem (in mom_vecinv & shap_filt):
989      all experiments pass when compile with un-initialised var. checking option.
990    o added pkg/salt_plume
991    o script to test restart (for now, in MITgcm_contrib/jmc_script)
992    o pkg/seaice: new read/write pickup version.
993      read meta file and write only fields which are needed to restart.
994      ( same logic as main pickup file ; also using pickupStrictlyMatch )
995    o pkg/seaice: fix bug in seaice_ocean_stress (call of seaice_calc_strainrates)
996    o lab_sea.hb87: modify the domain & update output.hb87.txt :
997      lat-long grid & no-slip BC in seaice-dynamics produce different sigma12
998      at j=1 & j=Ny+1 : this case is not treated correctly in the restart
999      process. Fixed here by closing the domain at the Northern boundary.
1000    o pkg/rw: cleaning-up: call directly new MDSIO S/R MDS_READ/WRITE_FIELD.
1001    o pkg/mdsio: add new arguments to MDS_READ/WRITE_FIELD for reading/writing
1002      a set of consecutive levels in/from a 3-D array.
1003    o pkg/ptracers:
1004      use a 2 characters string ioLabel to identify tracer (if more than 99 tracers).
1005      to-do: fix pkg/diagnostics when large number of diagnostics are defined.
1006    
1007    checkpoint59j
1008    o in pkgs: dic, obcs, offline, rbcs:
1009      standard way to compute coeff. for time interpolation between 2 time reccords
1010      which retains full precision (& make results less dependent on compiler).
1011      update output of exp: tutorial_cfc_offline & tutorial_global_oce_biogeo.
1012    o pkg/cfc: if compiled with exf and seaice, cfc now can use fields from those
1013      packages instead of reading ice cover and wind speed separately
1014    o split PTRACERS.h in 2 header files: PTRACERS_FIELDS.h & PTRACERS_PARAMS.h
1015     (keep a temporary version of PTRACERS.h in verification/OpenAD/code_ad_openad
1016      to allow to compile customized code before the update)
1017    o cleaning-up:
1018      - fix CPP instruction syntax in pkg/obcs
1019      - replace (some) call to MDSIO S/R with call to RW interface S/R ; and
1020        add #ifdef ALLOW_MDSIO elsewhere (allows to compile without pkg/mdsio)
1021      - fix some threads issue in IO parts.
1022    o pkg/dic:
1023      - add tons of "_d 0" (--> much better testreports !)
1024       and then update outputs of tutorial_global_oce_biogeo
1025    o pkg/mom_fluxform:
1026      add a special version of momentum advection intended to conserve momentum
1027      next to a bathymetry step or a coastline edge. (default = off = #undef)
1028    o new read/write pickup version:
1029      - for now, only implemented for main (mdsio) pickup file.
1030      - write out only what is needed to restart; merge pickup_nh , pickup_ph
1031        and main pickup together.
1032      - read meta file; read only what is needed to restart; stop if a field
1033        is missing (if pickupStrictlyMatch=T, = the default) or try to restart
1034        if it make sense (even if the restart is not perfect).
1035      - if no meta file, assume that pickup to read corresponds exactly to
1036        a pickup that would currently be written.
1037      - read pickup written in the old format (until checkpoint59i) if it
1038        recognizes an old meta file (no field-list).
1039      - add a meta file in exp. which starts from a pickup: 2 cases:
1040        a) minimal meta file (with just file precision) + pickupStrictlyMatch=F
1041         e.g.: global_ocean.90x40x15/input/pickup.0000036000.meta
1042        b) a meta file describing the content of the associated pickup file
1043         e.g.: tutorial_global_oce_biogeo/input/pickup.0004248000.meta
1044    o pkg/mdsio & pkg/rw:
1045      - new routine to read a meta file ; new set of routine to read
1046        Multiple-fields file (with meta file).
1047    o added open boundary conditions capability for seaice
1048        HSNOW, HSALT, UICE, and VICE
1049    
1050    checkpoint59i
1051    o adjoint:
1052      * fix multiDimAdvection adjoint
1053        (partial recomputation problem by TAF for fVerT(:,:,kDown)
1054        and comlev1 size definition (maxpass vs. max. number of tracers)
1055      * verification/global_ocean.90x45x15 adjoint now tests
1056        NLFS and multiDimAdvection using DST3 (=30)
1057      * verification/lab_sea now tests multiDimAdvection using DST3 (=30)
1058    o pkg/kpp: add "_d 0" to real constant (if missing);
1059      update output of exp: natl_box (10.digits); vermix (std, 7.digits)
1060      and lab_sea, 3.FW (only 6,4,6 digits match) & AD (8.digits).
1061    o prepare for "clever pickup" implementation: add new header file "RESTART.h"
1062      for internal parameters related to restart process (formerly from PARAMS.h)
1063      and add startAB parameter to argument list of S/R ADAMS_BASHFORTH2.
1064    o more standard interface to {PKG}_WRITE_PICKUP with pickup suffix passed
1065      as argument. (only atm2d & obcs write_pickup have not yet been updated)
1066    o pkg/monitor:
1067      - use GLOBAL_SUM_TILE instead of _GLOBAL_SUM
1068      - fix mon_stats_rs (statistics over the full domain, even where field is zero)
1069      - account for deep Atmosphere factor and density factor (anelastic)
1070    o added open boundary conditions capability for seaice HEFF and AREA
1071    o pkg/shelfice: add option for convservative form of Hellmer&Olbers (1989)
1072      thermodynamics
1073      - requires a little reorganization, which affects the testreport results
1074        of isomip.htd (only 7 digits of cg2d agree) => update/modify experiment,
1075        so that now the conservative form is tested
1076      - add a few comments
1077    o add missing cvs Header: or Name: in eesupp/*, pkg/* & verification/code*
1078    o add a little bit of code to gad_os7mp_adv_?.F to help vectorization
1079    o add new diagnostics to seaice: advective, diffusive fluxes (only for
1080      multidim-advection, for scheme 2 they are not filled) and transports,
1081      thermodynamic growth rates
1082    o change units of EmPmR (inside the code, + within coupling interface)
1083      from m/s to kg/m2/s (mass flux) but leave input file unchanged.
1084      Affects results @ truncation level (cg2d match) and update output of
1085       experiments: lab_sea(6), global_ocean.90x40x15(10),
1086      global_ocean.cs32x15(11x3,10), natl_box(11), tutorial_global_oce_latlon(11)
1087      + adjoint results: global_ocean_ebm(11) and lab_sea (12).
1088      Coupled set-up: allow to restart from previous pickups (cpl_oldPickup=T).
1089      Next: will retire convertEmP2rUnit (simply using mass2rUnit instead).
1090    
1091    checkpoint59h
1092    o pkg/exf:
1093      - improve vectorization by moving if-statement out of loops in
1094        exf_mapfields, exf_radiation
1095      - exf_bulkformulae.F: introduce 2D fields and vectorize code
1096    o pkg/kpp: added the salt plume scheme (ALLOW_SALT_PLUME) to KPP package
1097    o testreport:
1098      - allow to test for Qnet & SeaIce monitor output; clean-up ALLOW_BULK_OFFLINE
1099        monitor & update offline_exf_seaice exp. output.
1100      - AD testing: pass/FAIL according to Grad. output accuracy (instead of Cost)
1101    o pkg/seaice:
1102      - bug fix in the evp solver: boundary conditions were affected be
1103        masking of zMax/zMin (changes results)
1104      - minor bug fix in boundary conditions in seaice_calc_strainrates
1105        (changes results for no_slip)
1106      - seaice_lsr.F: make interpolation of eta dependent on boundaries
1107      - replace hardcoded lower limit for zeta (zMin) by runtime parameter
1108      - add a test to lab_sea, that tests the Hibler and Bryan (1987) ocean
1109        stress formulation and no-slip boundary conditions
1110    o pkg/ptracers: Temporary fix for PTRACERS_useGMRedi & PTRACERS_useKPP
1111      in gad_calc_rhs.F ; add few safety stops in initialisation phase.
1112    o pkg/seaice: a first HSALT time stepping equation has been checked in
1113    o pkg/seaice: replaced maskW with seaiceMaskU and maskS with seaiceMaskV
1114      in seaice_lsr.F; this solves the pkg/seaice-pkg/obcs problem
1115      without requiring DO-IF statements
1116    o pkg/thsice:
1117      use continuous power-law function for partition of energy between lateral
1118      melting/freezing and thinning/thickening ; old code using step function
1119      still available with #undef THSICE_FRACEN_POWERLAW
1120      update output of exp: aim.5l_cs.thSI, global_ocean.cs32x15.icedyn & .thsice
1121    o testreport: change AD testing : check against results/output_adm.txt
1122      using same scripts as for forward test.
1123    
1124    checkpoint59g
1125    o adjoint testing: in preparation for changing testreport:
1126      - output format: cost and grad written on separated lines
1127      - ad output results in directory "results" (instead of "results_ad")
1128    o pkg/seaice: adding ice salinity HSALT as a prognostic variable
1129    o pkg/seaice: changes for using pkg/seaice with pkg/obcs
1130    o pkg/ecco: allow user defined cost function contributions
1131    o testreport:
1132      Allow to choose (per experiment) the list of tested output variables
1133       and the main variable (used to issue a pass/FAIL ) ;
1134      - for now, done by adding the specific list in file: [exp]/input/tr_checklist
1135      - default is unchanged: >cg2d< , (T,S,U,V,5 tracers)_[min,max,mean,StD] ;
1136      Also modify printing of summary:
1137       a) ">" NN "<" indicates the "main" variable (used for pass/FAIL)
1138       b) echo the list of tested variables in the individual summary.txt of
1139          each experiment.
1140    o new S/R GLOBAL_SUM_TILE to compute global sum independently of number of
1141      threads and number of processes (with #define GLOBAL_SUM_SEND_RECV)
1142      (but still depend on the tile decompostion of the domain).
1143    o pkg/seaice: change a discretization detail to make the B-grid code
1144      "more symmetric". This change is likely to remove all "ridges/leads" that
1145      where quasi-aligned with the grid in B-grid solutions. It may also be
1146      the solution to the stress coupling issues with the B-grid.
1147    o each tested exp: add a "run" directory with a standard ".cvsignore" file ;
1148      remove .cvsignore from input dir. (since testreport no longer run here).
1149    o pkg/thsice:
1150     - cleaning: move common block out of "THSICE_2DYN.h" (removed) to "THSICE_VARS.h"
1151     - fix reshaping of sea-ice just after advection:
1152       melt all the ice only if ice-volume is too small.
1153     - re-visit lateral/thinning repartition of melting (modifs from May 04, 2007):
1154       prevent lateral melting if sea-ice fraction is too close to iceMaskMin ;
1155     and update experiment global_ocean.cs32x15.icedyn (+start from pickup files).
1156    o external_forcing_surf : extend the use of salt_EvPrRn & temp_EvPrRn (fresh-water
1157      tracer content) to linFS or no RealFreshWaterFlux ; default remains unchanged.
1158    o define mass2rUnit & rUnit2mass as units conversion factor, used for surface
1159      forcing. mass2rUnit: from mass per unit area [kg/m2] to r-coordinate unit
1160      (z-coord: =1/rhoConst ; p-coord: =gravity) ; rUnit2mass is just the reverse;
1161      and remove horiVertRatio (& recip_horiVertRatio). Affects truncation error
1162      of exp. global_oce_in_p: 10 16 16 14 16 13 16 16 16 13 13 13 16 13 13 12 16
1163      -> update output.txt
1164    o pkg/cd_code: add brackets in multiple terms sum (S/R CD_CODE_SCHEME):
1165     this affects truncation error: -> update output.txt of exp:
1166      global_ocean.90x40x15 (fw&adm), lab_sea (fw&adm) & lab_sea.lsr,
1167      ideal_2D_oce, isomip.htd, natl_box, tutorial_global_oce_latlon.
1168    
1169    checkpoint59f
1170    o pkg/autodiff: zero_adj resets an ajoint variable to zero (in adjoint mode)
1171    o pkg/ctrl: ctrl_bound  forces parameter corrections to stay in
1172      a bounded range (in forward mode)
1173    o pkg/ecco, ctrl, autodiff and mom_common:
1174     internal parameter controls, completements of implementations
1175    o add few EXCH S/R (UV_BGRID, UV_DGRID, SM) for B & D-Grid velocity & 2nd Moment Sxy.
1176    o use UV_BGRID exch for dxV,dyU: for now, only with pkg/exch2 & forward ;
1177      (not seem any difference in testing results).
1178    o pkg/cd_code: use the right EXCH calls (for CS-grid); but problem remains
1179       at face corners.
1180    o pkg/generic_advdiff:
1181     - in GAD.h, define as parameters (iMinAdvR,iMaxAdvR,jMinAdvR,jMaxAdvR)
1182      loop range indices for computing vertical advection tendency
1183      and do the calculation in the interior only (no overlap) ;
1184      for now, only implemented for SOM advection (to save CPU time).
1185     - add argument "withSigns" to S/R FILL_CS_CORNER_TR_RL (needed for SOM_xy moment)
1186    o exch2 adjoint
1187      First set of changes:
1188      - add exch2 hand-written adjoint templates
1189      - exch2 hand-written no longer use TAF-flag 'nownew_arg'
1190        This will require cleanup in pkg/autodiff/*.F
1191        (changed routines currently kept separate in verif. code/)
1192      - Comment all relevant #ifndef ALLOW_AUTODIFF_TAMC
1193        that used to hide exch2 or cubed-sphere specific code
1194        (commented via 'cph-exch2')
1195    o pkg/seaice
1196      - Close southern and western boundaries for UICE/VICE when useOBCS=.TRUE.
1197    o pkg/bulk_force: fix loading into Qsw of Short-Wave flux; and update
1198       output of global_ocean.cs32x15.thsice .
1199    
1200    checkpoint59e
1201    o exch2: new S/R that only use the cube-tracer (center-position) exchange:
1202      for B-grid vector (not yet tested) and C-grid vector (<- only used
1203      when option W2_USE_R1_ONLY in W2_OPTIONS.h is defined).
1204    o starting implementation of Duffy et al. (GRL 1999) salt plume scheme
1205      (#ifdef ALLOW_SALT_PLUME)
1206    o gather_2d/scatter_2d: removed halo regions
1207    o gmredi: add option (GM_taper_scheme='fm07') for Ferrari & McWilliams 2007
1208      scheme and the corresponding test case (under front_relax dir). For now,
1209      only available with Skew-flux form and not yet tested in realistic set-up.
1210      adjoint: store directives updated, but gradient checks deteriorated,
1211      so maybe GM/Redi adjoint is now broken.
1212    o seaice adjoint
1213      * add AREA, HEFF, HSNOW as control variable
1214        (should not change lab_sea results)
1215      * CTRL_OPTIONS.h needs new flag: CTRL_SET_OLD_MAXCVARS_40
1216    o pkg/seaice:
1217      * added computation of saltFlux in seaice_growth;
1218        For time being, sea ice salinity is assumed constant
1219        contribution of snow flooding to freshening of sea ice is neglected.
1220        SEAICE_salinity is set in SEAICE_PARM01 of data.seaice and it
1221        defaults to 0.0 in order to maintain backward compatibility.
1222        Typical values for SEAICE_salinity are 4 to 10 g/kg.
1223      * replaced dRf(1) with dRf(kSurface)*hFacC(kSurface) in seaice_growth.F
1224      * added SEAICE_availHeatFrac, which specifies fraction of surface level
1225        heat content used to melt or grow ice
1226      * commented out cap of HICE: it helps keep ice thinner
1227      * reintroduced cap of HEFF via MAX_HEFF and SEAICE_CAP_HEFF option
1228      * applied OBCS T/S mask to HEFFM sea ice mask
1229    
1230    checkpoint59d
1231    o standard name: {PKG}_DIAGNOSTICS_STATE to fill diagnostics array
1232     for {PKG} state variables, and called from DO_STATEVARS_DIAGS.
1233     (keep {PKG}_DIAGNOSTICS_FILL for non-state variables diagnostics)
1234    o pkg/gmredi (gmredi_readparms.F): add some missing "_d 0"
1235     and change default value of parameter "GM_Small_Number";
1236     update output of exp: lab_sea (x2), cfc_example, global_ocean.90x40x15,
1237       global_ocean.cs32x15 (x4), global_ocean_ebm, global_with_exf,  
1238       tutorial_global_oce_biogeo, tutorial_global_oce_latlon
1239    o pkg/ecco: cost function when applying pkg/smooth to controls
1240    o pkg/ctrl: add forcingPrecond run time parameter
1241    o pkg/seaice:
1242     - replace ZMIN=4.e8 with ZMIN=0. in dynsolver.F as in C-grid code
1243     - fix bug in metric terms of u-equation in LSR solver (implicit part),
1244       changes verification/lab_sea
1245     - rearrange implicit part of u-equation in LSR solver to make it easier to
1246       read, understand, and debug. This causes changes at the truncation level.
1247     - fix (serious) bug in the boundary conditions (sign error in the implicit
1248       part) of the LSR solver. Changes all LSR results.
1249     - fixed problem with HSNOW initialization to avoid thick snow when AREA
1250       is initilized with small values - does not change lab_sea results.
1251     - added HsnowFile initialization capability
1252    o pkg/smooth: addition to model/src and pkg/ctrl so allow
1253     initialization of pkg/smooth and application to control vector
1254    o pkg/seaice: fix another bug in the LSR no-slip boundary conditons
1255    o dependencies: pkg/profiles requires pkg/cal
1256    o pkg/profiles:
1257     - added option ALLOW_PROFILES_GENERICGRID
1258         -> pkg/profiles can thus be used with any grid (e.g. cs32x15) assuming
1259         that interpolation information (grid points and coefficients) is provided
1260         within the netcdf input files.
1261         -> sample matlab scripts can be found in MITgcm_contrib/gael
1262         that allow you to prepare netcdf input files.
1263     - also modified: cleaner include statements, cleaner error print statements,
1264       cleaner stops when error, and more tests of the netcdf input files consistency.
1265    o additional test (in global_ocean.cs32x15) using seaice+thsice pkgs.
1266    o pkg/seaice:
1267     - move seaice-diagnostics from seaice_do_diags to do_statevars_diags; this
1268       requires a new routine: seaice_diagnostics_fill.F
1269     - make sure that seaice does not move if not forced (pressure replacement
1270       method, Hibler and Ip, 1995), changes results
1271     - and new damping criterion for EVP solver according to Hunke, JCP, 2001
1272     - SEAICE_evpDampC = > 0. turns it on (615. is the recommended value).
1273       It is turned off by default (=-1.), because it changes the results.
1274     - make it possible to read AREA from a file, too.
1275    
1276    checkpoint59c
1277    o add S/R and diagnostics for oceanic mixed-layer depth
1278    o move GMRedi call after all vertical mixing schemes (including KPP)
1279    o pkg/thsice:
1280     - ensure iceMask > iceMaskMin : this problem appeared after May-04 modifs
1281      (melt only laterally if thin ice): update output of global_ocean.cs32x15.thsice
1282    o pkg/obcs:
1283     - bug fix for balance code
1284    o pkg/seaice:
1285      - allow values of SEAICE_elasticParm > 1
1286      - add new parameter SEAICE_evpTauRelax as an alternative
1287        to SEAICE_elasticParm
1288      - make lsr boundary conditions free slip (by default), changes result
1289      - add code for no slip boundary conditions for lsr
1290      - set minimum of zeta to zero (and not 4e8) (changes results)
1291      - add a cap on AREA after advecting AREA if seaice_growth is not called
1292    o change calculation of Visbeck K:
1293      - no longer depend on tapering scheme; instead, compute slope (limited
1294        by GM_maxSlope). this is equivalent to what was comuted before with
1295        clipping or linear tappering.
1296      - fix vertical averaging (wrong by 1/2 level)
1297      - leave the old version (but will not be maintained) within
1298        #ifdef OLD_VISBECK_CALC / #endif
1299      - update output of exp. ideal_2D_oce
1300    o change error catch in calc_r_star to improve vectorization
1301    o exf runoff and seaice: remove ALLOW_SEAICE from exf pkg files and
1302      add #define ALLOW_RUNOFF in SEAICE_OPTIONS.h (when not using exf).
1303    o adjoint:
1304      Re-organized adjoint checkpointing according to Matt Mazloff
1305      (but with modifs/completions/cleanups)
1306      Storing is now bundled into large arrays to optimized I/O
1307      (and second step in cleanup of the_main_loop)
1308    
1309    checkpoint59b
1310    o coupler (pkg/atm_ocn_coupler, pkg/ocn_compon_interf, pkg/atm2d):
1311      - export/import (between ocean & coupler) fields needed for ocean DIC.
1312    o pkg/seaice:
1313      - get rid of three more exchanges seaice_calc_viscosities (required
1314        different loop boundaries in seaice_lsr and seaice_ocean_stress)
1315      - bug fix in seaice_ocean_stress (update of lab_sea required)
1316      - reduce loop boundaries to necessary minimum also in seaice_evp
1317      - go back to the old way of computing deltaC/Z as the adjoint likes that
1318        better
1319    o Refresh of tutorial_global_oce_latlon (includes changing salinity-like
1320      passive tracer to an Age Tracer) + update output.txt
1321    o pkg/exf:
1322      - implement A-grid / C-grid selection for wind-stress input files.
1323      - clean-up exf_wind.F (remove us, use wspeed instead ; add wStress)
1324      for now, in exf_bulk_largeyeager04.F only :
1325      - change implementation for case where windspeed + 2. components wind-stress
1326        are read-in. AND use rhoConstFresh to convert evap.
1327    o pkg/seaice:
1328      - use correct EXCH_UV for wind-forcing (on A-grid).
1329      - change SEAICE_OPTIONS.h to limit the number of option combinations (regarding
1330        SEAICE_EXTERNAL_FORCING & SEAICE_EXTERNAL_FLUXES); add corresponding stops.
1331    o pkg/exf:
1332      - default EXF options are now set in EXF_OPTIONS.h (ifndef ALLOW_AUTODIFF_TAMC)
1333      EXF_INTERPOLATION:
1334      - merge global_with_exf/code version of exf_interp_read.F
1335        to the main code ;
1336      - Add new option: EXF_INTERP_USE_DYNALLOC to use Dynamical Allocation when
1337        reading the file ; Important: This options needs to be defined to recover
1338        previous code.
1339        otherwise, use fixed size array to read in (size=exf_interp_bufferSize).
1340      - no longer loose real*8 precision along the way when using exf_iprec=64.
1341    o pkg/seaice: rearrangement of common blocks (really needs more cleaning up)
1342      - change discretisation of evp-solver in order to avoid another exchange
1343        (changes lab_sea) and clean up a little
1344      - replace SQRT(MAX(deltaC,SEAICE_EPS)) by MAX(SQRT(deltaC),SEAICE_EPS)
1345        help the adjoint (this also changes the results slightly)
1346      - add a few "_d 0" where they had been missing in seaice_evp.F
1347      - cleaning up: remove unused seaice_calc_rhs.F
1348    o pkg/exf: some cleaning-up:
1349      - change various "constants" into runtime parameters
1350      - cleaned-up Large&Yeager04 routine which should eventually
1351        replace exf_bulkformulae.F (changed names of S/R and CPP)
1352        and merged various ALLOW_ATM_WIND options
1353     only used with thsice pkg (in thsice_get_exf.F):
1354      - implement fixed turbulent transfert Coeff over ice (as in Large&Yeager04)
1355        which are used when useStabilityFct_overIce=TRUE (= the default)
1356      - change default values of ice & snow emissivity and scale downward LW
1357        by ice & snow emissivity.
1358    o pkg/thsice:
1359     fix few little problems, in thsice_calc_thickn.F:
1360      - growth vertically (and not laterally) if iceFrac == iceMaskMax
1361      - melt only laterally if hIce < hThinIce (as the comments say)
1362      and in thsice_extend.F:
1363      - allow to form ice even when iceFrac == iceMaskMax (by increasing thickness)
1364      - start to form ice as soon as the minimum ice-volume is reachable.
1365     update output of test-exp: aim.5l_cs(thSI), global_ocean.cs32x15(thsice),
1366      and cpl_aim+ocn
1367    o pkg/kpp
1368     - move computation of surface related input fields to KPP into a new
1369       subroutine kpp_forcing_surf.F
1370     - remove wrong (within bi,bj loops) EXCH calls.
1371     - little cleaning (add argument myThid in last position, cvs header ...)
1372     - for now, fix conservation problem by exchanging KPPviscAz (may not
1373       be the best fix)
1374    o pkg/seaice
1375     - check for inconsistent evp parameter/cpp-flag combination
1376     - remove leftover errIO flat for obsolete name list error handling
1377    o OpenAD
1378     - changed verification/OpenAD to full baroclinic setup (including GM/Redi)
1379    
1380    checkpoint59a
1381    o pkg/seaice: some parameter clarifications and a little bit of clean up
1382    o pkg/thsice: rename run-time parameters:
1383       himin       -> hIceMin
1384       himin0      -> hThinIce
1385       hihig       -> hThickIce
1386       i0          -> i0swFrac
1387       transCoef   -> bMeltCoef
1388       frac_energy -> fracMelting
1389      add new parameters: hNewIceMax, fracFreezing, dhSnowLin
1390       with default values (for now) that do not change the results.
1391      remove old version of thsice vars advection in pkg/seaice.
1392    o in FFIELDS.h:
1393      - replace #ifndef ALLOW_EXF  by #ifndef EXCLUDE_FFIELDS_LOAD
1394      - make pLoad & sIceLoad always available (but still only used if
1395         ATMOSPHERIC_LOADING is #define).
1396    o pkg/kpp: replaced _KPP_RL with _RL
1397    o bug fixes for vertical diffusivity computations when both KPP and
1398        3D diffusivity arrays are used; pkg/kpp/kpp_calc_diff_s & _t.F
1399        are no longer updating the vertical diffusivity array
1400        (passed as argument) but are (re-) setting those arrays.
1401    o pkg/seaice: fix bug in evp solver, while doing that
1402      - change (improve?) discretization of stress computations for both
1403        cgrid-lsr and evp solver
1404      - add a new routine to compute strain rates
1405      - the above changes lab_sea results
1406      - add no slip conditions for evp solver (off by default), lsr-version
1407        may follow
1408      - fix exchange for shear at Z-points (does not change lab_sea)
1409      - retire SEAICEuseEVP, instead turn on EVP by setting SEAICE_deltaTevp
1410        (to force the user to pick a time step since there is not "safe" way
1411        of choosing it)
1412      - add principal stress diagnostics
1413      - rearrange fields for evp a little to avoid having to call a: too many
1414        exchanges and b: exchanges for stress trensor components which we do
1415        not have.
1416      - modify Hibler+Bryan (1987) stress coupling so that it reuses information
1417        of evp, complete rewrite for lsr case (latter is does not yet work
1418        in all cases)
1419    o pkg/kpp: add code to have mixing in shelf ice caverns
1420      - add myThid to all kpp routines (long overdue)
1421    
1422    checkpoint59
1423    o pkg/exf:
1424      - fix wind-stress location: defined on A-grid (if ALLOW_ATM_WIND &
1425        ALLOW_BULKFORMULAE or USE_EXF_INTERPOLATION), otherwise, defined on C-grid
1426      - move exf header files from lower_case.h to UPPER_CASE.h ;
1427        add missing cvs Header & Name
1428      - add adjoint routines and flow dirs for newly used exch_uv_agrid routines
1429      - add namelist param. selectStressGridPosition, exf_monFreq
1430      - retire many _CLIM routines, and remove data.exf_clim
1431        + params moved to data.exf
1432        + climsst, climsss now handled by exf_set_gen, i.e.
1433          climss?period=0 refers to constant field,
1434          climss?period=-12 to monthly forcing
1435      - split up namelists in data.exf
1436    o pkg/seaice:
1437      - remove seaice_exch and seaice_exch_uv
1438      - remove superfluous exchange of theta
1439      - add myThid to seaice_budget_ocean/ice
1440      - add new interface for atmospheric wind forcing (C-grid only)
1441        + new routine
1442        + two new field (taux, tauy for stress over ice)
1443        + removed one global field (DAIRN) for C-grid case only
1444    o pkg/thsise
1445      - 2nd set of modifs for thsice adjoint in conjunction with exf
1446    o enable runtime flag useEXF (useCAL is set to .T. if useEXF=.T.)
1447    
1448    checkpoint58y_post
1449    o Added capability for latitudinal dependence of Bryan and Lewis, 1979
1450      vertical diffusivity, similar to that in MOM4; turned on using
1451      #define ALLOW_BL79_LAT_VARY in CPP_OPTIONS.h and specified using
1452      diffKrBL79*, diffKrBLEQ*, and BL79LatVary in runtime data file.
1453    o Added capability for 3D specification of background vertical diffusion
1454      coefficient.  This is done by (i) #define ALLOW_3D_DIFFKR
1455      in CPP_OPTIONS.h and (ii) specifying file diffKrFile in runtime
1456      "data" file that contains the 3D vertical diffusivity coefficients.
1457    o ice dynamics (pkg/seaice) with thsice thermodynamics:
1458      - add code within pkg thsice to advect & diffuse sea-ice fields
1459      similar to (and will replace) what has been added in  seaice_advdiff.F,
1460      but: - conserving Mass, Heat & Salt.
1461           - better when using non-linear advection scheme (not yet fully tested)
1462           - can also be used in atmospheric set-up (for now, only the diffusion).
1463    
1464    checkpoint58x_post
1465    o IO option for global-file compact format:
1466      - add options when generating topology (utils/exch2/matlab-topology-generator)
1467      - add I/O capability (pkg/mdsio).
1468      - adapt utils/matlab/rdmds.m to read this format.
1469      for now long-line format not yet supported by pkg/mdsio (& exch2).
1470    o shelfice: add a few diagnostics
1471    
1472    checkpoint58w_post
1473    o p-coord. non-hydrostatic using reference profile for w <-> omega conversion:
1474      rVel2wUnit & wUnit2rVel are computed from reference profile Tref,Sref
1475      (and replace horiVertRatio in NH code).
1476      Update output of exp.: tutorial_global_oce_in_p (useNHMTerms !)
1477                         and tutorial_plume_on_slope (sensitive to truncation)
1478    o seaice: if ALLOW_ATM_WIND is undefined use wind stress
1479      directly to drive seaice model (C-grid only)
1480    o exf: when input wind-stress (#undef ALLOW_ATM_WIND):
1481     - reintroduce computation of wind from stress,
1482     - compute tau (in exf_bulkformulae.F) from windstress averaged to
1483       mass points to avoid tau = 0
1484     - fix serious bug: (1/3) in Fortran is not the same as (1./3.)
1485    o rdmnc.m: make it work with "global" files created with gluemnc
1486    o rdmnc.m : some improvements in dealing with singleton dimension
1487      (tested on all testreport mnc output files).
1488    o genmake2: disable pkg/profiles if netcdf test fails.
1489    o cpl_aim+ocn exp.: use consistent rhoConstFresh in Atm & Ocn; update output.
1490    o move call to cal_readparms up to make calendar parameters/variable available
1491      to all packages
1492    
1493    checkpoint58v_post
1494    o change EOS (from POLY3 to JMD95P) in global_ocean.90x45x15 to get
1495      useDynP_inEos_Zc tested.
1496    o pkg/exf: changes to properly interpolate/mask/scale initial fields
1497    o utils/matlab/cs_grid/read_cs: routines to speed up reading of CS510 fields
1498      and portions thereof.  See read_cs.txt for description and examples.
1499    o utils/matlab/cs_grid/bk_line: to compute transport through passages,
1500      add a script (grt_circ_bkl.m) to generate broken-line between 2 points,
1501      following the great-circle arc between those 2 points.
1502    o trap un-initialized variable with pathscale compiler on weddell.mit.edu
1503      (thanks to Constantinos): fix few problems and get (almost) all exp to pass.
1504    o 2nd-Order Moment Advection Scheme (Prather, 1986): first check-in
1505     - enable by setting #define GAD_ALLOW_SOM_ADVECT (in GAD_OPTIONS.h)
1506     - used without limiter (AdvScheme=80) or with Prather limiter (AdvScheme=81)
1507     - still needs work (not working with some options ; efficiency to improve)
1508       and serious testing.
1509     - use this scheme for temperature & salinity in 2 advection test exp.:
1510       advect_xy & advect_xz, respectively.
1511    
1512    checkpoint58u_post
1513    o new test-exp: fizhi-cs-32x32x40 (40 levels) to replace the 10 levels.
1514    o move call to INI_FORCING from PACKAGES_INIT_VARIABLES to INITIALISE_VARIA.
1515    o testreport: add option "-skipdir" to skip some test.
1516    o exf: when input wind-stress (#undef ALLOW_ATM_WIND), by-pass turbulent
1517      momentum calculation.
1518    o gad_advection: fix vertAdvecScheme (if different from advectionScheme)
1519    o some cleaning: usePickupBeforeC35 no longer supported ; remove this option.
1520      remove checkpoint.F and the_correction_step.F (no longer used);
1521      do the k loop inside CYCLE_TRACER (supposed to be more efficient).
1522    o add option (linFSConserveTr) to correct for tracer source/sink due to
1523      Linear Free surface
1524    o pkg/seaice: fix a bug in the flooding algorithm: turn off the snow machine
1525    o pkg/thsice: fix reading mnc-pickups
1526    
1527    checkpoint58t_post
1528    o pkg/diagnostics: fix multi-threaded output (when singleCpuIO=F)
1529    o pkg/mdsio:
1530     - clean-up mdsio_readfield.F & mdsio_writefield_new.F and
1531       move to new files: mdsio_read_field.F (S/R MDS_READ_FIELD) &
1532       mdsio_write_field.F (S/R MDS_WRITE_FIELD);
1533     - fix multi-threaded singleCpuIO option in MDS_WRITE_FIELD
1534     - collect old S/R  in one file: mdsio_rw_field.F (now just a call to
1535       either MDS_READ_FIELD or MDS_WRITE_FIELD )
1536     - new S/R (to replace MDSWRITEMETA), which allows to write more
1537       informations (variable names, time ...) to meta files.
1538     - modify rdmds.m to give back the meta file content.
1539    o pkg/diagnostics: change vertical interpolation to be safer, and more
1540       flexible (define p-levels to interpolate to in data.diagnostics);
1541      add argument to S/R DIAGNOSTICS_GET_POINTERS to catch the right
1542       diagnostic pointer.
1543    o pkg/seaice: more cleaning up of seaice_growth, added many comments
1544    o pkg/exf: put runoff0 and runoff1 into the appropriate common block
1545    o fix multi-category seaice:
1546     - change cpp flag SEAICE_MULTILEVEL to more meaningful name:
1547       SEAICE_MULTICATEGORY
1548     - fix short wave heat flux
1549    o pkg/seaice: change default (SEAICE_OPTIONS.h): use C-grid dynamics
1550       and allow to use EVP solver. Change forward lab_sea: test both EVP
1551       solver and LSR solver, and use C-grid dynamics (like lab_sea adjoint)
1552    o Initial check-in of lab_sea adjoint
1553      (very similar to natl_box_adjoint/code_seaice)
1554      * used C-grid and EVP solver
1555      * used KPP, GM/Redi
1556      * uses inAdExact=.TRUE.
1557      * gradient checks fail for both ADM and TLM
1558        due to sensitive snow melt code in seaice_grwoth (look for "JZ")
1559        f.d. gradients actually seem more problematic than ADM, TLM gradients;
1560        issue is related to forward mismatch between g77 an ifort
1561    o pkg/seaice: overhaul of thermodynamics
1562     - growth.F and groatb.F are replaced by new routine seaice_growth.F
1563     - budget.F is replaced by two new routines seaice_budget_ocean/ice.F
1564     - move a few global fields out of SEAICE.h into seaice_growth.F and
1565       make them 2D (FICE/QNETO/ ...)
1566     - remove FO (it is the same as QNETO)
1567     - introduce a few local fields to avoid modifying external fields such
1568       as atemp, etc.
1569    
1570    checkpoint58s_post
1571    o pkg/exf: moved exf_init_runoff.F to exf_init.F and exf_set_gen.F
1572      changed exf_set_gen.F so that
1573        genperiod=0 means input file is one time-constant field and
1574        genperiod=-12 means input file contains 12 monthly means
1575    o CG2D: use pre-computed solver main-diagonal (stored in common block);
1576      this affects truncation error ; generate new output file for exp. which
1577      fails: exp4(12d), fizhi-cs-aqualev20(12d), front_relax(10d),
1578        global_ocean.90x40x15(10d), global_ocean.cs32x15(10d).thsice(11d).viscA4(10d),
1579        ideal_2D_oce(10d), internal_wave(09d), isomip.htd(11d), matrix_example(07d),
1580        MLAdjust(4x11d,12d), natl_box(11d), rotating_tank(12d),
1581        tutorial_global_oce_in_p(10d), tutorial_plume_on_slope(11d),
1582        vermix(12d).ggl90(12d).my82(11d).opps(12d).pp81(11d)
1583    o start implementation of deep-atmosphere and anelastic formulation
1584    o verification: remove 2nd copy of input files and use script "prepare_run"
1585      to make a symbolic link to the 1rst copy (reduce downloaded size by ~81.M)
1586    o mom_common/vecinv/fluxform: fix a few initialisation isssues
1587    o profiles: fix for multithreaded case
1588    
1589    o diagnostics: rename few diags:
1590      s/'PRESSURE'/'RCENTER '/g
1591      s/'TICE    '/'oceFreez'/g
1592      s/'TAUX    '/'oceTAUX '/g
1593      s/'TAUY    '/'oceTAUY '/g
1594      s/'SWFLUX  '/'oceQsw  '/g
1595      s/DIFx/DFxE/g
1596      s/DIFy/DFyE/g
1597      and add few ocean-forcing diagnostics:
1598      atmPload, sIceLoad, oceQnet, oceFWflx, oceSflux, surForcT & surForcS
1599    o modifications to pkg/seaice/growth.F and budget.F, which change results of
1600      lab_sea experiment: HSNOW was sometimes treated as effective and sometimes
1601      as actual snow thickness.  It now refers everywhere to effective snow
1602      thickness, meaning that for non-zero AREA, actual thickness is HEFF/AREA.
1603    
1604    checkpoint58r_post
1605    o modifications to pkg/seaice/growth.F, which change results of
1606      lab_sea experiment: fixes pertain to melting snow over open water, to
1607      masking EVAP under sea ice, and to using the correct AREA variable for
1608      computations of EVAP, PRECIP, HSNOW, and GHEFF
1609    o add ability to read bathy, salt, and theta using MNC (off by def)
1610    o add flooding algorithm and advection of HSNOW for pkg/seaice;
1611      both are turned off by default and do no change any results
1612    o seaice advection with pkg/thsice: a step toward the use of non-linear
1613      advection scheme, but #ifdef or commented out for now (requires more EXCH).
1614    o use standard version of PTRACERS_INI_VARIA in tutorial_tracer_adjsens
1615      (identical results) and the standard version of EXTERNAL_FIELDS_LOAD
1616      in natl_box (affects results @ truncation level: update output.txt)
1617    o multi-threading and IO:
1618      - replace some call to MDSIO S/R by the corresponding READ/WRITE_FLD S/R.
1619      - remove most of BEGIN_MASTER/ END_MASTER around READ/WRITE_FLD S/R calls
1620        (needed to work with SingleCpuIO): tested in all verif. exp.
1621    o GAD: use simpler DST3 formulation as default (old version left within #ifdef)
1622      affects the results (but none of the verification test uses this scheme).
1623    o Adding some pkg/diagnostics capability to pkg/seaice
1624      (will certainly be subject to changes)
1625    o ctrl: adding new control variables:
1626      lwflux, lwdown, evap, snowprecip, apressure, runoff
1627    
1628    checkpoint58q_post
1629    o added CPP_EEOPTIONS.h flag DISABLE_MPI_READY_TO_RECEIVE.  Speeds up
1630      1/6-deg Southern Ocean configuration by 8% on IBM Datastar and
1631      high_res_cube configuration by 4% on Columbia.
1632    o clean-up multi-threaded problems (reported by debugger tcheck on ACES);
1633      add (in global_with_exf/code) a version of EXF_INTERP_READ without
1634      dynamical allocation (seems to work in multi-threaded).
1635    o new function "MASTER_CPU_IO" (=T if master thread & master CPU, if using
1636      single CPU io) so that TAF does not have to see EESUPPORT.h
1637    o pkg/seaice: implement sea-ice loading (when using RealFreshWaterFlux)
1638    
1639    checkpoint58p_post
1640    o obcs: stop if obcs is used with useCDscheme = .true.
1641    o shelfice:
1642     - fix a sign error so that no slip at shelfice interface works
1643     - remove stop for combination non-hydrostatic code and shelfice. That does
1644       not mean, that the results are correct, but at least they are numerically
1645       stable
1646    o diagnoctics: modify UVELPHI and VVELPHI to include hfac (i.e. mass-weighted)
1647    o added adjoint exch routined for all exch*3d* routines
1648      and updated flow directives
1649    
1650    checkpoint58o_post
1651    o replace calls to EXCH_Z & EXCH_UV_AGRID: use the new _3D_ version ;
1652      remove old subroutines (_XY_ & _XYZ_); update the adjoint version.
1653    o change controling S/R for writing pickup file (new S/R do_write_pickup)
1654      and clean-up reading/writing of pickup files.
1655    o fix local version of read/write pickup (NH part) in rotating_tank/code
1656    o simplify EXCH interface:
1657     - change _XYZ_ interface to _3D_ subroutine (with 3rd dim in argument list)
1658     - not often used EXCH S/R (exch_z, exch_uv_agrid): keep only the _3D_ version
1659    o added the regrid package
1660    o shelfice:
1661     - add a simple boundary layer scheme to reduce noise
1662     - fix the indexing in shelfice_u/v_drag so that there will be actually drag
1663    
1664    checkpoint58n_post
1665    o fix globalArea multi-threaded calculation: need to apply GLOBAL_SUM to
1666       local variable (not in common block).
1667    o lot of small changes for multi-threaded. Most tests (using OMP & ifort) pass.
1668      - still problems with pkgs: mnc, exp2, dic, cal, exf (and probably more);
1669      - still BEGIN_MASTER/END_MASTER to remove around READ/WRITE_FLD S/R calls
1670        to work with SingleCpuIO.
1671    o add "_d 0" to real constant of pkg/cfc subroutines ;
1672       update exp. cfc_exemple & tutorial_cfc_offline output files.
1673    o multi-threading and IO:
1674      - all threads call READ_FLD S/R (needed if using SingleCpuIO):
1675        (no BEGIN_MASTER/ END_MASTER around the call, but inside MDSIO S/R.
1676      - barrier before and after reading.
1677      - stop if other than master is calling MDS_WRITELOCAL (if #undef IO_THREAD_SAFE)
1678      - avoid using MDS_WRITELOCAL for LAND pkg output.
1679      - new S/R AIM_WRITE_PHYS (replaces AIM_WRITE_LOCAL) to write AIM physics
1680        common-block variables ; Allows multi-threading with master-thread IO.
1681    o change default MAX_NO_THREADS from 32 to 4 ;
1682      and stop cleanly when MAX_NO_THREADS is too small.
1683    o add S/R BAR_CHECK to check multi-threaded barrier synchronization
1684    
1685    checkpoint58m_post
1686    o add a Non-Hydroatatic test (with 3-D Coriolis, NHMTerms, biharmonic Visc.
1687       and side-drag) on CS-grid : global_ocean.cs32x15.viscA4
1688    o make "tutorial_global_oce_latlon" from standard "global_ocean.90x40x15" exp.
1689       keep global_ocean.90x40x15 (for AD testing) with former secondary test
1690       (".qshyd") as the main test (mv output.qshyd.txt to output.txt)
1691    o CVS modules: update MITgcm_verif_basic; remove MITgcm_verif_ocean & _verif_atmos;
1692        add MITgcm_tutorials (= code + all the tutorials)
1693    o ecco, option to compute cost for total ssh (mean+anom)
1694    o consistent with addition of ptracer and ssh in pkg/profiles
1695    o profiles: adding ptracer and ssh
1696    o testreport: change multi-test output-file name
1697      (from output.txt.{name} to output.{name}.txt)
1698    o profiles: now ok for mutli-tiles case
1699    o seaice: add 4 parameters for different advection schemes for area,
1700      (effective) seaice thickness, enthalphy, and snow height. Their default
1701      is the standard parameter SEAICEadvScheme
1702    o calc_gw:
1703     - add cosFacU in zonal viscous flux (harmonic.visc.).
1704     - put back side-drag (call new S/R MOM_W_SIDEDRAG) and output.txt.
1705       of tutorial_plume_on_slope.
1706    o obcs_calc.F : fix index Pb in OBSeta & OBNeta (Thanks to Gianmaria).
1707    o calc_gw: true flux-form, account for horizontal grid spacing.
1708      update rotating_tank results, but not plume_on_slope (affected at
1709      truncation level, 11 digits).
1710    
1711    checkpoint58l_post
1712    o calc_gw:
1713     - take bi,bj loops outside calc_gw to fix Pb with local array KappaRU,V
1714     - remove side-drag for now (need to fix it); update plume_on_slope results.
1715     - fix for partial-cell & non-uniform dz; update plume_on_slope results.
1716    o commit code to make SST/SSS weights spatially variable
1717      (based on either variable in-situ or variable initial T/S weights)
1718    o pkg/ecco:
1719      * commit code to relax deviations of xx_theta, xx_salt to 5*sigma,
1720        now based on horizontally varying weights wthetaLev, wsaltLev
1721      * cost_averagesflags now returns year indices in addition to day, month
1722      * sflux balance is performed on annual basis
1723        (sflxumm, sfluxmm2, bal_sfluxmm)
1724      * for SSH anomaly, separate more cleanly contrib from T/P, ERS, GFO,
1725        including separate counting and multipliers
1726    o pkg/rbcs
1727      * add all necessary infrastructure for pkg/rbcs levN adjoint checkpointing
1728    
1729    checkpoint58k_post
1730    o testreport:
1731     - always build in dir. "build" (if not there, mkdir build instead of building
1732       & running in input)
1733     - run in dir run (if it exists), in build otherwise.
1734     - call prepare_run (if input/prepare_run exists)
1735     - run multi-threaded test (with new option: "-mth") if file input/eedata.mth exists.
1736    o pkg/exf modifications to interpolation and rotation routines for more
1737       reasonable treatment of North Pole singularity: for tracers North Pole
1738       value is set to northernmost zonal-mean value, for zonal velocity it is
1739       set to zero, and for meridional velocity it is set to northernmost value.
1740    o pkg/exf/exf_check_range.F
1741     - add tile index to diagnostics and move stop statement to the very
1742       end of the routine.
1743    o pkg/diagnostics: (diagnostics_main_init.F)
1744      define title of isomorphic variables according to the current config.
1745    o pkg/thsice with pkg/seaice dynamics:
1746    - fix domain of computation (interior only, required for exf) and do exchanges
1747    - seaice-dynamics forcing: add atmospheric and seaice loading to SSH gradient
1748    o towards a standard way of dealing with multi-threading in MONITOR
1749      and ${PKG}_MONITOR (all except ptracers_monitor) subroutines.
1750    o Pass variable viscosities (vertical and horizontal, e.g., KPP or Leith)
1751       to W momentum equation in nonhydrostatic and quasihydrostatic runs.  
1752    o make exf_monitor & seaice_monitor independant of the main (dynamics) monitor.
1753    o pkg/seaice: fix SEAICEuseEVPpickup parameter (put it in a commom block)
1754    o generic_advdiff: DST advection S/R : use local copy of velocity to compute CFL
1755       (problems ? with gradient check in bottom_ctrl_5x5 adjoint test)
1756    o tracer advection:
1757     - clean-up and simplify calc_common_factors.F
1758     - make a local copy of velocity and pass it (as u,v,r_Trans) to DST tracer
1759       advection subroutine (but still not used within DST advection S/R)
1760    o rename pkg aim_ocn_coupler to atm_ocn_coupler (later on, will be used without aim)
1761    
1762    checkpoint58j_post
1763    o new driver S/R: LOAD_FIELDS_DRIVER to load external forcing fields
1764      from file (collects calls previously in FORWARD_STEP)
1765    o move call to SEAICE_MODEL from FORWARD_STEP to DO_OCEANIC_PHYS
1766    o adjoint store dir. adjusted accordingly
1767    o genmake2
1768      replace target "ad_taf" by $(EXE_AD) ; add $(EXE_AD) to the make CLEAN list.
1769    
1770    checkpoint58i_post
1771    o pkg/seaice: add parameter that allows to scale/turn off effect of seaice
1772      on wind stress (SEAICEstressFactor defaults to 1.)
1773    o Total number of Timers is finite (<=40): comment out 2 non-essential one
1774      in the_main_loop.F to avoid Pb (e.g., when running fizhi test)
1775    o vector_invariant: fix highOrderVorticity(=4.th.Order) advection
1776      on CS-grid: no longer loosing mass.
1777    o exf & curvilinear-grid: no longer modify longitude xC & xG.
1778    o pkg/ggl90: fix sloppy output and fix a bug
1779    o pkg/seaice: added SEAICEuseEVPpickup parameter
1780      - Set to false in order to start EVP solver with
1781        non-EVP pickup files when using SEAICEuseEVP
1782      - fix sign error in diffusion in seaice_calc_rhs
1783    
1784    checkpoint58h_post
1785    * Modifications for bottom topography control
1786      o replace hFacC by _hFacC at various places
1787      o replace ALLOW_HFACC_CONTROL by ALLOW_DEPTH_CONTROL
1788      o add non-self-adjoint cg2d_nsa
1789      o update autodiff support routines
1790      o re-initialise hfac after ctrl_depth_ini
1791      o works for 5x5 box, doesnt work for global_ocean.90x40x15
1792    * Adding verification for 5x5 box (4-layer) bottom topography control
1793    
1794    checkpoint58g_post
1795    o pkg/diagnostics: implement "periodic averaging diagnostics" (e.g.,
1796       used for mean seasonal cycle, mean diurnal cycle); add an example
1797       in verification/global_ocean.cs32x15/input.thsice/data.diagnostics
1798    o pkg/ggl90:
1799      - add parameter (minimum surface kinetic energy)
1800      - fix bug (avoiding division by zero)
1801    o couple pkg/thsice to pkg/seaice:
1802      - modify advection in seaice to accomodate new scalar fields to be advected
1803      - only muliDimAdection scheme work with seaice/thsice
1804      - mapping of thsice-variables to seaice-variables, back and forth
1805      - does not break the verification experiments, but does not give the
1806        desired results either
1807    o pkg/seaice
1808      - make (default) second order advection a bit less confusing?
1809    
1810    checkpoint58f_post
1811    o couple pkg/thsice and pkg/exf (as a preparation for coupling pkg/thsice
1812      to pkg/seaice):
1813      - new routines thsice_map_exf and thsice_get_exf provide the interface
1814      - add an additional formal parameter to thsice_solve4temp
1815    o pkg/exf:
1816      - add new fields wspeed, snowprecip (to be able to couple to thsice)
1817      - correct Stefan-Boltzmann constant
1818      - new parameter for longwave surface emittance
1819      - separate some stuff from exf_bulkformulae into new routines  
1820        exf_radiation, exf_wind
1821      - add new parameters and constants: longwave emissivity for ocean, ice
1822        and snow, evaporation parameters over ice
1823      - decouple wind/stress computation from ALLOW_BULKFORMULA: always compute
1824        either wind from stress or stress from wind
1825    o pkg/thSIce:
1826    - split thsice_step_fwd.F in 2 S/R: thsice_step_temp.F & thsice_step_fwd.F
1827    - put i,j loops inside S/R: THSICE_ALBEDO, THSICE_SOLVE4TEMP, THSICE_EXTEND
1828       and THSICE_CALC_THICKN
1829    - for now, call to THSICE_GET_BULKF remains inside i,j loops.
1830    - add CPP option: ALLOW_DBUG_THSICE and header file THSICE_DEBUG.h
1831      to make debugging easier.
1832    - affects results (@ truncation level) of global_ocean.cs32x15.thsice: update output
1833    o pkg/bulk_force:
1834      - clean-up comments and parameters ;
1835      - add new Bulk-Formulae from Large and Yeager, 2004, NCAR/TN-460+STR ;
1836    o fix bug in aim+thsice albedo: snow & ice thickness arguments were switched;
1837      generate new output for test-experiment: aim.5l_cs.thSI
1838    o results_ad : rename "output.txt_adm" to "output_adm.txt" and change
1839      testreport accordingly
1840    
1841    checkpoint58e_post
1842    o SEAICE_CGRID adjoint done
1843    o R_STAR adjoint implemented.
1844      * Seems to just work (based on global_ocean.90x40x15/code_ad_nlfs/ )
1845      * need to sort out init. of h0facc, etc.
1846    o Make pkg/profile fully independent of ecco,cost, etc. stuff
1847      to be able to use it in pure forward.
1848    
1849    checkpoint58d_post
1850    o upgrade simple test-experiment to tutorial example:
1851     step.1: duplicate the experiment and (step.2) will remove the old copy.
1852      tutorial_barotropic_gyre      <- copy of exp0     (R1:barotropic_gyre_in_a_box)
1853      tutorial_baroclinic_gyre      <- copy of exp1     (R1:baroclinic_gyre_on_a_sphere)
1854      tutorial_global_oce_latlon    <- empty for now    (R1:global_ocean_circulation)
1855      tutorial_global_oce_biogeo    <- copy of dic_example
1856      tutorial_deep_convection      <- almost like exp5 (R1:nonhydrostatic_deep_convection)
1857      tutorial_plume_on_slope       <- copy of plume_on_slope
1858      tutorial_tracer_adjsens       <- copy of carbon   (R1:tracer_adjoint_sensitivity)
1859      tutorial_global_oce_optim     <- empty for now (David ?)
1860      tutorial_global_oce_in_p      <- copy of global_ocean_pressure
1861     some tutorials (R1) were already checked-in under tutorial_examples in release1_branch
1862    o correct a sign problem in cost_scat.F
1863    o obcs and ptracers: fix boundary conditions for advections schemes
1864      with larger stencil
1865    o thsice adjoint: start
1866    o mom_vecinv: add ISOTROPIC_COS_SCALING flags to mom_vi_hdissip for
1867      completeness
1868    o mom_fluxform: fixing the mutual use of ISOTROPIC_COS_SCALING
1869      and COSINEMETH_III, add comments in default CPP_OPTIONS.h
1870    o ptracers adjoint:
1871      * avoid extensive recomputatations
1872      * fix missing re-init. of gptr (missed by TAF)
1873    o obcs: add a flag (OBCSprintDiags, defaults is true) that allows
1874      me to turn off the excessive output to STDOUT that this package produces
1875    o move NH metric terms & 3.D Coriolis S/R to pkg/mom_common
1876      and add those terms in Vector-Invariant formulation.
1877    o in ctrl pkg, if ALLOW_CAL, use monthly mean controls
1878      if the control period (xx_hfluxperiod etc) is 0
1879    o in profiles pkg, clean routines and fix details
1880    o in ecco pkg, reading ssh data:
1881      fix problem in case the model does not start at iter0=0
1882    o fix mnc-pickup/restart for ptracers
1883    o new package prifiles:
1884      code to compute profile-based cost by Gael Forget
1885      (modifs in ecco, ctrl, autodiff)
1886    o Benign bug fix in initialization (spotted by M. Mazloff) of
1887      ctrl_set_globfld_xz.F ctrl_set_globfld_yz.F
1888    
1889    checkpoint58c_post
1890    o adjoint: finish NLFS adjoint and provide reference output in
1891      verification/global_ocean.90x40x15/results_ad_nlfs
1892    o seaice: add an EVP solver following Hunke and Dukowicz (1997) and the
1893      documentation of CICE. Turn on by defining SEAICE_ALLOW_EVP in
1894      SEAICE_OPTIONS.h and SEAICEuseEVP=.true. in data.seaice. Works only
1895      with SEAICE_CGRID defined.
1896    o move calendarDumps from "data" to "data.cal" and clean-up the code
1897      with a simple call to pkg/cal S/R: CAL_TIME2WRITE
1898    o add useEXF & useCAL flags (for now, set in hard-coded way)
1899    o add S/R to compute NH-metrics terms & Coriolis f' in vertical momentum
1900      (were missing in NH mode, and wrong in quasihydrostatic mode).
1901      waiting for Chris updated version of calc_gw to add those CALLs.
1902    o fix bug in quasihydrostatic S/R ;
1903      add a test for this option: global_ocean.90x40x15.qshyd
1904    o new S/R "SET_PARMS": set parameters that might depend on the use of some pkgs.
1905      (called from INITIALISE_FIXED, after INI_PARMS & PACKAGES_READPARAMS)
1906    o add on/off flag useOffLine for package OFFLINE
1907    o seaice:
1908      - modify advection so that it works also on the C-grid
1909      - extend loop ranges in seaice_lsr and seaice_dynsolver; fixes
1910        problem in multi-tile runs with C-grid
1911      - add flags for clipping ice velocities and/or masking solver forcing
1912      - fix drag (ocean on ice) formulation and a bug that caused noise in the
1913        C-grid solver
1914      - added a few comments to seaice_diffusion.F
1915      - separate C-grid and B-grid versions more cleanly (UVM and seaiceMaskU/V
1916        are now exclusive)
1917      - add a new ocean-ice stress coupling method (Hibler and Bryan, 1987) which
1918        required re-ordering the code a little:
1919       + make DAIRN global variable (defined in SEAICE)
1920       + move computation of the viscosities eta and zeta into a new separate
1921         routine (because I need to recompute them in seaice_ocean_stress.F)
1922    
1923    checkpoint58b_post
1924    o AIM+thSIce: fix sign of Short-Wave through the Ice ;
1925      update output.txt of exp. aim.5l_cs.thSI
1926    o various mnc cleanups and improvements:
1927      + shrink lookup tables by factor of ~4
1928      + better error reporting when running out of lookup space
1929      + able to handle longer path/file names (up to 500 chars)
1930    o adjoint:
1931      - Another overhaul of store dirs. for NLFS to eliminate  "hidden" recomputations.
1932      - TBD: "hidden" mom_vecinv recomp. in dynamics
1933    o change forcing_In_AB to affects both T,S forcing and Momentum forcing
1934     (allow to differentiate between forcing components using new integer flags:
1935      momForcingOutAB=1/0 & tracForcingOutAB=1/0)
1936     and add new flag to put Dissipation tendency out of Adams-Bashforth.
1937    o ecco
1938      - enable trend removal from SSH anomaly obs.
1939    o adjoint
1940      - a fix for PmEpR when #undef EXACT_CONSERV
1941      - fix of "hidden" recomp. in thermodynamics (no TAF warnings)
1942      - try to fix "hidden" recomp. in forward_step for NLFS
1943        (NLFS seems broken sometimes after I checked it in)
1944    o seaice:
1945     - add c-grid version of the dynamic solver:
1946       + three new routines that are the c-grid substitute lsr, dynsolver
1947         and ostres
1948       + put a few fields that were local to dynsolver into global common
1949         blocks, so that I can move the computation of stresses etc into
1950         seaice_lsr (saves coding but may break the adjoint).
1951     - replace more hardwired parameters by runtime parameters
1952     - add ice masks that mask the rhs of the implicit solvers where there
1953       is no ice (commented out in seaice_dynsolver, because i am not sure
1954       if this works properly), eventually this should replace the clipping
1955       of ice velocities in seaice_dynsolver to +/-40cm/s.
1956    o remove the BUILD_INFO.h include from CPP_EEOPTIONS.h and explicitly
1957      include it only where its needed
1958    o move balancing of fluxes before the call of external_forcing_surf
1959    o seaice:
1960      - correct units of turning angles (now they are really in degrees)
1961      - move computation of GWATX/Y out of main routine into dynsolver
1962      - initialize GWATX/Y in seaice_init
1963    o Apply mask on Fresh-Water flux (needed for SSH forcing).
1964      update output.txt of exp. global_ocean_ebm & cpl_aim+ocn (affects cg2d residual)
1965    o seaice: add runtime flags for turning angles (default to zero)
1966    o Adding runtime parameter to exf/, ctrl/, to remove on-the-fly global mean
1967      and trend from exf forcing and ctrl control adjustments
1968    o fix variable aliasing in gad_calc_rhs that cannot be handled by TAF
1969      (since checkpoint57x_post)
1970    o change the default rotation period to 86164.s = the Earth rotation
1971    o 1rst implementation of Implicit IGW using the 3-D solver (use3Dsolver=T)
1972      and based on a reference stratification. Tested within hs94.cs-32x32x5.
1973    o seaice advection: add code for choosing between the default (2nd order
1974      central differences) and multiDim advection schemes provided by
1975      pkg/generic_advdiff
1976    o seaice:
1977      - removed all references to SEAICE_GRID.h fields from
1978        dynsolver, advect, diffus, lsr, without changing the results of lab_sea
1979        (cubed-sphere configuration will change a little)
1980      - grid computations in seaice_init are obsolete now.
1981      - cleaned up code a little so that is easier to read (hopefully).
1982      - added new (better?) discretizations of default advection and diffusion
1983        (turn on with SEAICEuseFluxForm)
1984      - replace 1 in 3d global fields by kSurface in growth.F
1985      
1986    checkpoint58a_post
1987    o seaice:
1988      - bug fix in advect.F
1989    o shelfice:
1990      - separate shelfice load anomaly from pload (breaks with time
1991        dependent forcing), => introduce constant field shelficeLoadAnomaly.
1992        Its default is 0., but it may be computed more cleverly from (unknown)
1993        t- and s-profiles (tRef, sRef) and actual EOS. For now this has to be
1994        done offline. A good approximation of the pressure load anomaly is
1995        necessary to avoid large initial adjustment processes underneath
1996        deep-reaching shelfice.
1997      - small fix in ISOMIP shelfice_thermodynamics
1998      - add more sophisticated thermodynamics of Hellmer (1989), this is
1999        now the default
2000      - give a few constants more intuitive names
2001    o add code to balance EmPmP and Qnet at the end of do_ocean_physics. Useful
2002      if bulk formulae are used in long integration (especially EmPmR). Turn
2003      on with balanceEmPmR = .true. or balanceQnet = .true. in data, PARM01
2004      if balancePrintMean, the imbalance that is substracted is printed to
2005      STDOUT.
2006    o fix bug (typo) in obcs_apply_eta.F
2007    o add a new package shelfice which enables us to model the circulation
2008      underneath shelf-ice with draughts of hundreds of meters.
2009     - works
2010     - to do: + include improved thermodynamics
2011              + check whether kSurfC (from model/inc/SURFACE.h) can be used
2012                instead of new field kTopC
2013              + can we use topoFile, Ro_surf and existing code in ini_depth.F
2014                instead of new field R_shelfIce and new code in ini_depth.F
2015                and ini_mask_etc.F?
2016              + adjust vertical mixing schemes?
2017    o seaice pkg:
2018     - add a cpp-flag to include a simple formula for a salinity dependent
2019       freezing point of sea water at the surface
2020     - change the contents of SEAICE_TEST_ICE_STRESS_1 so that zonal and
2021       meridional stresses are now different (and hopefully correct)
2022    o AIM pkg: change threshold on large-scale condensation to conserve Heat.
2023       update results of aim.5l_LatLon test ; fix title & units of AIM diagnostics
2024       and  change 3 diagnostics names (OSR,OSRCLR,KM -> TSR,TSRCLR,DRAG)
2025    o pkg/diagnostics: add options and parameters for regional-statistics
2026       diagnostics ; define regions by reading a region-mask from a file
2027       (might add other options later)
2028    o pkg/bulk_force:
2029     - add option and parameters to use AIM surface-flux formulae.
2030     - Change loading part: S/R BULKF_FIELDS_LOAD only take care of bulkf_fields ;
2031       others forcing fields (defined in PARM05, parameter file "data") are loaded
2032       from S/R EXTERNAL_FIELDS_LOAD, as usually (with useBulkforce = T or F).
2033     - initialise all bulkf_fields in bulkf_init.F ; do in-lining of exf_bulkcdn.F
2034     - use the right EXCH call for uwind,vwind (to work on CS-grid).
2035     - re-arrange header files (move parameters from BULKF.h to BULKF_PARAMS.h)
2036       and parameters (note: calcWindStress replaces .NOT.readwindstress).
2037     - cleaner interface with pkg/thSIce (new S/R THSICE_GET_PRECIP).
2038    
2039    checkpoint58
2040    o add "--embed-source" option to genmake2 which, when the supporting
2041      tools can be compiled (as determined by genmake2) will turn on the
2042      embed_files package which then embeds the entire MITgcm source code
2043      (*.[fFhc] + Makefile) used for the build within the executable
2044      - requested by CNH but off by default
2045      - adds a paltry <9MB to the mitgcmuv executable in most cases
2046      - only writes the output when useEMBEDSRC in eedata is true
2047    o clean up 3-dim. relaxation codes:
2048      * Fix I/O inconsistency in pkg/rbcs: replace precFloat32 by readBinaryPrec
2049      * Remove 3-dim. relaxation code from pkg/exf (now use only pkg/rbcs)
2050      * Thanks to Tom Haine for testing!
2051    
2052    checkpoint57z_post
2053    o make CG3D solver compatible with Free-surface at k > 1 (p-coordinate):
2054      affects output (@ truncation level) of exp. plume_on_slope ; updated.
2055    o fix the pickup behavior for obcs in combination with ptracers
2056    o fix a bug in ptracers_external_fields_load
2057    o no AB-2 at the first iteration for Gw (consistent with Gu,Gv,Gt,Gs ...)
2058      affects results of NH experiments (but all our NH tests have Gw[it=1]==0 !!)
2059    o transfered surface NH pressure to eta field (if exactConserv).
2060    o gmredi: fix bugs in slope tapering ldd97 (depthZ had the wrong sign)
2061         and update lab_sea output.txt file.
2062    o completing 3-dim. relaxation code: additional term
2063         1/tau*( theta(i,j,k) - thetaStar(i,j,k) )
2064      in S/R EXTERNAL_FORCING_T (file external_forcing.F)
2065      * At compile time, in "EXF_OPTIONS.h" set
2066          #define  ALLOW_CLIMTEMP_RELAXATION
2067          #define  ALLOW_CLIMSALT_RELAXATION
2068      * At runtime in "data", under &PARM03 set (e.g., units in seconds)
2069          tauThetaClimRelax3Dim = 15552000.0,
2070          tauSaltClimRelax3Dim  = 15552000.0,
2071      * 3 cases:
2072          1) Use a constant-in-time 3-dim. field
2073          2) Provide 12 3-dim. fields corresponding to Jan., ... , Dec.
2074          3) Real-time relax. to time-evolving prescribed field
2075    o Adding Laplacian-type smoothness constraint on
2076      initial and boundary (forcing) controls (ic, bc)
2077      * enable at compile-time via
2078        ALLOW_SMOOTH_IC_COST_CONTRIBUTION, ALLOW_SMOOTH_BC_COST_CONTRIBUTION
2079      * enable at run-time via mult_smooth_ic = 1, mult_smooth_bc = 1
2080      * Absolute scale somewhat unclear so far
2081      * no area weighting was included since no other cost term does so far
2082    
2083    checkpoint57y_post
2084    First step for a NLFS adjoint
2085    o initially suppress rStar (new flag DISABLE_RSTAR_CODE)
2086    o new init. routines for calc_r_star, calc_surf_dr
2087    o still need to deal with ini_masks_etc
2088    o testreport seemed happy
2089    checkpoint57y_pre
2090    
2091    o obcs: always reset wVel & eta (to zero or prescribe it) at the OBs.
2092    o add new package rbcs (for relaxing ptracers at boundaries/depth/surface etc)
2093    o add new offset feature to offline pkg (plus minor cleanup)
2094    o cfc fixes for final year of integration
2095    o clean up GCHEM_OPTIONS.h/DIC_OPTIONS.h (all options should
2096      be in GCHEM_OPTIONS).
2097    
2098    checkpoint57x_post
2099    o fix testreport Pb in multiple test experiment.
2100    o cleanup our namelist syntax in verification:
2101      - make it more F95 standards compliant (some work still needed)
2102      - allows the vast majority of our tests to work with gfortran
2103    o Non-Hydrostatic:
2104     - put all NH variables (formerly in DYNVARS.h & GW.h) in NH_VARS.h
2105     - fix exchange calls for CS-grid using the new EXCH_S3D_RL.
2106    o Allow to apply AB on T,S rather than on AB(gT,gS):
2107     - implemented within #ifdef ALLOW_ADAMSBASHFORTH_3
2108     - use the same arrays (gtNm,gsNm) to hold tracer field at previous
2109       time-steps (if AB(T,S)) and tendencies (if AB(gT,gS)).
2110     - need a "clever" read_pickup to restart from the other AB formulation
2111    o move local commom bloc /GlobalLo/ (used for singleCpuIO) in EESUPPORT.h
2112    o remove some unused variables (reduces number of compiler warnings)
2113    o adjoint
2114      * Disable useVariableViscosity for adjoint for time being
2115        (there are a number of extensive recomputations)
2116      * Initialize certain variables needed for adjoint
2117    
2118    checkpoint57w_post
2119    o pkg/mdsio: use MAX_LEN_FNAM (instead of hard coded 80) for file-names
2120                 fix the singleCpuIO RS version of MDSWRITEFIELD
2121       and add a WARNING if using globalFiles=T with multi-processors.
2122    o write grid-file(s) in only one format (MDS or MNC): default=MNC (if
2123      using MNC); can force MDS output by setting writegrid_mnc=F in data.mnc
2124    o tracer advection scheme:
2125      add DST-2 (=Lax-Wendroff) & 1rst order upwind schemes (the way to get
2126       those 2 schemes before, changing GAD_FLUX_LIMITER.h + to recompile,
2127       was not very convenient).
2128      add implicit version for DST-3 & DST3_Flux_Limit vertical advection;  
2129       (further tests needed for the implicit DST & Flux-Limiter schemes).
2130    o PTRACERS: added namelist parameter PTRACERS_ref in analogy to tRef
2131      and sRef for convenience, handy, when you want to initialize
2132      ptracers in a large domain with a constant non-zero value. Also,
2133      untangle ptracers_init.F a little.
2134    
2135    checkpoint57v_post
2136    o change dome exp. to use variable viscosity in side-drag terms.
2137    o remove all the files from the cfc_offline test since they are now
2138      incorporated into tutorial_cfc_offline which has been producing
2139      identical results for a few days of testing
2140    o add new parameter: sideDragFactor to enable half-slip-side BC
2141      and change side-drag S/R to use viscosity from mom_calc_visc
2142      (can switch back by setting sideDragFactor=0.); affects results at
2143      truncation level; regenerate output for exp.: global_ocean.cs32x10(x3),
2144       global_ocean_ebm, global_ocean_pressure, matrix_example & MLAdjust(x5).
2145    o vorticity & strain are now computed without masking, to account for
2146      no-slip-side BC in variable viscosity calculation ; mask is applied
2147      anyway later on, before computing advection/coriolis terms.
2148    o modify exp4 to test new obcs support for reading from external files
2149      and for passive tracers
2150    o fix behavior of ptracers_monitor when monitor output is written to a
2151      netcdf-file; still not independent of monitor.F (writes in the same
2152      file).
2153    o change default value of tRef (put a uniform, meaningful value for ocean
2154      & atmos) and initialize sRef (was missing, as Martin mentioned).
2155    o Redefine viscC?Leith*.  Change the coefficients of Leith viscosity
2156      to be proportional to enstrophy dissipation length.  Thus,
2157       viscC?leith?_new=pi*(viscC?leith?_old)^(1/3)
2158      This is now consistent with Smagorinsky and with the manual.
2159    
2160    checkpoint57u_post
2161    o OBCS and PTRACERS: add open boundary support for passive tracers
2162      - either use homogenous (pseudo) v.Neumann conditions or prescribe
2163        OB-values from file; this is not different from the way theta and salinity
2164        are treated
2165      - however, Orlanski-radiation conditions are not supported, and the model
2166        will stop if you use pTracers and Orlanski at the same time.
2167      - beefed up the rountine obcs_external_fields_load: now only those open
2168        boundary values are overwritten with values from files for which there
2169        are really files, otherwise the OB-fields remain untouched. This makes
2170        it possible to use different OBs at different ends of the domain (as
2171        with EXF)
2172    o reduce number of exch calls in shap_filt (s2).
2173    o CS-grid: fix divergence contribution to Leith viscosity. Affects (@
2174      truncation level) 4/5 MLAdjust test results (11&12 digits match).
2175    
2176    checkpoint57t_post
2177    o test biharmonic viscosity + no-slip with exp: global_ocean.cs32x15.viscA4
2178    o finish adding brackets (coriolis S/R, vecinv) in multi-terms sum to get
2179      same truncation, independent of the face number: affects affects several
2180      test. exp.: Update global_ocean.cs32x15 (+.thsice) & MLAdjust (all 5).
2181    o fix bug in mom_v_sidedrag (biharmonic viscosity was counted 2 times);
2182      note that biharmonic viscosity + no-slip was not tested in any experiment.
2183    o fix bug in non-linear free-surf side-drag ; generate new output for
2184      global_ocean.cs32x15(+.thsice) & global_ocean_pressure.
2185    o make mnc honor the writeBinaryPrec flag for most kinds of output
2186    o eesupp: split EEPARAMS into EESIZE/EEPARAMS and add a vector global sum
2187    o minor change in averaging W (mom_vi_?_vertshear.F) that affects truncation
2188      error; update output from global_ocean.cs32x15(+.thsice) & MLAdjust (all 5).
2189    o add brackets in multi-terms sum to get same truncation, independent of
2190      the face number (manage to get exactly same value of gU,gV at the cs-edge)
2191      affects several test. exp. Update global_ocean.cs32x15 (+.thsice).
2192    o Clean, new version of mom_calc_visc.  Adds a new feature, viscAhRemax
2193      and viscA4Remax, which allow one to limit the minimum viscosity by specifying
2194      a maximum grid-scale Reynolds number.  Also, changes all length calculations
2195      in the case of grid anisotropy to geometric mean of dx**2 and dy**2.
2196      Suggested values of viscosity parameters found in mom_calc_visc.
2197      Many new viscosity diagnostics available.
2198    
2199    checkpoint57s_post
2200    o Add clearing-house for viscosity calculations, mom_calc_visc and
2201      correct numerous bugs in LeithD and Smagorinsky discretizations.  
2202      mom_calc_visc now allows for Smagorinsky, Leith and LeithD to be
2203      used simultaneously, and to be used in mom_vecinv and mom_fluxform.
2204      Mom_vecinv can be used with standard viscous calculation (mom_vi_hdissip.F)
2205      and with Strain-Tension viscous term calculation (mom_hdissip.F).  
2206      The Strain-Tension form is now called with useStrainTensonVisc=.true.
2207      ViscAhStrain and viscAhTension are now retired.
2208    o diagnostics "VISCAHD" & "VISCA4D" replace "VISCAH" & "VISCA4".
2209    o In response to JMC's bug report, genmake2 now ignores any soft-links
2210      that it finds in the *current* directory when searching for files.
2211      Soft-links found in any other source directories will still work as
2212      they did before.
2213    o add HAVE_SETRLSTK define and useSETRLSTK flag (eedata) which calls
2214      a C routine to unlimit the stack size
2215    o mnc-ify pkg/aim snapshot vars
2216    o mnc-ify pkg/land as requested by Daniel
2217    o various changes to mnc including:
2218      - all files use the new "BASENAME[[.ITER].{t|f}NUM].nc" format
2219      - output can now be grouped so that all files within a group
2220          change the ITER portion of their names in lock-step together
2221      - can now read ("global") PER-FACE (in addition to PER-TILE) files
2222          and works with both EXCH1 and EXCH2 (but needs more testing)
2223      - writing works for all verification test cases w/ g77 on Linux
2224    
2225    checkpoint57r_post
2226    o make MNC variable initialization happen earlier
2227    o add diagnostics for (almost) each term of the momentum Eq.
2228    o remove SST,SSS,UVEL_k2,VVEL_k2 diagnostics.
2229    o move pkg timeave out of pkg-groups "oceanic" & "atmospheric" (pkg/pkg_groups)
2230    o remove MINIMAL_TAVE_OUTPUT option ;
2231      add "dumpInitAndLast" to replace "nodumps" (and MINIMAL_TAVE_OUTPUT).
2232    o move some basic S/R (used elsewhere in the code) from pkg/mdsio to eesupp/src
2233      allows to compile without pkg/mdsio (& test successfully hs94.1x64x5)
2234    o add MNC output for adjoint of EXF (adexf), SEAICE (adseaice)
2235    o add time-dependent SST, SSS control
2236    o cost terms in ecco/ modularized (new cost_generic.F)
2237    o cost_averages routines are modularized (new cost_averagesgeneric.F)
2238    o new infrastructure for seaice model vs. obs misfits in seaice/
2239      * driver from the_main_loop.F is seaice_cost_driver.F
2240      * first term is AREA vs. SMR observation misfit (ALLOW_SEAICE_COST_SMR_AREA)
2241      * gradient check in Exp. 6a of natl_box_adjoint/
2242    o natl_box_adjoint input_seaice for Lab. Sea now available online via wget
2243      (see README file)
2244    
2245    checkpoint57q_post
2246    o fix initialisation Pb in calc_gw (get NANs in exp5 with g77)
2247    o fix annoying months-old bug in mnc/mdsio output for seaice pkg
2248      - bug was reported by Jean-Michel and Ian Fenty
2249    o fix initialization Pb in AIM-Ocean coupled model (aim_sice2aim.F)
2250      update exp. cpl_aim+ocn output.
2251    o Implement 4-level checkpointing: AUTODIFF_4_LEVEL_CHECKPOINT
2252      Needed for high-res. runs with large global files
2253      to be able to limit tapelev size
2254    o Changed some tests for adjoint:
2255      * carbon/ now tests AUTODIFF_2_LEVEL_CHECKPOINT
2256      * natl_box_adjoint/code_bulk/ tests AUTODIFF_4_LEVEL_CHECKPOINT
2257      * global_ocean.90x40x15/ back to default 3-level checkpointing
2258    o Modifications to enable scripted COMMON to MODULE conversion
2259      * verification/OpenAD/code/ has necessary scripts and description;
2260      * converts, compiles and runs successfully;
2261    
2262    checkpoint57p_post
2263    o reading of delXfile & delYfile moved from ini_parms.F to ini_grid.F
2264    o move ${PKG}_MNC_INIT from ${PKG}_READ_PARAMS to ${PKG}_INIT_FIXED
2265      (already the case for some pkgs, including recent MNC_init, e.g. thsice)
2266    o call CALC_GW from DYNAMICS (instead of from FORWARD_STEP)
2267    o Dissipation & phiHyd gradient are always added to gU,gV in timestep.F
2268      (was already the case for dissipation with mom_vecinv,
2269       and also the case for grad.PhiHyd when staggered-timeStep)
2270      This will allow to put dissipation out-off the AB time-stepping.
2271     Unfortunately, affects truncation error. Update output of exp. that "fails"
2272      (cg2d matching number) and leave the others for later: front_relax(10),
2273      global_ocean_pressure(10),ideal_2D_oce(10),internal_wave(9),lab_sea(12),
2274      matrix_example(7!),natl_box(12),plume_on_slope(11),vermix(12x3,11x2).
2275    
2276    checkpoint57o_post
2277    o fix MNC/MDSIO flags in PTRACERS so that (1) it works, and
2278      (2) its ready to be documented during the 20050801 DocFest
2279    o MNC-ify the gmredi package -- tested and works w/ and w/o mnc
2280      for ideal_2D_oce and lab_sea on linux_ia32_g77
2281    o set to #undef CTRL_SET_OLD_MAXCVARS_30
2282      in global1x1_tot/code_seaice_adj to access indices 32, 33
2283      (worth another tag)
2284    
2285    checkpoint57n_post
2286    o adding precip control xx_precip 32
2287    o adding swflux control xx_swflux 33
2288    o Replacing 10 forcing penalty cost routines by 1 generic.
2289    o Implementing partitioning in time-mean and variable adjustment
2290      for atmos. state.
2291    o Time-mean constant error is now read in data.ecco (instead of hard-coded)
2292    o in natl_box_adjoint:
2293      * updated exp 1 to 10
2294        (but does not have time-mean vs. variable split results yet)
2295    o updated global1x1/*_seaice_adj/
2296      to incorporate latest changes
2297    o enable useSingleCpuIO for mdsio vector routines
2298      (applies in particular to tapelev I/O)
2299    o removed inefficient K-loop in all active_file*control*.F
2300    
2301    checkpoint57m_post
2302    o re-arrange exp. adjustment.cs-32x32x1 (adjust_nlfs.cs-32x32x1 merge into)
2303      and advect_cs (use EXCH-2 and standard cs-32 grid files).
2304    o pkg/exch2: filling of face-corner halo regions is optional
2305      (ifdef W2_FILL_NULL_REGIONS) and is turned off by default.
2306    
2307    checkpoint57l_post
2308     tag before updating tutorials (pre-release-2)
2309    o add cos & sin of grid-direction orientation angle (curvilinear grid only,
2310       for output and interpolation of input fields onto model grid)
2311    o fix radius in mom_v_metric_cylinder.F (wrong by dy/2).
2312       Affects results of exp. rotating_tank ; update output.txt.
2313    o pkg/diagnostics: 2 new S/R to fill a diagnostics using a scaling factor
2314          and taking the square quantity and/or using a fraction-weight field.
2315    o fix aim_diagnostics_init.F mate numbers.
2316    o add mnc output capability to diagnostics/diagstat and update
2317      our cvsignore files for the ACSII output generated
2318    
2319    checkpoint57k_post
2320    o lab_sea now uses diagnostics package and provides a suite of
2321      new EXF diagnostics output.
2322    
2323    checkpoint57j_post
2324    o exf
2325      * bug fix in exf_bulkformulae for psimh (spotted by Eliyahu Biton):
2326        Bracket missing in eqn. for psimh (eqn. 7 of Large & Pond, 1982);
2327        terms -2*ATAN(x) + pi/2 were added to both stable and unstable case.
2328      * extended diagnostics output
2329        - now includes all EXF variables
2330        - hs, hl moved to common block
2331        - separate S/R for diagnostics, called after ctrl vector is added
2332        - name changed for EXFsw -> EXFswnet, EXFlw -> EXFlwnet
2333        - EXFqnet contains true Qnet (i.e. includes qsw)
2334      * updated verif. lab_sea, global_with_exf
2335      * Rearranging hflux (exf_mapfields -> exf_getforcing)
2336        to ensure that diagnostics sees a true EXFqnet
2337    o add matlab scripts for CS-grid vectors (in utils/cs_grid)
2338    o diagnostics pkg: change pointers so that 1 diagnostic can be used
2339      several times with different frequencies.
2340    o mnc-ify the thsice package as requested by Daniel Enderton
2341      - the monitor--MNC output needs work
2342      - many attributes need to be added (most are currently blank)
2343    o mnc-ify theaim_v23 package as requested by Daniel Enderton
2344      - many attributes need to be added (most are currently blank)
2345    o remove "groundAtK1" & "rkFac" (replaced by usingPCoords & -rkSign)
2346    o add Sadourny like discretization to the 4th.O vorticity advection scheme
2347    o fix bug in rStar code (calc_r_star.F) when used with topo/bathy.
2348      update output.txt from: aim.5l_cs (& .thSI), cpl_aim+ocn,
2349         fizhi-gridalt-hs and global_ocean.cs32x15 (& .thsice).
2350    o fix few little things to avoid floating error with -ftrapuv (ifort v9)
2351     (ini_spherical_polar_grid.F, calc_r_star.F, monitor/mon_surfcor.F)
2352    
2353    checkpoint57i_post
2354    o Diagnostics package was changed: diagnostic allocation is now deactivated
2355      by setting an empty file name in the namelist (used to be by setting 0 frequency)
2356    o momentum advection (VI form) options: activate 4th.O vorticity Coriolis ;
2357      add 1rst Order upwind vertical Shear.
2358    o add a quick fix for A/B checkpointing in OFFLINE mode
2359    o add IGNORE_TIME define and -ignore_time option to genmake2 as an
2360      end-run around the C/Fortran linking horror in eesup/src/timers.F
2361    o added pkg/runclock: allows user to terminate run based on wall clock
2362    o added non-hydrostatic scaling parameter: nh_am2
2363    o pkg/my82: futile attempt to make results compiler-independent by adding
2364      some "_d 0", etc. no effect.
2365    o for mnc output, fill the 'T' coordinate var with myTime and create a
2366      separate 'iter' variable for iteration count
2367    o pkg/diagnostics:
2368      add new capability: output of Global/Regional & per-level statistics ;
2369      tested against monitor output (including land & thSIce) on various exp.
2370    o make seaice-pkg I/O type flags (MNC/MDS) more standard.
2371    
2372    checkpoint57h_done
2373      tag after changing user customized files (DIAGNOSTICS_SIZE.h,
2374      data.diagnostics, data.gchem, data.ptracers) is done.
2375    
2376    o pkg/diagnostics: prepare for Global/Regional statistics.
2377      add 2nd namelist in data.diagnostics and update DIAGNOSTICS_SIZE.h
2378    o remove "baseTime" (no used) from arg. list of DIFF_BASE_MULTIPLE
2379      and rename it: DIFFERENT_MULTIPLE
2380    
2381    checkpoint57h_post
2382    o move tIter0 from data.gchem to PTRACERS_Iter0 in data.ptracers
2383    o pkg/diagnostics: change output frequency, now in seconds (instead
2384      of Nb of iterations). This requires to change data.diagnostics.
2385    checkpoint57h_pre
2386    
2387    o in mnc, let the user create the output dir if both mnc_outdir_date
2388      and mnc_outdir_num are false
2389    o add fflags() to pkg/diagnostics which allows one to specify, on a
2390      per-file basis, the file precision [default behavior is unchanged]
2391    o added diagnostics to pkg/kpp, including computation of mixed layer
2392      depth based on a temperature/density criterion
2393    o updated verification/natl_box to test the new pkg/kpp diagnostics
2394    o bugs fixed (with useAbsVorticity=T & with useJamartMomAdv=T)
2395    o test AB-3 code with 4th.Order advection scheme (advect_xy/input.ab3_c4)
2396    o fix mnc flags in pkg/seaice so that they are "owned" by seaice,
2397      not mnc -- this mistake was found by JMC and is now corrected
2398    
2399    checkpoint57g_post
2400    o add Adams-Bashforth 3rd Order time stepping:
2401      - default remains AB-2 (#undef ALLOW_ADAMSBASHFORTH_3)
2402      - not yet implemented with NH, CD_Scheme, pTracers, MNC_pickup ...
2403    checkpoint57g_pre
2404    
2405    o make lambda[Theta,Salt]ClimRelax spatially varying
2406      (default remains spatially uniform constant based on tau)
2407    o added new control variables
2408      * init. uVel, vVel, etanN
2409      * lambda[Theta,Salt]ClimRelax
2410    o separate masks used for ctrl_pack/unpack 'from write_grid' output
2411      (suggested by G. Forget)
2412    
2413    checkpoint57f_post
2414    o add parameter "baseTime" = model base time = time at iteration zero
2415      new function DIFF_BASE_MULTIPLE (replace DIFFERENT_MULTIPLE) to
2416      account for baseTime shift
2417    o move Coriolis arrays from PARAMS.h to GRID.h
2418    checkpoint57f_pre
2419    
2420    o mnc-ifying the seaice package
2421    o introduced an alternative length scale calculation for use in the limiting
2422      maximum viscosity (off by default, see mom_vi_hdissip.F for details)
2423    o S/R ptracers_calc_diff: argument list bug for CALL KPP_CALC_DIFF_S
2424    o added modified Leith scheme with viscosity proportional to grad(Hdiv)
2425      as well as grad(vort3).  Made it compatible with both approximate form
2426      for the cubed sphere and full form of these gradients.  Added flag
2427      useFullLeith to select between approximate and full form.  
2428    o add "d0" in getcon.F to reduce differences between compilers/platforms
2429      update output.txt of exp. fizhi-gridalt-hs
2430    o change port_rand funtion to allow to set the seed.
2431    o fix obscure MNC bug involving conversion between reals and integers
2432      - it caused no problems with certain (eg. gcc, ifc) compilers but the
2433        new version is now more standards-compliant
2434    o adjoint-related modifications
2435      * gad_dst3_adv_?: to be able to use advscheme=30 in adjoint
2436      * gad_calc_rhs: fool adjoint, revert to advscheme=30 in reverse when using 33
2437      * mom_vi_hdissip: to be able to use Leith scheme in adjoint
2438    
2439    checkpoint57e_post
2440    o Adding eddy stress controls a la Ferreira et al.
2441    checkpoint57e_pre (actually was tagged: eckpoint57e_pre)
2442    
2443    o fizhi pkg: fix AtoC and CtoA when called with same input & output array
2444      update output.txt of exp. fizhi-gridalt-hs
2445    o add more "Z" dimensions and associated coordinate vars to MNC
2446    o pkg/exf: added twoDigitYear capability for option useExfYearlyFields
2447    o parameter calendarDumps: when set, approximate months (30-31 days) and years
2448      (360-372 days) for parameters chkPtFreq, pChkPtFreq, taveFreq, SEAICE_taveFreq,
2449      KPP_taveFreq, and freq in pkg/diagnostics are converted to exact calendar
2450      months and years.  Requires pkg/cal.
2451    o diagnostics: add pickup functionality
2452      - off by default for backwards compatibility
2453      - current version only uses MDSIO -- MNC will be added
2454    o allow to use pkg diagnostics for LAND pkg output & Shapiro Tendencies.
2455    o pkg/shap_filt: fix for multi-tiles per face (CS-grid with EXCH2)
2456    
2457    checkpoint57d_post
2458    o pkg/thsice used in the ocean: fix tile Pb related to sIceLoad forcing
2459    o modify verification/ideal_2D_oce so that it tests the creation of mnc
2460      output from the diagnostics package
2461    o temporary fix in EXCH2_UV: add a 3rd call to fix the 24.tiles CS-grid set-up
2462    o make genmake2 more portable by using ".$FS" instead of ".f" for more
2463      of the test compilations (eg. IBM xlf on Mac OSX w/HFS filesys)
2464    o add coordinate variables to the MNC output from the diagnostics package
2465    o change MNC-flags default value: true when useMNC=TRUE
2466    o add a "readgrid_mnc" flag to MNC and give model/src/ini_curvilinear_grid.F
2467      the ability (off by default) to read the grid information using MNC
2468    o lab_sea: use LSR_ERROR=1.E-12 for testing ; update output.txt
2469    o diagnostics: fix a bug (sub-set of levels); keep full precision when averaging
2470    o do snap-shot diagnostics at the middle of the time-interval (instead of
2471      at the end).
2472    o update exp. aim.5l_cs (use default LAND_OPTIONS.h file) and add
2473      new test for AIM with thSIce + slab-ocean
2474    o cpl_aim+ocn test: update output (optfile & default GMREDI_OPTIONS.h)
2475    o move state variable diagnostics to the beginning of the time step ;
2476      (note: still needs some work specially for snap-shot diagnostics)
2477      duplicate & replace UVELVVEL diagnostics with UV_VEL_C & UV_VEL_Z
2478    
2479    checkpoint57c_post
2480    o Change testing option (-ieee) to get closer agreement between g77 & ifort
2481    o generate new output.txt files on faulks with g77 & the new -ieee option
2482    checkpoint57c_pre
2483    
2484    o add "_d 0" in freeze ; change some "FLOAT" to "DFLOAT" and went back (TAF);
2485      update output.txt of exp. global_ocean.90x40x15
2486    o fix in ini_eos.F (one "_d 0" was missing): now g77 & ifc give much closer
2487      results; update global_ocean_pressure & global_ocean.cs32x15 output.txt
2488    o add saltFlux(+File) forcing capability with periodicExternalForcing
2489    o allow to use pkg diagnostics for GM-Redi & ThSIce output
2490    o diagnostics_fill: fill in up to sNx+1 or sNy+1 (if U,V or Z pt) for mnc.
2491    o improvements for the MNC output from DIAGNOSTICS:
2492      - correct handling of the unlimitied dimension
2493      - all dims now have associated coordinate variables
2494      - variables located at U, V, and Corner ("Z") points are now written
2495        with the correct horzontal dimensions (eg. 'Xp1', 'Yp1') so that
2496        *all* data points are output
2497    o added seaice_summary.F and removed obsolete ALLOW_SEAICE's from pkg/seaice
2498    o added pkg/seaice/seaice_monitor.F
2499    o mdsio_readfield.F can now read files visible only to master MPI process.
2500    o pkg/seaice: some test code for ice-modified ocean stress
2501    o exf_getffields interpolation defaults to bilinear for all scalar forcing
2502      fields (remains bicubic for wind velocity and stress).  This avoids, e.g.,
2503      spurious negative numbers for precipitation and humidity.  Will cause
2504      some small numerical differences for integrations using pkg/exf/exf_interp.F.
2505    o pkg/ctrl/
2506      * Add ctrlvec diagnostics in pack/unpack for nondimensional I/O
2507        May be enabled via doPackDiag
2508      *  introduce z-scaling of
2509         + gradient (doZscalePack) and
2510         + control (doZscaleUnpack)
2511    o pkg/mdsio/
2512      * enable useSingleCpuIO for state estimation (ctrl_pack/unpack) mdsio_gl.F
2513      * N.B.: leave tiled I/O for tapelev (i.e. mds...vector)
2514    
2515    checkpoint57b_post
2516    o simplify options in diagnostics_fill arguments (remove weird combinations)
2517    o fix MNC coordinate variables so that they now contain per-face index
2518      values (instead of xC,xG,yC,yG values) when run with EXCH2 since, in
2519      general, EXCH2 grids are only aligned to a "local" coordinate system
2520    o test diagnostics pkg in dic_example (no output) and ideal_2D_oce (with ouput)
2521    o Implement instantaneous output within pkg diagnostics:
2522      setting a negative frequency in data.diagnostics produces
2523     "snap-shot" output (as opposed to time-average if freq > 0)
2524    o move out off EQUIVALENCE all diagnostics that fizhi does not use ;
2525      NOTE: change ptracer diagnostics name: use 2 characters to work with
2526            more than 9 tracers. Add also diagnostics of advect & diffus flux.
2527    o more CF compliance: convert all MNC 'iter' variables to 'T' so that it
2528      becomes the coordinate variable for the 'T' dimension
2529    o add CF-style coordinate variables to MNC
2530      - just a first cut:  numbers are meaningless on the cubesphere and
2531        missing along the T axis but otherwise it works!
2532    o add surface flux diagnostics: TAUX, TAUY, TFLUX, TRELAX, TICE, SFLUX, SRELAX
2533    o pkg/thSIce: read initial state from 6 files ; allow monitor to use MNC.
2534    o add diagnostics of advective & diffusive flux for T & S (pTracers coming soon)
2535      this is based directly on what the model compute, so that the content of
2536      each diagnostics might be affected by switching options (e.g., implicitDiffusion)
2537    o small changes for diagnostics (gad_biharm_?.F, arguments of S/R impldiff.F)
2538    o clean up build options files for SunOS, in particular
2539      - remove -traditional from xmakedepend
2540      - change -xarch=v9 to -xarch=native for f77
2541      - restore use of make (not gmake)
2542      - add CC=gcc if using g77
2543    o changes per discussion of AM, JMC, & EH3 today:
2544      - move redundant "grid" variables out of "state" -- in preparation of
2545        creating proper CF-style coordinate variables and in recognition
2546        that any/all grid variables can be easily copied (eg. w/NCO) from
2547        the grid files into any of the other NetCDF files
2548      - *always* output grid variables with MDSIO (this will eventually be
2549        changed)
2550      - output MNC grid file if useMNC is true
2551    o every instance of _END_MASTER() has been found and replaced with
2552      _END_MASTER( myThid ) in order to satisfy certain picky Sun
2553      preprocessors
2554    o re-arrange diagnostics pkg initialisation:
2555     - allow each package to extend the available diagnostics list
2556     - add some checking and fix small problems (multi-threaded, ...)
2557     - new S/R diagnostics_fill (replace fill_diagnostics):
2558       look through the short list of active diag. (instead of the long list)
2559       create function DIAGNOSTICS_IS_ON to tell if a diagnostics is active
2560    
2561    checkpoint57a_post
2562    o this set of changes restores TAMC compatibility
2563      tested for global_ocean.90x40x15 adjoint on trough
2564      (what a pain)
2565    
2566    checkpoint57a_pre
2567    o some modifs in tools/build_options for sunos
2568    o call ctrl_pack for ctrl at end for optimcycle=0
2569    
2570    checkpoint57
2571    o add horizontal bi-harmonic viscosity for vertical velocity
2572      - new parameter viscA4W (defaults to viscA4)
2573      - affects only non-hydrostatic code
2574      - to be done: no-slip lateral boundary conditions
2575    o switch back to "sflux = sflux - runoff" in exf_getforcing.F
2576    o implement Implicit Vertical advection for pTracers
2577    o depth convergence accelerator: replace deltaTtracer by dTtracerLev(k)
2578      (implemented also for implicit vertical diffusion & advection)
2579    o OBCS: extend application of tracer open boundary conditions
2580      to a strip beyond the boundary of width Olx/Oly
2581    o add call monitor to TAF set of required calls (flow directives)
2582      and include in natl_box_adjoint
2583    o untangle a few ifdefs related to cost, ctrl, autodiff
2584      untangel a few ALLOW_ECCO_OPTIMIZATION
2585    o Apply Cooper & Haines representative estimates also at sub-surface (k=Nr)
2586      (theta2, salt2 in ecco_cost_weights)
2587    
2588    checkpoint56c_post
2589    o OBCS as control variables
2590      - update ctrl_ad_diff.list, obcs_ad_diff.list
2591      - remove balance of obcs controls from default
2592      - fix index bug nobcs in ctrl_init
2593      - fix dummy fields filen in ctrl_pack
2594      - add dummy weights for obcs
2595    o lsopt: comment out fort.94 output
2596    o optim:
2597      - remove unnecessary header files
2598      - adjusted namelists
2599      - add xerbla.F to Makefile
2600    o exf:
2601      - multiple modifications of exf_check_range
2602      - unit change in exf_init_runoff from [m/year] to [m/s]
2603    o mdsio:
2604      - i/o-vector change debugLevel from debLevA to debLevB
2605    
2606    checkpoint56b_post
2607    o collect all ptracers output in an new routine (PTRACERS_OUTPUT) that
2608      is called from DO_THE_MODEL_IO
2609      - rename PTRACERS_STATV_WRITE to PTRACERS_WRITE_TIMEAVE
2610      - introduce new parameter PTRACERS_dumpFreq (defaults to dumpFreq)
2611      - clean up PTRACERS_WRITE_TIMEAVE a little
2612    o add another verification experiment that tests both the cfc-pkg and
2613      the gchem-pkg with GCHEM_SEPARATE_FORCING undefined, that is with
2614      reactive tendencies treated inline with regular timestepping
2615    o testreport previously did a lousy job of comparing small numbers, so
2616      we (Ed and Martin) changed the  way the cut-off of 1.e-12 is
2617      implemented in the little c-progam tmp_cmpnum.c which is embedded in
2618      testreport.
2619    o ptracers_monitor: bug fix for MPI
2620    
2621    checkpoint56a_post
2622    o GCHEM: finish reorganizating the package
2623      - forward_step calls GCHEM_CALC_TENDENDY, which computes gchemTendency
2624        (introduces another 3D-array for each passive tracer, but only if
2625        GCHEM_SEPARATE_FORCING is undefined. For GCHEM_SEPARATE_FORCING
2626        gchemTendency is not needed because the timestep is done separately)
2627      - gchemTendency is added to gPtr in GCHEM_ADD_TENDENCY
2628      - GCHEM is now---more or less cleanly---separate from PTRACERS
2629      - to bo done: handling of surfaceForcingPtr that is needed for KPP not
2630        so clear to me how that should be done in a general way.
2631    o CFC: improve formatting of output in CFC_ATMOS
2632    o PTRACERS:
2633      - rename GCHEM_MONITOR to PTRACERS_MONITOR and call it from MONITOR, so
2634        that ALL experiments with ptracers enable can be checked. This makes
2635        GCHEM_MONITOR obsolete.
2636      - include a runtime parameter PTRACERS_monitorFreq that defaults to
2637        monitorFreq
2638      - set default PTRACERS_write_mdsio to false if PTRACERS_write_mnc is true
2639    o add PTRACERS (PTR0[1-5]) to testreport output
2640    o exf_check_range:
2641      * default changed to .TRUE.
2642      * will check values for niter0 if debLevA, every timestep if debLevB
2643      * STOP in exf_check_range if 'out of range'
2644      * range chosen generous to allow for potential extema
2645      TBD: a version with stricter range
2646           permitted range would be runtime parameters
2647    o GMredi:
2648      - fix ldd97 slope limit ; extend valid domain of Psi-Bolus ;
2649      - change S/R GRAD_SIGMA to be valid in the overlap on CS-grid.
2650      - change the default GMREDI_OPTIONS.h: compile everything except Visbeck
2651    o GCHEM:
2652      - move call to GCHEM_FORCING_SEP, so that it is now called before
2653        the blocking exchanges to avoid computing halos in GCHEM_FORCING_SEP
2654      - introduced a useGCHEM runtime flag and applied it everywhere.
2655      - renamed PTRACERS_SEPARATE_FORCING to GCHEM_SEPARATE_FORCING;
2656        this flag is now only visible within GCHEM-pkg routines.
2657      - moved gchem_forcing_int temporarily into ptracers_forcing, this will
2658        be replaced by a 3D array that is computed before thermodynamics; for
2659        this, the tracer ID iTracer had to be included into the parameter list
2660        of ptracers_forcing
2661      - set up forward_step to call gchem_forcing, that will replace
2662        gchem_forcing_int in ptracers_forcing
2663      - cleaning up
2664    o small cleaning of exch2: remove files that are also in eesupp/src
2665    
2666    checkpoint56
2667    o AIM: read land-Fraction earlier (from ini-fixed) and monitor land at nIter0
2668    o mnc: cleanup "full" files--fixes out-of-memory problem
2669    o ECCO-GODAE
2670      * model/, pkg/, code/, input/ now complete w.r.t. ECCO-GODAE production setup
2671      * fully merged and updated from SIO code
2672        windstress sign change affects
2673        - exf_inscal_[u/v]stress
2674        - sign of xx_tau[u/v] adjustments
2675        - signs in cost_scat
2676      * ctrl_get_gen: avoid update of tau[u/v] for first few days
2677      * natl_box_adjoint updated and compressed
2678      * 2-level checkpoint switch added
2679        (tested in EXP. 1 of natl_box_adjoint)
2680      * new switch doInitXX to avoid init. of xx_... in optimcycle=0
2681    o SVD
2682      * first complete, non-hacked version for SVD calculations
2683      * all interfaces clean w.r.t to handling of xx_..., adxx_..., g_xx_...
2684        performed via direct access files admtlm_vector.it????
2685        (via ctrl_[un]pack)
2686      * optimcycle is used for ARPACK iteration counter
2687        (note: adxx_... is iterated, rather than xx_...; latter is constant!)
2688      * EV problem ok w.r.t. L2-norm in tangent space; need to check other norms
2689        and add linear transforms where necessary
2690      * controls are initial/final SST, SSS (can be extended; need to check
2691        ctrl_set_[un]pack_xyz.F according to ctrl_set_[un]pack_xy.F
2692    o mdsio: filename info to both stderr, stdout
2693    o exf: exf_inscal_runoff: separated default conversion [m/year] -> [m/sec]
2694      from sign change
2695    
2696    checkpoint55j_post
2697    o isolate dissipation tendency (allow to keep it out off AB) in V.I form.
2698      affects (truncation level) output.txt of global_ocean.cs32x15(&.thsice)
2699    o add consistent build directories and .cvsignore files to verification
2700    o added viscA4GridMin and viscA4GridMax for more control on biharmonic viscosity
2701    o make all subroutines 30 or less characters in length for certain older
2702      compilers to work (a thorough search only turns up two routines in
2703      pkg/ptracers)
2704    o allow (vecinv only) a different horiz. viscosity for Divergence and Vorticity;
2705      affects (truncation level) output.txt of global_ocean.cs32x15(&.thsice)
2706    
2707    checkpoint55i_post
2708    o change arrays for total vertical diffusivity (2.D if explicit,
2709      3.D if implicit) ; each ptracer uses its own background value.
2710    o added mnc/NetCDF output capability to ocn_compon_interf
2711      - added bits to verification/cpl_aim+ocn so that it can run on
2712        ITRDA and other clusters without the mpirun "-wd" option
2713    o fixed wayward endif in mom_fluxform.F that messed up cyclindrical
2714      configuration
2715    o give MNC the ability to create additional files rather than
2716      exceeding a specified file size limit "MNC_MAX_FILESIZE"
2717      - the default is just less than 2GB which is a practical limit
2718        on many systems
2719    o Compute the non-local term using either KPP vertical diffusivity (=default)
2720       or the total vertical diffusivity (when KPP_ghatUseTotalDiffus=T)
2721    
2722    checkpoint55h_post
2723    o add verification test "vermix"
2724    o remove all the *_ioinc flags and replace with the single global
2725      outputTypesInclusive flag
2726    o allow to set a vertical profile of vertical diffusivity for T & S
2727    o call PACKAGE_BOOT & PACKAGES_READPARMS just after INI_PARMS
2728    o useMNC moved from data.mnc to data.pkg
2729    
2730    checkpoint55g_post
2731    o Renaming carbon AD experiments to comply with testreport conventions
2732    o Updating adjoint of Held-Suarez hs94.1x64x5
2733    o Fixing directives for non-ECCO forward_step, after ECCO directives
2734      have been fixed to avoid recomp. of do_oceanic_phys
2735      Works well for global_ocean.90x40x15,
2736      but recomp. issue remains for carbon
2737    o Updating adjoint output for natl_box_adjoint after
2738      pkg/ecco has been modified (see taga c55d_post)
2739    
2740    checkpoint55f_post
2741    o rename to timeave_init_fixed
2742    
2743    checkpoint55e_post
2744    o some delicate re-shuffle of store directives to avoid one
2745      extra call of do_oceanic_physics
2746      affects ecco_the_main_loop.F, do_oceanic_physics.F
2747      checkpoint_lev1_directives.h
2748    o NB: this may break global_ocean adjoint temporarily,
2749      but it is clear how to fix it. Will do later, need this now.
2750    
2751    checkpoint55d_post
2752    o ECCO specific cost function terms (up-to-date with 1x1 runs)
2753    o ecco_cost_weights is modified to 1x1 runs
2754    o modifs to allow observations to be read in as
2755      single file or yearly files
2756    o enable to read exf forcing fields as either
2757      single file or yearly files (flag useExfYearlyFields)
2758    checkpoint55d_pre
2759    
2760    o switch between 2-level and 3-level checkpointing
2761    o add ability of MNC to write local and "partial" (eg. 2D slices where
2762      the full 3D field is never actually stored) arrays to NetCDF files
2763      with the correct (that is, the complete multi-dimensional) set of
2764      array indicies
2765      - used in mom_vecinv() to write the diagFreq output
2766      - tested (demonstrated) in verification/aim.5l_cs
2767  o further mnc-ification  o further mnc-ification
2768    - add verification/lab_sea to the list with mnc setups    - add verification/lab_sea to the list with mnc setups
2769    - fix undefined mnc v-names in cd_code    - fix undefined mnc v-names in cd_code
# Line 118  o add two new packages Line 2879  o add two new packages
2879    - my82 (Mellor and Yamada, 1982) level 2 turbulence closure scheme    - my82 (Mellor and Yamada, 1982) level 2 turbulence closure scheme
2880    - these scheme operate in a similar manner as KPP (without ghat, of    - these scheme operate in a similar manner as KPP (without ghat, of
2881      course), however there is only one diffusivity that is used for both      course), however there is only one diffusivity that is used for both
2882      temperature and salinity (and passive tracers)ç      temperature and salinity (and passive tracers)
2883  o add offline package  o add offline package
2884  o add "verification/dic_example" which contains a dic-gchem-ptracer setup  o add "verification/dic_example" which contains a dic-gchem-ptracer setup
2885    provided by Stephanie Dutkiewicz    provided by Stephanie Dutkiewicz

Legend:
Removed from v.1.363  
changed lines
  Added in v.1.1200

  ViewVC Help
Powered by ViewVC 1.1.22