/[MITgcm]/MITgcm/verification/natl_box_adjoint/README
ViewVC logotype

Contents of /MITgcm/verification/natl_box_adjoint/README

Parent Directory Parent Directory | Revision Log Revision Log | View Revision Graph Revision Graph


Revision 1.7 - (show annotations) (download)
Wed Aug 31 19:42:39 2005 UTC (18 years, 9 months ago) by dimitri
Branch: MAIN
Changes since 1.6: +31 -31 lines
updating verification/natl_box_adjoint

1 # Example: Subtropical North Atlantic and Labrador Sea Areas
2 # ==========================================================
3 # - forward/adjoint run
4 # - optimization cost function
5 # - The input data is real*8
6 # - The tests below assume that a "taf" executable is available
7 # (http://www.fastopt.de/)
8
9 >>>>>>>>>>>>>>>>>>>> DO THESE THINGS FIRST <<<<<<<<<<<<<<<<<<<<
10 cd verification/natl_box_adjoint
11 gunzip results*/output*.gz
12 mkdir exe
13 cd input
14 wget -nd -r -A"PH*" http://channel.mit.edu/datasets/MITgcm_input_files/MITgcm/verification/natl_box_adjoint/input
15 cd ../input_seaice
16 wget -nd -r -A"*labsea*" http://channel.mit.edu/datasets/MITgcm_input_files/MITgcm/verification/natl_box_adjoint/input_seaice
17 wget -nd -r -A"pickup*" http://channel.mit.edu/datasets/MITgcm_input_files/MITgcm/verification/natl_box_adjoint/input_seaice
18 >>>>>>>>>>>>>>>>>>>> DO THESE THINGS FIRST <<<<<<<<<<<<<<<<<<<<
19
20 ####################
21 # Experiment no. 1 #
22 ####################
23 # Use air-sea fluxes as controls (standard case):
24 # perform gradient checks for first four elements of the
25 # heat flux part of the control vector (grdchkvarindex = 3).
26 # - with GMREDI, KPP, and shortwave heating
27 # - 4 timesteps
28
29 # Compile code in build/:
30 cd ../build
31 ../../../tools/genmake2 -ieee -mods=../code
32 make depend
33 make adall
34
35 # To run:
36 cd ../exe
37 cp ../input/* .
38 ../build/mitgcmuv_ad >&! output.txt
39 # To verify the results of the gradient check, type:
40 grep grad-res output.txt
41 # A reference output is in:
42 grep grad-res ../results/output.txt_adm
43
44
45 ####################
46 # Experiment no. 2 #
47 ####################
48 # Use bulk formulae and atmospheric state controls
49 # (only differences to experiment 1 are in
50 # ECCO_CPPOPTIONS.h and in data.grdchk):
51 # perform gradient checks for first four elements of the
52 # air temperture part of the control vector (grdchkvarindex = 7).
53
54 # Compile code in build/:
55 cd ../build
56 rm -f *.o *.f *.p rii_files *.flow
57 rm -f *.F *.h *.c Makefile* *.template genmake_*
58 ../../../tools/genmake2 -ieee -mods=../code_bulk
59 make depend
60 make adall
61
62 # To run:
63 cd ../exe
64 cp ../input_bulk/* .
65 cp ../input_bulk/data.grdchk_precip data.grdchk
66 cp ../input/PH_*.data .
67 ../build/mitgcmuv_ad >&! output.txt
68 # To verify the results of the gradient check, type:
69 grep grad-res output.txt
70 # A reference output is in:
71 grep grad-res ../results_bulk/output.txt_adm
72
73
74 ####################
75 # Experiment no. 4 #
76 ####################
77 # Same as exp. 2, but with ALLOW_SEAICE defined and useseaice = .true.
78
79 # Compile code in build/:
80 cd ../build
81 rm -f *.o *.f *.p rii_files *.flow
82 rm -f *.F *.h *.c Makefile* *.template genmake_*
83 ../../../tools/genmake2 -ieee -mods=../code_seaice
84 cp ../code_seaice/SEAICE_OPTIONS.h.FLUXES SEAICE_OPTIONS.h
85 make depend
86 make adall
87
88 # To run:
89 cd ../exe
90 cp ../input_bulk/* .
91 cp ../input_bulk/data.grdchk_precip data.grdchk
92 cp ../input_seaice/data.seaice.cgrid data.seaice
93 cp ../input_seaice/data.pkg .
94 cp ../input/PH_*.data .
95 ../build/mitgcmuv_ad >&! output.txt
96 # To verify the results of the gradient check, type:
97 grep grad-res output.txt
98 # A reference output is in:
99 grep grad-res ../results_seaice/output_exp4.txt_adm
100
101
102 ####################
103 # Experiment no. 5 #
104 ####################
105 # Same as exp. 4, but using sea-ice bulk formulae.
106 # This experiment tests pkg/seaice bulk formulae over open water.
107 # No sea-ice is formed anywhere in the domain.
108
109 # Compile code in build/:
110 cd ../build
111 rm -f *.o *.f *.p rii_files *.flow
112 rm -f *.F *.h *.c Makefile* *.template genmake_*
113 ../../../tools/genmake2 -ieee -mods=../code_seaice
114 make depend
115 make adall
116
117 # To run:
118 cd ../exe
119 cp ../input_bulk/* .
120 cp ../input_bulk/data.grdchk_precip data.grdchk
121 cp ../input_seaice/data.seaice.cgrid data.seaice
122 cp ../input_seaice/data.pkg .
123 cp ../input/PH_*.data .
124 ../build/mitgcmuv_ad >&! output.txt
125 # To verify the results of the gradient check, type:
126 grep grad-res output.txt
127 # A reference output is in:
128 grep grad-res ../results_seaice/output_exp5.txt_adm
129
130
131 ####################
132 # Experiment no. 6 #
133 ####################
134 # Same as experiment 5, but in the Labrador Sea rather than in
135 # the North Atlantic subduction region. The cost function is
136 # total ice volume over the 4-hour test period.
137 #
138 # The cost function data files are not used. They contain:
139 # labsea_TP_fields : filled with -9999
140 # labsea_TP_mean : hour 100 ssh (cm) of lab_sea experiment
141 # labsea_ERS_fields : filled with -9999
142 # labsea_SST_fields : 14 * Levitus annual mean SST
143 # labsea_Lev.ptmp : 14 * Levitus annual mean temperature
144 # labsea_Lev.salt : 14 * Levitus annual mean salinity
145 # labsea_ssh.err : filled with -9999
146 # labsea_geoid.err : constant 0.2 with -9999 landmask
147 # labsea_totflux.err : 100 with -9999 landmask
148 # labsea_pme.err : 4e-8 with -9999 landmask
149 # labsea_ustress.err : 3 with -9999 landmask
150 # labsea_vstress.err : 3 with -9999 landmask
151
152 # To run:
153 cd ../exe
154 cp ../input_seaice/* .
155 cp ../input_bulk/data.grdchk .
156 ../build/mitgcmuv_ad >&! output.txt
157 # To verify the results of the gradient check, type:
158 grep grad-res output.txt
159 # A reference output is in:
160 grep grad-res ../results_seaice/output_exp6.txt_adm
161
162
163 ####################
164 # Experiment no. 7 #
165 ####################
166 # Same as experiment 6, but finite difference gradient check for
167 # air temperature is computed and compared for the complete domain.
168 #
169 # Notes:
170 # variables xx_* contain control vector perturbation
171 # variables adxx_* contain cost function gradient relative to control
172
173 # To run:
174 cd ../exe
175 cp ../input_seaice/* .
176 ../build/mitgcmuv_ad >&! output.txt
177 # To verify the results of the gradient check, type:
178 grep grad-res output.txt > grad-res.txt
179 cd ../results_seaice
180 # plot with matlab:
181 matlab
182 lookat_exp8
183
184
185 ####################
186 # Experiment no. 8 #
187 ####################
188 # Same as experiment 7, but starting from a checkpoint file.
189
190 # To run:
191 cd ../exe
192 cp ../input_seaice/* .
193 cp data.001 data
194 ../build/mitgcmuv_ad >&! output.txt
195 # To verify the results of the gradient check, type:
196 grep grad-res output.txt > grad-res.txt
197 cd ../results_seaice
198 matlab
199 lookat_exp8
200
201
202 ####################
203 # Experiment no. 9 #
204 ####################
205 # Same as experiment 8, but starting from time step 180.
206 # This includes a location (12,8) which experiences a phase
207 # transition from no-ice to sea-ice, and which therefore has
208 # a very large and inaccurate gradient.
209
210 # To run:
211 cd ../exe
212 cp ../input_seaice/* .
213 cp data.180 data
214 ../build/mitgcmuv_ad >&! output.txt
215 # To verify the results of the gradient check, type:
216 grep grad-res output.txt > grad-res.txt
217 cd ../results_seaice
218 matlab
219 lookat_exp8
220
221
222 #####################
223 # Experiment no. 10 #
224 #####################
225 # Set up a 100-day sensitivity experiment.
226 # Things start falling apart, see below.
227 # Longer integrations periods cause NANs in adjoint gradient.
228 # Note: cost_ssh is hardwired for 1-day ssh records
229 # "topexperiod" in data.cost is never used.
230
231 # Compile code in build/:
232 cd ../build
233 rm -f *.o *.f *.p rii_files *.flow
234 rm -f *.F *.h *.c Makefile* *.template genmake_*
235 ../../../tools/genmake2 -ieee -mods=../code_seaice
236 make depend
237 make adall
238 make ftlall
239
240 # To run:
241 # PH: I modified data to run 24 timesteps only
242 cd ../exe
243 cp ../input_seaice/* .
244 cp data.24 data
245 cp ../input_bulk/data.grdchk .
246 # run the ADM
247 ../build/mitgcmuv_ad >&! output.txt_adm
248 # run the TLM
249 ../build/mitgcmuv_ftl >&! output.txt_tlm
250
251 # For 100 days, adjoint gradient is NAN
252
253 # Following table compares finite difference gradient for various choices
254 # of grdchk_eps.
255 1.d-12 -.177327175E+20 0.140230277E+20 -.254542273E+20 0.138603531E+19
256 1.d-8 0.174714613E+16 -.527867903E+15 0.403581037E+15 0.377322748E+12
257 1.d-4 0.999954825E+11 0.156018218E+12 -.474931072E+11 -.357260091E+11
258 1.d-2 0.634576350E+09 -.185440863E+10 -.599212833E+09 -.334417056E+10
259
260 # Following table compares adjoint and finite difference gradient for
261 # various choices of nTimeSteps
262 # with nTimeSteps=4
263 adj grad 0.103151639E+00 0.308058453E+00 -.732758366E+04 -.161844794E+06
264 1.d-4 0.305175781E+00 0.305175781E+00 -.732757568E+04 -.161844788E+06
265 # with nTimeSteps=24
266 adj grad 0.137444822E+04 0.365984818E+04 0.256198267E+05 -.204077640E+06
267 1.d-4 0.137313843E+04 0.365982056E+04 0.256221008E+05 -.204077454E+06
268 # with nTimeSteps=240
269 adj grad 0.443328852E+39 -.133652133E+38 -.905448973E+38 -.598093614E+40
270 1.d-4 -.209616183E+10 0.257127391E+10 -.917457365E+10 0.104622205E+10
271 # with nTimeSteps=480
272 adj grad -.217869560E+39 0.656820132E+37 0.444973903E+38 0.293927165E+40
273 1.d-4 -.848343350E+09 0.186724144E+10 -.768266406E+10 0.188919420E+10
274 # with nTimeSteps=960
275 adj grad -.125255788E+49 0.377613667E+47 0.255820763E+48 0.168982206E+50
276 1.d-4 0.683065531E+10 -.241320782E+11 -.359080729E+11 0.222805821E+11
277 # with nTimeSteps=1920
278 adj grad 0.993422132E+94 -.299490969E+93 -.202895220E+94 -.134022280E+96
279 1.d-4 0.677603652E+12 0.115923780E+12 -.383606246E+12 -.393716060E+12
280 # with nTimeSteps=2400
281 adj grad 0.204800998+114 -.617421814+112 -.418282846+113 -.276296408+115
282 1.d-4 0.796041873E+12 0.280172355E+12 -.429971310E+12 -.655627972E+12
283 # with nTimeSteps=3600
284 adj grad 0.123800977+143 -.373227788+141 -.252849475+142 -.167019524+144
285 1.d-4 0.154270431E+12 0.246315840E+12 0.392679620E+12 0.816557457E+11
286
287 # With cost_ice_flag = 2
288 # adj grad 0.500216760+194 -.353450868+194 -.799381224+195 -.173412383+194
289 # 1.d-04 -.327859949E+08 -.300222927E+10 0.252204364E+09 -.658448165E+10
290 # 1.d-03 -.572185323E+08 0.614938314E+08 -.850914638E+09 0.248982808E+08
291 # 1.d-02 -.624721639E+07 -.147537212E+08 -.114497432E+09 -.358163526E+08
292 # 1.d-01 0.603974309E+07 -.684786020E+07 -.149337451E+09 -.601790080E+07
293 # 1.d-00 -.497381448E+06 -.404972657E+05 -.142684281E+09 -.501277195E+08
294
295 # 100 day experiment with cost_ice_flag = 3, but in North Atlantic
296 # domain, i.e., with no sea-ice is OK
297 adj grad 0.234593317E+17 0.166950683E+17 0.238665515E+17 0.249850733E+17
298 1.d-4 0.234313954E+17 0.166674930E+17 0.238322031E+17 0.249217155E+17
299
300 # with same order of magnitude results as those from pkg/exf bulk formulae
301 adj grad 0.279968788E+17 0.226979382E+17 0.269224396E+17 0.323359773E+17
302 1.d-4 0.279944626E+17 0.226935335E+17 0.269274317E+17 0.323399293E+17
303
304 # 10 day experiment with cost_ice_flag = 3 is OK
305 adj grad 0.353941629E+17 0.955451129E+16 -.265793314E+17 0.232229067E+16
306 1.d-4 0.353943893E+17 0.955563114E+16 -.265195776E+17 0.232137949E+16
307 1-fd/adj -.639540199E-05 -.117207086E-03 0.224813073E-02 0.392362727E-03
308
309 # 100 day experiment with cost_ice_flag = 3 fails
310 adj grad 0.134326162+285 0.434825818+285 0.353667347+285 -.121707013+286
311 1.d-4 -.248910431E+20 -.581887317E+20 0.530805948E+18 0.554441614E+20
312
313 # 100 day experiment with cost_ice_flag = 4 fails
314 adj grad 0.942881479+279 0.305219181+280 0.248251262+280 -.854303341+280
315 1.d-4 0.550158678E+19 -.107685572E+20 -.139042495E+20 0.445855968E+20
316
317 # 100 day experiment with cost_ice_flag = 5 fails
318 adj grad 0.149606733+285 0.484290396+285 0.393899563+285 -.135552065+286
319 1.d-4 -.300535490E+20 -.689378119E+20 0.300954675E+19 0.767231924E+20
320
321
322 # With cost_ice_flag = 6, i.e., a quadratic cost function
323 # 1.d-04 -.525101466E+01 -.328685504E+03 0.267928050E+02 -.563072857E+03
324 # 1.d-03 -.313705632E+01 0.463320361E+01 -.458088751E+02 0.571140277E+00
325 # 1.d-02 -.232806373E+00 -.104311448E+01 0.173597838E+02 -.394705606E+01
326 # 1.d-01 0.515424287E+00 -.578962143E+00 0.108556846E+02 -.563596055E+00
327 # 1.d-00 -.480177391E-01 -.327366136E-02 0.107190195E+02 -.498391127E+01
328 # adj grad NAN NAN NAN NAN
329
330 # 100 day experiments with all albedos set to a constant 0.4, with
331 # IMAX_TICE=50, and with HSNOW=0 also fail with NANs
332
333 # 100-day with undef ALLOW_GMREDI
334 adj grad 0.846385475+258 0.198955589+259 0.729012228+259 0.320320183+256
335 1.d-4 -.577220699E+12 -.987464011E+12 -.342421713E+12 -.553564700E+12
336
337 # Adjoint gradient is OK for 100 days is KPP and GM
338 # are undefined in CPP_OPTIONS file:
339 adj grad 0.717330426E+06 0.106802371E+07 0.443223909E+06 -.581863641E+08
340 1.d-4 0.717581787E+06 0.106213684E+07 0.441527100E+06 -.581863293E+08
341 # Above experiment fails with NANs when extended to 375 days
342 # but it works OK is SEAICE_initialHEFF = 0.0 instead of 1.0
343 adj grad -.256772533E+05 -.782710992E+05 -.273621212E+05 -.133527839E+09
344 1.d-4 -.256640625E+05 -.779858398E+05 -.272338867E+05 -.133528066E+09
345 # 10-yr experiment with above parameters fails with NANs
346
347 # 100-day with yneg=0 in growth.F
348 adj grad -.246704815E+07 -.171229406E+09 -.113862028E+08 -.156706660E+08
349 1.d-4 -.246699463E+07 -.171229277E+09 -.113861792E+08 -.156706763E+08
350 # 375-day with yneg=0 in growth.F
351 (in progress)
352
353
354 #####################
355 # Experiment no. 11 #
356 #####################
357 >>>>>>>>>> PH: THIS ONE NOT YET UPDATED <<<<<<<<<<
358 # Same as experiment 8, but using 2-CPU MPI configuration.
359
360 # Compile code in bin/:
361 cd ../bin
362 rm -rf *.o *.f *.p rii_files
363 rm -rf *.F *.h *.c Makefile*
364 cp ../verification/natl_box_adjoint/code_seaice/*.h .
365 cp ../verification/natl_box_adjoint/code_seaice/.genmakerc .
366 cp ../verification/natl_box_adjoint/code_seaice/SIZE.h.MPI SIZE.h
367 cp ../verification/natl_box_adjoint/code_seaice/CPP_EEOPTIONS.h.MPI CPP_EEOPTIONS.h
368 # Configure and compile the code:
369 ../tools/genmake -mpi -makefile
370 # ==> on alhena use:
371 # ../tools/genmake -platform=o2k -mpi -makefile
372 make depend
373 # Generate the adjoint code:
374 cd ../adjoint
375 cp ../verification/natl_box_adjoint/code_seaice/makefile .
376 make adtaf
377 make adchange
378 rm -f makefile
379 # Go back and compile the code:
380 cd ../bin
381 make
382 # To run:
383 cd ../exe
384 cp ../verification/natl_box_adjoint/input_seaice/* .
385 cp data.001 data
386 cp ../verification/natl_box_adjoint/input_bulk/data.grdchk .
387 mpirun -np 2 mitgcmuv
388 # To verify the results of the gradient check, type:
389 grep "ph-grd 3" STDOUT.0000
390 # To plot adjoint sensitivy fields
391 cd ../verification/natl_box_adjoint/results_seaice
392 matlab
393 lookat_exp10
394
395
396 #####################
397 # Experiment no. 12 #
398 #####################
399 # Same as experiment 6, but including LSR dynamic solver.
400
401 # Compile code in build/:
402 cd ../build
403 rm -f *.o *.f *.p rii_files *.flow
404 rm -f *.F *.h *.c Makefile* *.template genmake_*
405 ../../../tools/genmake2 -ieee -mods=../code_seaice
406 cp ../code_seaice/SEAICE_OPTIONS.h.DYN SEAICE_OPTIONS.h
407 make depend
408 make adall
409 make ftlall
410
411 # To run:
412 cd ../exe
413 cp ../input_seaice/* .
414 cp data.seaice.lsr data.seaice
415 cp ../input_bulk/data.grdchk .
416 # run the ADM
417 ../build/mitgcmuv_ad >&! output.txt_adm
418 # run the TLM
419 ../build/mitgcmuv_ftl >&! output.txt_tlm
420
421 # To verify the results of the gradient check, type:
422 grep grad-res output.txt_adm
423 # A reference output is in:
424 grep grad-res ../results_seaice/output_exp12.txt_adm
425
426
427 #####################
428 # Experiment no. 13 #
429 #####################
430 # Same as experiment 12, but finite difference gradient check for
431 # air temperature is computed and compared for the complete domain.
432
433 # To run:
434 cd ../exe
435 cp ../input_seaice/* .
436 cp data.seaice.lsr data.seaice
437 ../build/mitgcmuv_ad >&! output.txt_adm
438 # To verify the results of the gradient check, type:
439 grep grad-res output.txt_adm > grad-res.txt
440 cd ../results_seaice
441 matlab
442 lookat_exp8
443
444
445 #####################
446 # Experiment no. 14 #
447 #####################
448 >>>>>>>>>> PH: THIS ONE NOT YET UPDATED <<<<<<<<<<
449 # Same as in 12 but for a 100-day sensitivity experiment.
450
451 # Compile code in bin/:
452 cd ../bin
453 rm -rf *.o *.f *.p rii_files
454 rm -rf *.F *.h *.c Makefile*
455 cp ../verification/natl_box_adjoint/code_seaice/*.h .
456 rm -f tamc.h
457 cp ../verification/natl_box_adjoint/code_seaice/.genmakerc .
458 cp ../verification/natl_box_adjoint/code_seaice/SEAICE_OPTIONS.h.MULTILEVEL SEAICE_OPTIONS.h
459 # Configure and compile the code:
460 ../tools/genmake -makefile
461 make depend
462 # Generate the adjoint code:
463 cd ../adjoint
464 cp ../verification/natl_box_adjoint/code_seaice/makefile .
465 make adtaf
466 make adchange
467 rm -f makefile
468 # Go back and compile the code:
469 cd ../bin
470 make
471 # To run:
472 cd ../exe
473 cp ../verification/natl_box_adjoint/input_seaice/* .
474 cp data.100day data
475 cp ../verification/natl_box_adjoint/input_bulk/data.grdchk .
476 cp data.seaice.lsr data.seaice
477 ../build/mitgcmuv >&! output.txt
478 # To verify the results of the gradient check, type:
479 grep "ph-grd 3" output.txt
480
481 # For 100-day experiment, with cost_ice_flag = 1, the adjoint gradient
482 # blows up, as in Exp. 10
483 # 1.d-04 0.251994583E+11 -.899637862E+10 0.372048919E+10 -.344972301E+10
484 # adj grad -.160660304+210 -.378763253+210 -.239235971+211 -.386444881+209
485
486 # With cost_ice_flag = 2, i.e., mean sea-ice area
487 # 1.d-04 -.152618243E+11 0.605974121E+06 -.155375485E+11 -.153368205E+11
488 # adj grad 0.000000000E+00 0.000000000E+00 -.124076923E+09 0.000000000E+00
489
490 # With cost_ice_flag = 6, i.e., a quadratic cost function
491 # 1.d-12 -.106128607E+12 0.106330784E+12 -.106446555E+12 -.106237252E+12
492 # 1.d-08 0.106450924E+08 0.103670536E+05 0.349155947E+05 0.335081902E+05
493 # 1.d-04 -.106143365E+04 0.206965778E+00 -.105672737E+04 -.106326894E+04
494 # 1.d-02 -.120891636E-02 0.106325012E+02 0.841459268E+01 -.107119297E+02
495 # 1.d-01 -.102221209E-02 -.124805738E-02 0.821489714E+01 -.331974254E-02
496 # 1.d-00 0.113825328E-03 -.105881751E+00 0.104550010E+02 -.106209116E+00
497 # adj grad 0.000000000E+00 0.000000000E+00 0.887775373E+01 0.000000000E+00
498
499
500 #####################
501 # Experiment no. 15 #
502 #####################
503 # Same as experiment 6, but with SEAICE_MULTILEVEL.
504
505 # Compile code in build/:
506 rm -f *.o *.f *.p rii_files *.flow
507 rm -f *.F *.h *.c Makefile* *.template genmake_*
508 ../../../tools/genmake2 -ieee -mods=../code_seaice
509 cp ../code_seaice/SEAICE_OPTIONS.h.MULTILEVEL SEAICE_OPTIONS.h
510 make depend
511 make adall
512
513 # To run:
514 cd ../exe
515 cp ../input_seaice/* .
516 cp ../input_bulk/data.grdchk .
517 ../build/mitgcmuv_ad >&! output.txt
518
519 # To verify the results of the gradient check, type:
520 grep grad-res output.txt
521 # The reference output is in:
522 grep grad-res ../results_seaice/output_exp15.txt_adm
523
524 # This test suggests that SEAICE_MULTILEVEL decreases the accuracy of
525 # the adjoint model, perhaps because the adjoint model is not handling
526 # multiple recomputations in budget properly.
527
528
529 #####################
530 # Experiment no. 20 #
531 #####################
532 # Same as experiment 10, but using divided adjoint.

  ViewVC Help
Powered by ViewVC 1.1.22