/[MITgcm]/manual/s_getstarted/text/getting_started.tex
ViewVC logotype

Contents of /manual/s_getstarted/text/getting_started.tex

Parent Directory Parent Directory | Revision Log Revision Log | View Revision Graph Revision Graph


Revision 1.22 - (show annotations) (download) (as text)
Wed Mar 24 20:53:12 2004 UTC (21 years, 3 months ago) by edhill
Branch: MAIN
Changes since 1.21: +16 -7 lines
File MIME type: application/x-tex
 o improve description of the genmake2 package selection process

1 % $Header: /u/gcmpack/manual/part3/getting_started.tex,v 1.21 2004/03/11 16:11:56 edhill Exp $
2 % $Name: $
3
4 %\section{Getting started}
5
6 In this section, we describe how to use the model. In the first
7 section, we provide enough information to help you get started with
8 the model. We believe the best way to familiarize yourself with the
9 model is to run the case study examples provided with the base
10 version. Information on how to obtain, compile, and run the code is
11 found there as well as a brief description of the model structure
12 directory and the case study examples. The latter and the code
13 structure are described more fully in chapters
14 \ref{chap:discretization} and \ref{chap:sarch}, respectively. Here, in
15 this section, we provide information on how to customize the code when
16 you are ready to try implementing the configuration you have in mind.
17
18 \section{Where to find information}
19 \label{sect:whereToFindInfo}
20
21 A web site is maintained for release 2 (``Pelican'') of MITgcm:
22 \begin{rawhtml} <A href=http://mitgcm.org/pelican/ target="idontexist"> \end{rawhtml}
23 \begin{verbatim}
24 http://mitgcm.org/pelican
25 \end{verbatim}
26 \begin{rawhtml} </A> \end{rawhtml}
27 Here you will find an on-line version of this document, a
28 ``browsable'' copy of the code and a searchable database of the model
29 and site, as well as links for downloading the model and
30 documentation, to data-sources, and other related sites.
31
32 There is also a web-archived support mailing list for the model that
33 you can email at \texttt{MITgcm-support@mitgcm.org} or browse at:
34 \begin{rawhtml} <A href=http://mitgcm.org/mailman/listinfo/mitgcm-support/ target="idontexist"> \end{rawhtml}
35 \begin{verbatim}
36 http://mitgcm.org/mailman/listinfo/mitgcm-support/
37 http://mitgcm.org/pipermail/mitgcm-support/
38 \end{verbatim}
39 \begin{rawhtml} </A> \end{rawhtml}
40 Essentially all of the MITgcm web pages can be searched using a
41 popular web crawler such as Google or through our own search facility:
42 \begin{rawhtml} <A href=http://mitgcm.org/mailman/htdig/ target="idontexist"> \end{rawhtml}
43 \begin{verbatim}
44 http://mitgcm.org/htdig/
45 \end{verbatim}
46 \begin{rawhtml} </A> \end{rawhtml}
47 %%% http://www.google.com/search?q=hydrostatic+site%3Amitgcm.org
48
49
50
51 \section{Obtaining the code}
52 \label{sect:obtainingCode}
53
54 MITgcm can be downloaded from our system by following
55 the instructions below. As a courtesy we ask that you send e-mail to us at
56 \begin{rawhtml} <A href=mailto:MITgcm-support@mitgcm.org> \end{rawhtml}
57 MITgcm-support@mitgcm.org
58 \begin{rawhtml} </A> \end{rawhtml}
59 to enable us to keep track of who's using the model and in what application.
60 You can download the model two ways:
61
62 \begin{enumerate}
63 \item Using CVS software. CVS is a freely available source code management
64 tool. To use CVS you need to have the software installed. Many systems
65 come with CVS pre-installed, otherwise good places to look for
66 the software for a particular platform are
67 \begin{rawhtml} <A href=http://www.cvshome.org/ target="idontexist"> \end{rawhtml}
68 cvshome.org
69 \begin{rawhtml} </A> \end{rawhtml}
70 and
71 \begin{rawhtml} <A href=http://www.wincvs.org/ target="idontexist"> \end{rawhtml}
72 wincvs.org
73 \begin{rawhtml} </A> \end{rawhtml}
74 .
75
76 \item Using a tar file. This method is simple and does not
77 require any special software. However, this method does not
78 provide easy support for maintenance updates.
79
80 \end{enumerate}
81
82 \subsubsection{Checkout from CVS}
83 \label{sect:cvs_checkout}
84
85 If CVS is available on your system, we strongly encourage you to use it. CVS
86 provides an efficient and elegant way of organizing your code and keeping
87 track of your changes. If CVS is not available on your machine, you can also
88 download a tar file.
89
90 Before you can use CVS, the following environment variable(s) should
91 be set within your shell. For a csh or tcsh shell, put the following
92 \begin{verbatim}
93 % setenv CVSROOT :pserver:cvsanon@mitgcm.org:/u/gcmpack
94 \end{verbatim}
95 in your .cshrc or .tcshrc file. For bash or sh shells, put:
96 \begin{verbatim}
97 % export CVSROOT=':pserver:cvsanon@mitgcm.org:/u/gcmpack'
98 \end{verbatim}
99 in your \texttt{.profile} or \texttt{.bashrc} file.
100
101
102 To get MITgcm through CVS, first register with the MITgcm CVS server
103 using command:
104 \begin{verbatim}
105 % cvs login ( CVS password: cvsanon )
106 \end{verbatim}
107 You only need to do a ``cvs login'' once.
108
109 To obtain the latest sources type:
110 \begin{verbatim}
111 % cvs co MITgcm
112 \end{verbatim}
113 or to get a specific release type:
114 \begin{verbatim}
115 % cvs co -P -r checkpoint52i_post MITgcm
116 \end{verbatim}
117 The MITgcm web site contains further directions concerning the source
118 code and CVS. It also contains a web interface to our CVS archive so
119 that one may easily view the state of files, revisions, and other
120 development milestones:
121 \begin{rawhtml} <A href=''http://mitgcm.org/download'' target="idontexist"> \end{rawhtml}
122 \begin{verbatim}
123 http://mitgcm.org/source_code.html
124 \end{verbatim}
125 \begin{rawhtml} </A> \end{rawhtml}
126
127 As a convenience, the MITgcm CVS server contains aliases which are
128 named subsets of the codebase. These aliases can be especially
129 helpful when used over slow internet connections or on machines with
130 restricted storage space. Table \ref{tab:cvsModules} contains a list
131 of CVS aliases
132 \begin{table}[htb]
133 \centering
134 \begin{tabular}[htb]{|lp{3.25in}|}\hline
135 \textbf{Alias Name} & \textbf{Information (directories) Contained} \\\hline
136 \texttt{MITgcm\_code} & Only the source code -- none of the verification examples. \\
137 \texttt{MITgcm\_verif\_basic}
138 & Source code plus a small set of the verification examples
139 (\texttt{global\_ocean.90x40x15}, \texttt{aim.5l\_cs}, \texttt{hs94.128x64x5},
140 \texttt{front\_relax}, and \texttt{plume\_on\_slope}). \\
141 \texttt{MITgcm\_verif\_atmos} & Source code plus all of the atmospheric examples. \\
142 \texttt{MITgcm\_verif\_ocean} & Source code plus all of the oceanic examples. \\
143 \texttt{MITgcm\_verif\_all} & Source code plus all of the
144 verification examples. \\\hline
145 \end{tabular}
146 \caption{MITgcm CVS Modules}
147 \label{tab:cvsModules}
148 \end{table}
149
150 The checkout process creates a directory called \textit{MITgcm}. If
151 the directory \textit{MITgcm} exists this command updates your code
152 based on the repository. Each directory in the source tree contains a
153 directory \textit{CVS}. This information is required by CVS to keep
154 track of your file versions with respect to the repository. Don't edit
155 the files in \textit{CVS}! You can also use CVS to download code
156 updates. More extensive information on using CVS for maintaining
157 MITgcm code can be found
158 \begin{rawhtml} <A href=''http://mitgcm.org/usingcvstoget.html'' target="idontexist"> \end{rawhtml}
159 here
160 \begin{rawhtml} </A> \end{rawhtml}
161 .
162 It is important to note that the CVS aliases in Table
163 \ref{tab:cvsModules} cannot be used in conjunction with the CVS
164 \texttt{-d DIRNAME} option. However, the \texttt{MITgcm} directories
165 they create can be changed to a different name following the check-out:
166 \begin{verbatim}
167 % cvs co MITgcm_verif_basic
168 % mv MITgcm MITgcm_verif_basic
169 \end{verbatim}
170
171
172 \subsubsection{Conventional download method}
173 \label{sect:conventionalDownload}
174
175 If you do not have CVS on your system, you can download the model as a
176 tar file from the web site at:
177 \begin{rawhtml} <A href=http://mitgcm.org/download target="idontexist"> \end{rawhtml}
178 \begin{verbatim}
179 http://mitgcm.org/download/
180 \end{verbatim}
181 \begin{rawhtml} </A> \end{rawhtml}
182 The tar file still contains CVS information which we urge you not to
183 delete; even if you do not use CVS yourself the information can help
184 us if you should need to send us your copy of the code. If a recent
185 tar file does not exist, then please contact the developers through
186 the
187 \begin{rawhtml} <A href=''mailto:MITgcm-support@mitgcm.org"> \end{rawhtml}
188 MITgcm-support@mitgcm.org
189 \begin{rawhtml} </A> \end{rawhtml}
190 mailing list.
191
192 \subsubsection{Upgrading from an earlier version}
193
194 If you already have an earlier version of the code you can ``upgrade''
195 your copy instead of downloading the entire repository again. First,
196 ``cd'' (change directory) to the top of your working copy:
197 \begin{verbatim}
198 % cd MITgcm
199 \end{verbatim}
200 and then issue the cvs update command such as:
201 \begin{verbatim}
202 % cvs -q update -r checkpoint52i_post -d -P
203 \end{verbatim}
204 This will update the ``tag'' to ``checkpoint52i\_post'', add any new
205 directories (-d) and remove any empty directories (-P). The -q option
206 means be quiet which will reduce the number of messages you'll see in
207 the terminal. If you have modified the code prior to upgrading, CVS
208 will try to merge your changes with the upgrades. If there is a
209 conflict between your modifications and the upgrade, it will report
210 that file with a ``C'' in front, e.g.:
211 \begin{verbatim}
212 C model/src/ini_parms.F
213 \end{verbatim}
214 If the list of conflicts scrolled off the screen, you can re-issue the
215 cvs update command and it will report the conflicts. Conflicts are
216 indicated in the code by the delimites ``$<<<<<<<$'', ``======='' and
217 ``$>>>>>>>$''. For example,
218 {\small
219 \begin{verbatim}
220 <<<<<<< ini_parms.F
221 & bottomDragLinear,myOwnBottomDragCoefficient,
222 =======
223 & bottomDragLinear,bottomDragQuadratic,
224 >>>>>>> 1.18
225 \end{verbatim}
226 }
227 means that you added ``myOwnBottomDragCoefficient'' to a namelist at
228 the same time and place that we added ``bottomDragQuadratic''. You
229 need to resolve this conflict and in this case the line should be
230 changed to:
231 {\small
232 \begin{verbatim}
233 & bottomDragLinear,bottomDragQuadratic,myOwnBottomDragCoefficient,
234 \end{verbatim}
235 }
236 and the lines with the delimiters ($<<<<<<$,======,$>>>>>>$) be deleted.
237 Unless you are making modifications which exactly parallel
238 developments we make, these types of conflicts should be rare.
239
240 \paragraph*{Upgrading to the current pre-release version}
241
242 We don't make a ``release'' for every little patch and bug fix in
243 order to keep the frequency of upgrades to a minimum. However, if you
244 have run into a problem for which ``we have already fixed in the
245 latest code'' and we haven't made a ``tag'' or ``release'' since that
246 patch then you'll need to get the latest code:
247 \begin{verbatim}
248 % cvs -q update -A -d -P
249 \end{verbatim}
250 Unlike, the ``check-out'' and ``update'' procedures above, there is no
251 ``tag'' or release name. The -A tells CVS to upgrade to the
252 very latest version. As a rule, we don't recommend this since you
253 might upgrade while we are in the processes of checking in the code so
254 that you may only have part of a patch. Using this method of updating
255 also means we can't tell what version of the code you are working
256 with. So please be sure you understand what you're doing.
257
258 \section{Model and directory structure}
259
260 The ``numerical'' model is contained within a execution environment
261 support wrapper. This wrapper is designed to provide a general
262 framework for grid-point models. MITgcmUV is a specific numerical
263 model that uses the framework. Under this structure the model is split
264 into execution environment support code and conventional numerical
265 model code. The execution environment support code is held under the
266 \textit{eesupp} directory. The grid point model code is held under the
267 \textit{model} directory. Code execution actually starts in the
268 \textit{eesupp} routines and not in the \textit{model} routines. For
269 this reason the top-level \textit{MAIN.F} is in the
270 \textit{eesupp/src} directory. In general, end-users should not need
271 to worry about this level. The top-level routine for the numerical
272 part of the code is in \textit{model/src/THE\_MODEL\_MAIN.F}. Here is
273 a brief description of the directory structure of the model under the
274 root tree (a detailed description is given in section 3: Code
275 structure).
276
277 \begin{itemize}
278
279 \item \textit{bin}: this directory is initially empty. It is the
280 default directory in which to compile the code.
281
282 \item \textit{diags}: contains the code relative to time-averaged
283 diagnostics. It is subdivided into two subdirectories \textit{inc}
284 and \textit{src} that contain include files (*.\textit{h} files) and
285 Fortran subroutines (*.\textit{F} files), respectively.
286
287 \item \textit{doc}: contains brief documentation notes.
288
289 \item \textit{eesupp}: contains the execution environment source code.
290 Also subdivided into two subdirectories \textit{inc} and
291 \textit{src}.
292
293 \item \textit{exe}: this directory is initially empty. It is the
294 default directory in which to execute the code.
295
296 \item \textit{model}: this directory contains the main source code.
297 Also subdivided into two subdirectories \textit{inc} and
298 \textit{src}.
299
300 \item \textit{pkg}: contains the source code for the packages. Each
301 package corresponds to a subdirectory. For example, \textit{gmredi}
302 contains the code related to the Gent-McWilliams/Redi scheme,
303 \textit{aim} the code relative to the atmospheric intermediate
304 physics. The packages are described in detail in section 3.
305
306 \item \textit{tools}: this directory contains various useful tools.
307 For example, \textit{genmake2} is a script written in csh (C-shell)
308 that should be used to generate your makefile. The directory
309 \textit{adjoint} contains the makefile specific to the Tangent
310 linear and Adjoint Compiler (TAMC) that generates the adjoint code.
311 The latter is described in details in part V.
312
313 \item \textit{utils}: this directory contains various utilities. The
314 subdirectory \textit{knudsen2} contains code and a makefile that
315 compute coefficients of the polynomial approximation to the knudsen
316 formula for an ocean nonlinear equation of state. The
317 \textit{matlab} subdirectory contains matlab scripts for reading
318 model output directly into matlab. \textit{scripts} contains C-shell
319 post-processing scripts for joining processor-based and tiled-based
320 model output.
321
322 \item \textit{verification}: this directory contains the model
323 examples. See section \ref{sect:modelExamples}.
324
325 \end{itemize}
326
327 \section{Example experiments}
328 \label{sect:modelExamples}
329
330 %% a set of twenty-four pre-configured numerical experiments
331
332 The MITgcm distribution comes with more than a dozen pre-configured
333 numerical experiments. Some of these example experiments are tests of
334 individual parts of the model code, but many are fully fledged
335 numerical simulations. A few of the examples are used for tutorial
336 documentation in sections \ref{sect:eg-baro} - \ref{sect:eg-global}.
337 The other examples follow the same general structure as the tutorial
338 examples. However, they only include brief instructions in a text file
339 called {\it README}. The examples are located in subdirectories under
340 the directory \textit{verification}. Each example is briefly described
341 below.
342
343 \subsection{Full list of model examples}
344
345 \begin{enumerate}
346
347 \item \textit{exp0} - single layer, ocean double gyre (barotropic with
348 free-surface). This experiment is described in detail in section
349 \ref{sect:eg-baro}.
350
351 \item \textit{exp1} - Four layer, ocean double gyre. This experiment
352 is described in detail in section \ref{sect:eg-baroc}.
353
354 \item \textit{exp2} - 4x4 degree global ocean simulation with steady
355 climatological forcing. This experiment is described in detail in
356 section \ref{sect:eg-global}.
357
358 \item \textit{exp4} - Flow over a Gaussian bump in open-water or
359 channel with open boundaries.
360
361 \item \textit{exp5} - Inhomogenously forced ocean convection in a
362 doubly periodic box.
363
364 \item \textit{front\_relax} - Relaxation of an ocean thermal front (test for
365 Gent/McWilliams scheme). 2D (Y-Z).
366
367 \item \textit{internal wave} - Ocean internal wave forced by open
368 boundary conditions.
369
370 \item \textit{natl\_box} - Eastern subtropical North Atlantic with KPP
371 scheme; 1 month integration
372
373 \item \textit{hs94.1x64x5} - Zonal averaged atmosphere using Held and
374 Suarez '94 forcing.
375
376 \item \textit{hs94.128x64x5} - 3D atmosphere dynamics using Held and
377 Suarez '94 forcing.
378
379 \item \textit{hs94.cs-32x32x5} - 3D atmosphere dynamics using Held and
380 Suarez '94 forcing on the cubed sphere.
381
382 \item \textit{aim.5l\_zon-ave} - Intermediate Atmospheric physics.
383 Global Zonal Mean configuration, 1x64x5 resolution.
384
385 \item \textit{aim.5l\_XZ\_Equatorial\_Slice} - Intermediate
386 Atmospheric physics, equatorial Slice configuration. 2D (X-Z).
387
388 \item \textit{aim.5l\_Equatorial\_Channel} - Intermediate Atmospheric
389 physics. 3D Equatorial Channel configuration.
390
391 \item \textit{aim.5l\_LatLon} - Intermediate Atmospheric physics.
392 Global configuration, on latitude longitude grid with 128x64x5 grid
393 points ($2.8^\circ{\rm degree}$ resolution).
394
395 \item \textit{adjustment.128x64x1} Barotropic adjustment problem on
396 latitude longitude grid with 128x64 grid points ($2.8^\circ{\rm
397 degree}$ resolution).
398
399 \item \textit{adjustment.cs-32x32x1} Barotropic adjustment problem on
400 cube sphere grid with 32x32 points per face ( roughly $2.8^\circ{\rm
401 degree}$ resolution).
402
403 \item \textit{advect\_cs} Two-dimensional passive advection test on
404 cube sphere grid.
405
406 \item \textit{advect\_xy} Two-dimensional (horizontal plane) passive
407 advection test on Cartesian grid.
408
409 \item \textit{advect\_yz} Two-dimensional (vertical plane) passive
410 advection test on Cartesian grid.
411
412 \item \textit{carbon} Simple passive tracer experiment. Includes
413 derivative calculation. Described in detail in section
414 \ref{sect:eg-carbon-ad}.
415
416 \item \textit{flt\_example} Example of using float package.
417
418 \item \textit{global\_ocean.90x40x15} Global circulation with GM, flux
419 boundary conditions and poles.
420
421 \item \textit{global\_ocean\_pressure} Global circulation in pressure
422 coordinate (non-Boussinesq ocean model). Described in detail in
423 section \ref{sect:eg-globalpressure}.
424
425 \item \textit{solid-body.cs-32x32x1} Solid body rotation test for cube
426 sphere grid.
427
428 \end{enumerate}
429
430 \subsection{Directory structure of model examples}
431
432 Each example directory has the following subdirectories:
433
434 \begin{itemize}
435 \item \textit{code}: contains the code particular to the example. At a
436 minimum, this directory includes the following files:
437
438 \begin{itemize}
439 \item \textit{code/CPP\_EEOPTIONS.h}: declares CPP keys relative to
440 the ``execution environment'' part of the code. The default
441 version is located in \textit{eesupp/inc}.
442
443 \item \textit{code/CPP\_OPTIONS.h}: declares CPP keys relative to
444 the ``numerical model'' part of the code. The default version is
445 located in \textit{model/inc}.
446
447 \item \textit{code/SIZE.h}: declares size of underlying
448 computational grid. The default version is located in
449 \textit{model/inc}.
450 \end{itemize}
451
452 In addition, other include files and subroutines might be present in
453 \textit{code} depending on the particular experiment. See Section 2
454 for more details.
455
456 \item \textit{input}: contains the input data files required to run
457 the example. At a minimum, the \textit{input} directory contains the
458 following files:
459
460 \begin{itemize}
461 \item \textit{input/data}: this file, written as a namelist,
462 specifies the main parameters for the experiment.
463
464 \item \textit{input/data.pkg}: contains parameters relative to the
465 packages used in the experiment.
466
467 \item \textit{input/eedata}: this file contains ``execution
468 environment'' data. At present, this consists of a specification
469 of the number of threads to use in $X$ and $Y$ under multithreaded
470 execution.
471 \end{itemize}
472
473 In addition, you will also find in this directory the forcing and
474 topography files as well as the files describing the initial state
475 of the experiment. This varies from experiment to experiment. See
476 section 2 for more details.
477
478 \item \textit{results}: this directory contains the output file
479 \textit{output.txt} produced by the simulation example. This file is
480 useful for comparison with your own output when you run the
481 experiment.
482 \end{itemize}
483
484 Once you have chosen the example you want to run, you are ready to
485 compile the code.
486
487 \section{Building the code}
488 \label{sect:buildingCode}
489
490 To compile the code, we use the {\em make} program. This uses a file
491 ({\em Makefile}) that allows us to pre-process source files, specify
492 compiler and optimization options and also figures out any file
493 dependencies. We supply a script ({\em genmake2}), described in
494 section \ref{sect:genmake}, that automatically creates the {\em
495 Makefile} for you. You then need to build the dependencies and
496 compile the code.
497
498 As an example, let's assume that you want to build and run experiment
499 \textit{verification/exp2}. The are multiple ways and places to
500 actually do this but here let's build the code in
501 \textit{verification/exp2/input}:
502 \begin{verbatim}
503 % cd verification/exp2/input
504 \end{verbatim}
505 First, build the {\em Makefile}:
506 \begin{verbatim}
507 % ../../../tools/genmake2 -mods=../code
508 \end{verbatim}
509 The command line option tells {\em genmake} to override model source
510 code with any files in the directory {\em ./code/}.
511
512 On many systems, the {\em genmake2} program will be able to
513 automatically recognize the hardware, find compilers and other tools
514 within the user's path (``echo \$PATH''), and then choose an
515 appropriate set of options from the files contained in the {\em
516 tools/build\_options} directory. Under some circumstances, a user
517 may have to create a new ``optfile'' in order to specify the exact
518 combination of compiler, compiler flags, libraries, and other options
519 necessary to build a particular configuration of MITgcm. In such
520 cases, it is generally helpful to read the existing ``optfiles'' and
521 mimic their syntax.
522
523 Through the MITgcm-support list, the MITgcm developers are willing to
524 provide help writing or modifing ``optfiles''. And we encourage users
525 to post new ``optfiles'' (particularly ones for new machines or
526 architectures) to the
527 \begin{rawhtml} <A href=''mailto:MITgcm-support@mitgcm.org"> \end{rawhtml}
528 MITgcm-support@mitgcm.org
529 \begin{rawhtml} </A> \end{rawhtml}
530 list.
531
532 To specify an optfile to {\em genmake2}, the syntax is:
533 \begin{verbatim}
534 % ../../../tools/genmake2 -mods=../code -of /path/to/optfile
535 \end{verbatim}
536
537 Once a {\em Makefile} has been generated, we create the dependencies:
538 \begin{verbatim}
539 % make depend
540 \end{verbatim}
541 This modifies the {\em Makefile} by attaching a [long] list of files
542 upon which other files depend. The purpose of this is to reduce
543 re-compilation if and when you start to modify the code. The {\tt make
544 depend} command also creates links from the model source to this
545 directory.
546
547 Next compile the code:
548 \begin{verbatim}
549 % make
550 \end{verbatim}
551 The {\tt make} command creates an executable called \textit{mitgcmuv}.
552 Additional make ``targets'' are defined within the makefile to aid in
553 the production of adjoint and other versions of MITgcm.
554
555 Now you are ready to run the model. General instructions for doing so are
556 given in section \ref{sect:runModel}. Here, we can run the model with:
557 \begin{verbatim}
558 ./mitgcmuv > output.txt
559 \end{verbatim}
560 where we are re-directing the stream of text output to the file {\em
561 output.txt}.
562
563
564 \subsection{Building/compiling the code elsewhere}
565
566 In the example above (section \ref{sect:buildingCode}) we built the
567 executable in the {\em input} directory of the experiment for
568 convenience. You can also configure and compile the code in other
569 locations, for example on a scratch disk with out having to copy the
570 entire source tree. The only requirement to do so is you have {\tt
571 genmake2} in your path or you know the absolute path to {\tt
572 genmake2}.
573
574 The following sections outline some possible methods of organizing
575 your source and data.
576
577 \subsubsection{Building from the {\em ../code directory}}
578
579 This is just as simple as building in the {\em input/} directory:
580 \begin{verbatim}
581 % cd verification/exp2/code
582 % ../../../tools/genmake2
583 % make depend
584 % make
585 \end{verbatim}
586 However, to run the model the executable ({\em mitgcmuv}) and input
587 files must be in the same place. If you only have one calculation to make:
588 \begin{verbatim}
589 % cd ../input
590 % cp ../code/mitgcmuv ./
591 % ./mitgcmuv > output.txt
592 \end{verbatim}
593 or if you will be making multiple runs with the same executable:
594 \begin{verbatim}
595 % cd ../
596 % cp -r input run1
597 % cp code/mitgcmuv run1
598 % cd run1
599 % ./mitgcmuv > output.txt
600 \end{verbatim}
601
602 \subsubsection{Building from a new directory}
603
604 Since the {\em input} directory contains input files it is often more
605 useful to keep {\em input} pristine and build in a new directory
606 within {\em verification/exp2/}:
607 \begin{verbatim}
608 % cd verification/exp2
609 % mkdir build
610 % cd build
611 % ../../../tools/genmake2 -mods=../code
612 % make depend
613 % make
614 \end{verbatim}
615 This builds the code exactly as before but this time you need to copy
616 either the executable or the input files or both in order to run the
617 model. For example,
618 \begin{verbatim}
619 % cp ../input/* ./
620 % ./mitgcmuv > output.txt
621 \end{verbatim}
622 or if you tend to make multiple runs with the same executable then
623 running in a new directory each time might be more appropriate:
624 \begin{verbatim}
625 % cd ../
626 % mkdir run1
627 % cp build/mitgcmuv run1/
628 % cp input/* run1/
629 % cd run1
630 % ./mitgcmuv > output.txt
631 \end{verbatim}
632
633 \subsubsection{Building on a scratch disk}
634
635 Model object files and output data can use up large amounts of disk
636 space so it is often the case that you will be operating on a large
637 scratch disk. Assuming the model source is in {\em ~/MITgcm} then the
638 following commands will build the model in {\em /scratch/exp2-run1}:
639 \begin{verbatim}
640 % cd /scratch/exp2-run1
641 % ~/MITgcm/tools/genmake2 -rootdir=~/MITgcm \
642 -mods=~/MITgcm/verification/exp2/code
643 % make depend
644 % make
645 \end{verbatim}
646 To run the model here, you'll need the input files:
647 \begin{verbatim}
648 % cp ~/MITgcm/verification/exp2/input/* ./
649 % ./mitgcmuv > output.txt
650 \end{verbatim}
651
652 As before, you could build in one directory and make multiple runs of
653 the one experiment:
654 \begin{verbatim}
655 % cd /scratch/exp2
656 % mkdir build
657 % cd build
658 % ~/MITgcm/tools/genmake2 -rootdir=~/MITgcm \
659 -mods=~/MITgcm/verification/exp2/code
660 % make depend
661 % make
662 % cd ../
663 % cp -r ~/MITgcm/verification/exp2/input run2
664 % cd run2
665 % ./mitgcmuv > output.txt
666 \end{verbatim}
667
668
669
670 \subsection{Using \textit{genmake2}}
671 \label{sect:genmake}
672
673 To compile the code, first use the program \texttt{genmake2} (located
674 in the \textit{tools} directory) to generate a Makefile.
675 \texttt{genmake2} is a shell script written to work with all
676 ``sh''--compatible shells including bash v1, bash v2, and Bourne.
677 Internally, \texttt{genmake2} determines the locations of needed
678 files, the compiler, compiler options, libraries, and Unix tools. It
679 relies upon a number of ``optfiles'' located in the {\em
680 tools/build\_options} directory.
681
682 The purpose of the optfiles is to provide all the compilation options
683 for particular ``platforms'' (where ``platform'' roughly means the
684 combination of the hardware and the compiler) and code configurations.
685 Given the combinations of possible compilers and library dependencies
686 ({\it eg.} MPI and NetCDF) there may be numerous optfiles available
687 for a single machine. The naming scheme for the majority of the
688 optfiles shipped with the code is
689 \begin{center}
690 {\bf OS\_HARDWARE\_COMPILER }
691 \end{center}
692 where
693 \begin{description}
694 \item[OS] is the name of the operating system (generally the
695 lower-case output of the {\tt 'uname'} command)
696 \item[HARDWARE] is a string that describes the CPU type and
697 corresponds to output from the {\tt 'uname -m'} command:
698 \begin{description}
699 \item[ia32] is for ``x86'' machines such as i386, i486, i586, i686,
700 and athlon
701 \item[ia64] is for Intel IA64 systems (eg. Itanium, Itanium2)
702 \item[amd64] is AMD x86\_64 systems
703 \item[ppc] is for Mac PowerPC systems
704 \end{description}
705 \item[COMPILER] is the compiler name (generally, the name of the
706 FORTRAN executable)
707 \end{description}
708
709 In many cases, the default optfiles are sufficient and will result in
710 usable Makefiles. However, for some machines or code configurations,
711 new ``optfiles'' must be written. To create a new optfile, it is
712 generally best to start with one of the defaults and modify it to suit
713 your needs. Like \texttt{genmake2}, the optfiles are all written
714 using a simple ``sh''--compatible syntax. While nearly all variables
715 used within \texttt{genmake2} may be specified in the optfiles, the
716 critical ones that should be defined are:
717
718 \begin{description}
719 \item[FC] the FORTRAN compiler (executable) to use
720 \item[DEFINES] the command-line DEFINE options passed to the compiler
721 \item[CPP] the C pre-processor to use
722 \item[NOOPTFLAGS] options flags for special files that should not be
723 optimized
724 \end{description}
725
726 For example, the optfile for a typical Red Hat Linux machine (``ia32''
727 architecture) using the GCC (g77) compiler is
728 \begin{verbatim}
729 FC=g77
730 DEFINES='-D_BYTESWAPIO -DWORDLENGTH=4'
731 CPP='cpp -traditional -P'
732 NOOPTFLAGS='-O0'
733 # For IEEE, use the "-ffloat-store" option
734 if test "x$IEEE" = x ; then
735 FFLAGS='-Wimplicit -Wunused -Wuninitialized'
736 FOPTIM='-O3 -malign-double -funroll-loops'
737 else
738 FFLAGS='-Wimplicit -Wunused -ffloat-store'
739 FOPTIM='-O0 -malign-double'
740 fi
741 \end{verbatim}
742
743 If you write an optfile for an unrepresented machine or compiler, you
744 are strongly encouraged to submit the optfile to the MITgcm project
745 for inclusion. Please send the file to the
746 \begin{rawhtml} <A href="mail-to:MITgcm-support@mitgcm.org"> \end{rawhtml}
747 \begin{center}
748 MITgcm-support@mitgcm.org
749 \end{center}
750 \begin{rawhtml} </A> \end{rawhtml}
751 mailing list.
752
753 In addition to the optfiles, \texttt{genmake2} supports a number of
754 helpful command-line options. A complete list of these options can be
755 obtained from:
756 \begin{verbatim}
757 % genmake2 -h
758 \end{verbatim}
759
760 The most important command-line options are:
761 \begin{description}
762
763 \item[\texttt{--optfile=/PATH/FILENAME}] specifies the optfile that
764 should be used for a particular build.
765
766 If no "optfile" is specified (either through the command line or the
767 MITGCM\_OPTFILE environment variable), genmake2 will try to make a
768 reasonable guess from the list provided in {\em
769 tools/build\_options}. The method used for making this guess is
770 to first determine the combination of operating system and hardware
771 (eg. "linux\_ia32") and then find a working FORTRAN compiler within
772 the user's path. When these three items have been identified,
773 genmake2 will try to find an optfile that has a matching name.
774
775 \item[\texttt{--pdefault='PKG1 PKG2 PKG3 ...'}] specifies the default
776 set of packages to be used. The normal order of precedence for
777 packages is as follows:
778 \begin{enumerate}
779 \item If available, the command line (\texttt{--pdefault}) settings
780 over-rule any others.
781
782 \item Next, \texttt{genmake2} will look for a file named
783 ``\texttt{packages.conf}'' in the local directory or in any of the
784 directories specified with the \texttt{--mods} option.
785
786 \item Finally, if neither of the above are available,
787 \texttt{genmake2} will use the \texttt{/pkg/pkg\_default} file.
788 \end{enumerate}
789
790 \item[\texttt{--pdepend=/PATH/FILENAME}] specifies the dependency file
791 used for packages.
792
793 If not specified, the default dependency file {\em pkg/pkg\_depend}
794 is used. The syntax for this file is parsed on a line-by-line basis
795 where each line containes either a comment ("\#") or a simple
796 "PKGNAME1 (+|-)PKGNAME2" pairwise rule where the "+" or "-" symbol
797 specifies a "must be used with" or a "must not be used with"
798 relationship, respectively. If no rule is specified, then it is
799 assumed that the two packages are compatible and will function
800 either with or without each other.
801
802 \item[\texttt{--adof=/path/to/file}] specifies the "adjoint" or
803 automatic differentiation options file to be used. The file is
804 analogous to the ``optfile'' defined above but it specifies
805 information for the AD build process.
806
807 The default file is located in {\em
808 tools/adjoint\_options/adjoint\_default} and it defines the "TAF"
809 and "TAMC" compilers. An alternate version is also available at
810 {\em tools/adjoint\_options/adjoint\_staf} that selects the newer
811 "STAF" compiler. As with any compilers, it is helpful to have their
812 directories listed in your {\tt \$PATH} environment variable.
813
814 \item[\texttt{--mods='DIR1 DIR2 DIR3 ...'}] specifies a list of
815 directories containing ``modifications''. These directories contain
816 files with names that may (or may not) exist in the main MITgcm
817 source tree but will be overridden by any identically-named sources
818 within the ``MODS'' directories.
819
820 The order of precedence for this "name-hiding" is as follows:
821 \begin{itemize}
822 \item ``MODS'' directories (in the order given)
823 \item Packages either explicitly specified or provided by default
824 (in the order given)
825 \item Packages included due to package dependencies (in the order
826 that that package dependencies are parsed)
827 \item The "standard dirs" (which may have been specified by the
828 ``-standarddirs'' option)
829 \end{itemize}
830
831 \item[\texttt{--make=/path/to/gmake}] Due to the poor handling of
832 soft-links and other bugs common with the \texttt{make} versions
833 provided by commercial Unix vendors, GNU \texttt{make} (sometimes
834 called \texttt{gmake}) should be preferred. This option provides a
835 means for specifying the make executable to be used.
836
837 \item[\texttt{--bash=/path/to/sh}] On some (usually older UNIX)
838 machines, the ``bash'' shell is unavailable. To run on these
839 systems, \texttt{genmake2} can be invoked using an ``sh'' (that is,
840 a Bourne, POSIX, or compatible) shell. The syntax in these
841 circumstances is:
842 \begin{center}
843 \texttt{/bin/sh genmake2 -bash=/bin/sh [...options...]}
844 \end{center}
845 where \texttt{/bin/sh} can be replaced with the full path and name
846 of the desired shell.
847
848 \end{description}
849
850
851
852 \section{Running the model}
853 \label{sect:runModel}
854
855 If compilation finished succesfuully (section \ref{sect:buildModel})
856 then an executable called {\em mitgcmuv} will now exist in the local
857 directory.
858
859 To run the model as a single process (ie. not in parallel) simply
860 type:
861 \begin{verbatim}
862 % ./mitgcmuv
863 \end{verbatim}
864 The ``./'' is a safe-guard to make sure you use the local executable
865 in case you have others that exist in your path (surely odd if you
866 do!). The above command will spew out many lines of text output to
867 your screen. This output contains details such as parameter values as
868 well as diagnostics such as mean Kinetic energy, largest CFL number,
869 etc. It is worth keeping this text output with the binary output so we
870 normally re-direct the {\em stdout} stream as follows:
871 \begin{verbatim}
872 % ./mitgcmuv > output.txt
873 \end{verbatim}
874
875 For the example experiments in {\em verification}, an example of the
876 output is kept in {\em results/output.txt} for comparison. You can compare
877 your {\em output.txt} with this one to check that the set-up works.
878
879
880
881 \subsection{Output files}
882
883 The model produces various output files. At a minimum, the instantaneous
884 ``state'' of the model is written out, which is made of the following files:
885
886 \begin{itemize}
887 \item \textit{U.00000nIter} - zonal component of velocity field (m/s and $>
888 0 $ eastward).
889
890 \item \textit{V.00000nIter} - meridional component of velocity field (m/s
891 and $> 0$ northward).
892
893 \item \textit{W.00000nIter} - vertical component of velocity field (ocean:
894 m/s and $> 0$ upward, atmosphere: Pa/s and $> 0$ towards increasing pressure
895 i.e. downward).
896
897 \item \textit{T.00000nIter} - potential temperature (ocean: $^{0}$C,
898 atmosphere: $^{0}$K).
899
900 \item \textit{S.00000nIter} - ocean: salinity (psu), atmosphere: water vapor
901 (g/kg).
902
903 \item \textit{Eta.00000nIter} - ocean: surface elevation (m), atmosphere:
904 surface pressure anomaly (Pa).
905 \end{itemize}
906
907 The chain \textit{00000nIter} consists of ten figures that specify the
908 iteration number at which the output is written out. For example, \textit{%
909 U.0000000300} is the zonal velocity at iteration 300.
910
911 In addition, a ``pickup'' or ``checkpoint'' file called:
912
913 \begin{itemize}
914 \item \textit{pickup.00000nIter}
915 \end{itemize}
916
917 is written out. This file represents the state of the model in a condensed
918 form and is used for restarting the integration. If the C-D scheme is used,
919 there is an additional ``pickup'' file:
920
921 \begin{itemize}
922 \item \textit{pickup\_cd.00000nIter}
923 \end{itemize}
924
925 containing the D-grid velocity data and that has to be written out as well
926 in order to restart the integration. Rolling checkpoint files are the same
927 as the pickup files but are named differently. Their name contain the chain
928 \textit{ckptA} or \textit{ckptB} instead of \textit{00000nIter}. They can be
929 used to restart the model but are overwritten every other time they are
930 output to save disk space during long integrations.
931
932 \subsection{Looking at the output}
933
934 All the model data are written according to a ``meta/data'' file format.
935 Each variable is associated with two files with suffix names \textit{.data}
936 and \textit{.meta}. The \textit{.data} file contains the data written in
937 binary form (big\_endian by default). The \textit{.meta} file is a
938 ``header'' file that contains information about the size and the structure
939 of the \textit{.data} file. This way of organizing the output is
940 particularly useful when running multi-processors calculations. The base
941 version of the model includes a few matlab utilities to read output files
942 written in this format. The matlab scripts are located in the directory
943 \textit{utils/matlab} under the root tree. The script \textit{rdmds.m} reads
944 the data. Look at the comments inside the script to see how to use it.
945
946 Some examples of reading and visualizing some output in {\em Matlab}:
947 \begin{verbatim}
948 % matlab
949 >> H=rdmds('Depth');
950 >> contourf(H');colorbar;
951 >> title('Depth of fluid as used by model');
952
953 >> eta=rdmds('Eta',10);
954 >> imagesc(eta');axis ij;colorbar;
955 >> title('Surface height at iter=10');
956
957 >> eta=rdmds('Eta',[0:10:100]);
958 >> for n=1:11; imagesc(eta(:,:,n)');axis ij;colorbar;pause(.5);end
959 \end{verbatim}
960
961 \section{Doing it yourself: customizing the code}
962
963 When you are ready to run the model in the configuration you want, the
964 easiest thing is to use and adapt the setup of the case studies
965 experiment (described previously) that is the closest to your
966 configuration. Then, the amount of setup will be minimized. In this
967 section, we focus on the setup relative to the ``numerical model''
968 part of the code (the setup relative to the ``execution environment''
969 part is covered in the parallel implementation section) and on the
970 variables and parameters that you are likely to change.
971
972 \subsection{Configuration and setup}
973
974 The CPP keys relative to the ``numerical model'' part of the code are
975 all defined and set in the file \textit{CPP\_OPTIONS.h }in the
976 directory \textit{ model/inc }or in one of the \textit{code
977 }directories of the case study experiments under
978 \textit{verification.} The model parameters are defined and declared
979 in the file \textit{model/inc/PARAMS.h }and their default values are
980 set in the routine \textit{model/src/set\_defaults.F. }The default
981 values can be modified in the namelist file \textit{data }which needs
982 to be located in the directory where you will run the model. The
983 parameters are initialized in the routine
984 \textit{model/src/ini\_parms.F}. Look at this routine to see in what
985 part of the namelist the parameters are located.
986
987 In what follows the parameters are grouped into categories related to
988 the computational domain, the equations solved in the model, and the
989 simulation controls.
990
991 \subsection{Computational domain, geometry and time-discretization}
992
993 \begin{description}
994 \item[dimensions] \
995
996 The number of points in the x, y, and r directions are represented
997 by the variables \textbf{sNx}, \textbf{sNy} and \textbf{Nr}
998 respectively which are declared and set in the file
999 \textit{model/inc/SIZE.h}. (Again, this assumes a mono-processor
1000 calculation. For multiprocessor calculations see the section on
1001 parallel implementation.)
1002
1003 \item[grid] \
1004
1005 Three different grids are available: cartesian, spherical polar, and
1006 curvilinear (which includes the cubed sphere). The grid is set
1007 through the logical variables \textbf{usingCartesianGrid},
1008 \textbf{usingSphericalPolarGrid}, and \textbf{usingCurvilinearGrid}.
1009 In the case of spherical and curvilinear grids, the southern
1010 boundary is defined through the variable \textbf{phiMin} which
1011 corresponds to the latitude of the southern most cell face (in
1012 degrees). The resolution along the x and y directions is controlled
1013 by the 1D arrays \textbf{delx} and \textbf{dely} (in meters in the
1014 case of a cartesian grid, in degrees otherwise). The vertical grid
1015 spacing is set through the 1D array \textbf{delz} for the ocean (in
1016 meters) or \textbf{delp} for the atmosphere (in Pa). The variable
1017 \textbf{Ro\_SeaLevel} represents the standard position of Sea-Level
1018 in ``R'' coordinate. This is typically set to 0m for the ocean
1019 (default value) and 10$^{5}$Pa for the atmosphere. For the
1020 atmosphere, also set the logical variable \textbf{groundAtK1} to
1021 \texttt{'.TRUE.'} which puts the first level (k=1) at the lower
1022 boundary (ground).
1023
1024 For the cartesian grid case, the Coriolis parameter $f$ is set
1025 through the variables \textbf{f0} and \textbf{beta} which correspond
1026 to the reference Coriolis parameter (in s$^{-1}$) and
1027 $\frac{\partial f}{ \partial y}$(in m$^{-1}$s$^{-1}$) respectively.
1028 If \textbf{beta } is set to a nonzero value, \textbf{f0} is the
1029 value of $f$ at the southern edge of the domain.
1030
1031 \item[topography - full and partial cells] \
1032
1033 The domain bathymetry is read from a file that contains a 2D (x,y)
1034 map of depths (in m) for the ocean or pressures (in Pa) for the
1035 atmosphere. The file name is represented by the variable
1036 \textbf{bathyFile}. The file is assumed to contain binary numbers
1037 giving the depth (pressure) of the model at each grid cell, ordered
1038 with the x coordinate varying fastest. The points are ordered from
1039 low coordinate to high coordinate for both axes. The model code
1040 applies without modification to enclosed, periodic, and double
1041 periodic domains. Periodicity is assumed by default and is
1042 suppressed by setting the depths to 0m for the cells at the limits
1043 of the computational domain (note: not sure this is the case for the
1044 atmosphere). The precision with which to read the binary data is
1045 controlled by the integer variable \textbf{readBinaryPrec} which can
1046 take the value \texttt{32} (single precision) or \texttt{64} (double
1047 precision). See the matlab program \textit{gendata.m} in the
1048 \textit{input} directories under \textit{verification} to see how
1049 the bathymetry files are generated for the case study experiments.
1050
1051 To use the partial cell capability, the variable \textbf{hFacMin}
1052 needs to be set to a value between 0 and 1 (it is set to 1 by
1053 default) corresponding to the minimum fractional size of the cell.
1054 For example if the bottom cell is 500m thick and \textbf{hFacMin} is
1055 set to 0.1, the actual thickness of the cell (i.e. used in the code)
1056 can cover a range of discrete values 50m apart from 50m to 500m
1057 depending on the value of the bottom depth (in \textbf{bathyFile})
1058 at this point.
1059
1060 Note that the bottom depths (or pressures) need not coincide with
1061 the models levels as deduced from \textbf{delz} or \textbf{delp}.
1062 The model will interpolate the numbers in \textbf{bathyFile} so that
1063 they match the levels obtained from \textbf{delz} or \textbf{delp}
1064 and \textbf{hFacMin}.
1065
1066 (Note: the atmospheric case is a bit more complicated than what is
1067 written here I think. To come soon...)
1068
1069 \item[time-discretization] \
1070
1071 The time steps are set through the real variables \textbf{deltaTMom}
1072 and \textbf{deltaTtracer} (in s) which represent the time step for
1073 the momentum and tracer equations, respectively. For synchronous
1074 integrations, simply set the two variables to the same value (or you
1075 can prescribe one time step only through the variable
1076 \textbf{deltaT}). The Adams-Bashforth stabilizing parameter is set
1077 through the variable \textbf{abEps} (dimensionless). The stagger
1078 baroclinic time stepping can be activated by setting the logical
1079 variable \textbf{staggerTimeStep} to \texttt{'.TRUE.'}.
1080
1081 \end{description}
1082
1083
1084 \subsection{Equation of state}
1085
1086 First, because the model equations are written in terms of
1087 perturbations, a reference thermodynamic state needs to be specified.
1088 This is done through the 1D arrays \textbf{tRef} and \textbf{sRef}.
1089 \textbf{tRef} specifies the reference potential temperature profile
1090 (in $^{o}$C for the ocean and $^{o}$K for the atmosphere) starting
1091 from the level k=1. Similarly, \textbf{sRef} specifies the reference
1092 salinity profile (in ppt) for the ocean or the reference specific
1093 humidity profile (in g/kg) for the atmosphere.
1094
1095 The form of the equation of state is controlled by the character
1096 variables \textbf{buoyancyRelation} and \textbf{eosType}.
1097 \textbf{buoyancyRelation} is set to \texttt{'OCEANIC'} by default and
1098 needs to be set to \texttt{'ATMOSPHERIC'} for atmosphere simulations.
1099 In this case, \textbf{eosType} must be set to \texttt{'IDEALGAS'}.
1100 For the ocean, two forms of the equation of state are available:
1101 linear (set \textbf{eosType} to \texttt{'LINEAR'}) and a polynomial
1102 approximation to the full nonlinear equation ( set \textbf{eosType} to
1103 \texttt{'POLYNOMIAL'}). In the linear case, you need to specify the
1104 thermal and haline expansion coefficients represented by the variables
1105 \textbf{tAlpha} (in K$^{-1}$) and \textbf{sBeta} (in ppt$^{-1}$). For
1106 the nonlinear case, you need to generate a file of polynomial
1107 coefficients called \textit{POLY3.COEFFS}. To do this, use the program
1108 \textit{utils/knudsen2/knudsen2.f} under the model tree (a Makefile is
1109 available in the same directory and you will need to edit the number
1110 and the values of the vertical levels in \textit{knudsen2.f} so that
1111 they match those of your configuration).
1112
1113 There there are also higher polynomials for the equation of state:
1114 \begin{description}
1115 \item[\texttt{'UNESCO'}:] The UNESCO equation of state formula of
1116 Fofonoff and Millard \cite{fofonoff83}. This equation of state
1117 assumes in-situ temperature, which is not a model variable; {\em its
1118 use is therefore discouraged, and it is only listed for
1119 completeness}.
1120 \item[\texttt{'JMD95Z'}:] A modified UNESCO formula by Jackett and
1121 McDougall \cite{jackett95}, which uses the model variable potential
1122 temperature as input. The \texttt{'Z'} indicates that this equation
1123 of state uses a horizontally and temporally constant pressure
1124 $p_{0}=-g\rho_{0}z$.
1125 \item[\texttt{'JMD95P'}:] A modified UNESCO formula by Jackett and
1126 McDougall \cite{jackett95}, which uses the model variable potential
1127 temperature as input. The \texttt{'P'} indicates that this equation
1128 of state uses the actual hydrostatic pressure of the last time
1129 step. Lagging the pressure in this way requires an additional pickup
1130 file for restarts.
1131 \item[\texttt{'MDJWF'}:] The new, more accurate and less expensive
1132 equation of state by McDougall et~al. \cite{mcdougall03}. It also
1133 requires lagging the pressure and therefore an additional pickup
1134 file for restarts.
1135 \end{description}
1136 For none of these options an reference profile of temperature or
1137 salinity is required.
1138
1139 \subsection{Momentum equations}
1140
1141 In this section, we only focus for now on the parameters that you are
1142 likely to change, i.e. the ones relative to forcing and dissipation
1143 for example. The details relevant to the vector-invariant form of the
1144 equations and the various advection schemes are not covered for the
1145 moment. We assume that you use the standard form of the momentum
1146 equations (i.e. the flux-form) with the default advection scheme.
1147 Also, there are a few logical variables that allow you to turn on/off
1148 various terms in the momentum equation. These variables are called
1149 \textbf{momViscosity, momAdvection, momForcing, useCoriolis,
1150 momPressureForcing, momStepping} and \textbf{metricTerms }and are
1151 assumed to be set to \texttt{'.TRUE.'} here. Look at the file
1152 \textit{model/inc/PARAMS.h }for a precise definition of these
1153 variables.
1154
1155 \begin{description}
1156 \item[initialization] \
1157
1158 The velocity components are initialized to 0 unless the simulation
1159 is starting from a pickup file (see section on simulation control
1160 parameters).
1161
1162 \item[forcing] \
1163
1164 This section only applies to the ocean. You need to generate
1165 wind-stress data into two files \textbf{zonalWindFile} and
1166 \textbf{meridWindFile} corresponding to the zonal and meridional
1167 components of the wind stress, respectively (if you want the stress
1168 to be along the direction of only one of the model horizontal axes,
1169 you only need to generate one file). The format of the files is
1170 similar to the bathymetry file. The zonal (meridional) stress data
1171 are assumed to be in Pa and located at U-points (V-points). As for
1172 the bathymetry, the precision with which to read the binary data is
1173 controlled by the variable \textbf{readBinaryPrec}. See the matlab
1174 program \textit{gendata.m} in the \textit{input} directories under
1175 \textit{verification} to see how simple analytical wind forcing data
1176 are generated for the case study experiments.
1177
1178 There is also the possibility of prescribing time-dependent periodic
1179 forcing. To do this, concatenate the successive time records into a
1180 single file (for each stress component) ordered in a (x,y,t) fashion
1181 and set the following variables: \textbf{periodicExternalForcing }to
1182 \texttt{'.TRUE.'}, \textbf{externForcingPeriod }to the period (in s)
1183 of which the forcing varies (typically 1 month), and
1184 \textbf{externForcingCycle} to the repeat time (in s) of the forcing
1185 (typically 1 year -- note: \textbf{ externForcingCycle} must be a
1186 multiple of \textbf{externForcingPeriod}). With these variables set
1187 up, the model will interpolate the forcing linearly at each
1188 iteration.
1189
1190 \item[dissipation] \
1191
1192 The lateral eddy viscosity coefficient is specified through the
1193 variable \textbf{viscAh} (in m$^{2}$s$^{-1}$). The vertical eddy
1194 viscosity coefficient is specified through the variable
1195 \textbf{viscAz} (in m$^{2}$s$^{-1}$) for the ocean and
1196 \textbf{viscAp} (in Pa$^{2}$s$^{-1}$) for the atmosphere. The
1197 vertical diffusive fluxes can be computed implicitly by setting the
1198 logical variable \textbf{implicitViscosity }to \texttt{'.TRUE.'}.
1199 In addition, biharmonic mixing can be added as well through the
1200 variable \textbf{viscA4} (in m$^{4}$s$^{-1}$). On a spherical polar
1201 grid, you might also need to set the variable \textbf{cosPower}
1202 which is set to 0 by default and which represents the power of
1203 cosine of latitude to multiply viscosity. Slip or no-slip conditions
1204 at lateral and bottom boundaries are specified through the logical
1205 variables \textbf{no\_slip\_sides} and \textbf{no\_slip\_bottom}. If
1206 set to \texttt{'.FALSE.'}, free-slip boundary conditions are
1207 applied. If no-slip boundary conditions are applied at the bottom, a
1208 bottom drag can be applied as well. Two forms are available: linear
1209 (set the variable \textbf{bottomDragLinear} in s$ ^{-1}$) and
1210 quadratic (set the variable \textbf{bottomDragQuadratic} in
1211 m$^{-1}$).
1212
1213 The Fourier and Shapiro filters are described elsewhere.
1214
1215 \item[C-D scheme] \
1216
1217 If you run at a sufficiently coarse resolution, you will need the
1218 C-D scheme for the computation of the Coriolis terms. The
1219 variable\textbf{\ tauCD}, which represents the C-D scheme coupling
1220 timescale (in s) needs to be set.
1221
1222 \item[calculation of pressure/geopotential] \
1223
1224 First, to run a non-hydrostatic ocean simulation, set the logical
1225 variable \textbf{nonHydrostatic} to \texttt{'.TRUE.'}. The pressure
1226 field is then inverted through a 3D elliptic equation. (Note: this
1227 capability is not available for the atmosphere yet.) By default, a
1228 hydrostatic simulation is assumed and a 2D elliptic equation is used
1229 to invert the pressure field. The parameters controlling the
1230 behaviour of the elliptic solvers are the variables
1231 \textbf{cg2dMaxIters} and \textbf{cg2dTargetResidual } for
1232 the 2D case and \textbf{cg3dMaxIters} and
1233 \textbf{cg3dTargetResidual} for the 3D case. You probably won't need to
1234 alter the default values (are we sure of this?).
1235
1236 For the calculation of the surface pressure (for the ocean) or
1237 surface geopotential (for the atmosphere) you need to set the
1238 logical variables \textbf{rigidLid} and \textbf{implicitFreeSurface}
1239 (set one to \texttt{'.TRUE.'} and the other to \texttt{'.FALSE.'}
1240 depending on how you want to deal with the ocean upper or atmosphere
1241 lower boundary).
1242
1243 \end{description}
1244
1245 \subsection{Tracer equations}
1246
1247 This section covers the tracer equations i.e. the potential
1248 temperature equation and the salinity (for the ocean) or specific
1249 humidity (for the atmosphere) equation. As for the momentum equations,
1250 we only describe for now the parameters that you are likely to change.
1251 The logical variables \textbf{tempDiffusion} \textbf{tempAdvection}
1252 \textbf{tempForcing}, and \textbf{tempStepping} allow you to turn
1253 on/off terms in the temperature equation (same thing for salinity or
1254 specific humidity with variables \textbf{saltDiffusion},
1255 \textbf{saltAdvection} etc.). These variables are all assumed here to
1256 be set to \texttt{'.TRUE.'}. Look at file \textit{model/inc/PARAMS.h}
1257 for a precise definition.
1258
1259 \begin{description}
1260 \item[initialization] \
1261
1262 The initial tracer data can be contained in the binary files
1263 \textbf{hydrogThetaFile} and \textbf{hydrogSaltFile}. These files
1264 should contain 3D data ordered in an (x,y,r) fashion with k=1 as the
1265 first vertical level. If no file names are provided, the tracers
1266 are then initialized with the values of \textbf{tRef} and
1267 \textbf{sRef} mentioned above (in the equation of state section). In
1268 this case, the initial tracer data are uniform in x and y for each
1269 depth level.
1270
1271 \item[forcing] \
1272
1273 This part is more relevant for the ocean, the procedure for the
1274 atmosphere not being completely stabilized at the moment.
1275
1276 A combination of fluxes data and relaxation terms can be used for
1277 driving the tracer equations. For potential temperature, heat flux
1278 data (in W/m$ ^{2}$) can be stored in the 2D binary file
1279 \textbf{surfQfile}. Alternatively or in addition, the forcing can
1280 be specified through a relaxation term. The SST data to which the
1281 model surface temperatures are restored to are supposed to be stored
1282 in the 2D binary file \textbf{thetaClimFile}. The corresponding
1283 relaxation time scale coefficient is set through the variable
1284 \textbf{tauThetaClimRelax} (in s). The same procedure applies for
1285 salinity with the variable names \textbf{EmPmRfile},
1286 \textbf{saltClimFile}, and \textbf{tauSaltClimRelax} for freshwater
1287 flux (in m/s) and surface salinity (in ppt) data files and
1288 relaxation time scale coefficient (in s), respectively. Also for
1289 salinity, if the CPP key \textbf{USE\_NATURAL\_BCS} is turned on,
1290 natural boundary conditions are applied i.e. when computing the
1291 surface salinity tendency, the freshwater flux is multiplied by the
1292 model surface salinity instead of a constant salinity value.
1293
1294 As for the other input files, the precision with which to read the
1295 data is controlled by the variable \textbf{readBinaryPrec}.
1296 Time-dependent, periodic forcing can be applied as well following
1297 the same procedure used for the wind forcing data (see above).
1298
1299 \item[dissipation] \
1300
1301 Lateral eddy diffusivities for temperature and salinity/specific
1302 humidity are specified through the variables \textbf{diffKhT} and
1303 \textbf{diffKhS} (in m$^{2}$/s). Vertical eddy diffusivities are
1304 specified through the variables \textbf{diffKzT} and
1305 \textbf{diffKzS} (in m$^{2}$/s) for the ocean and \textbf{diffKpT
1306 }and \textbf{diffKpS} (in Pa$^{2}$/s) for the atmosphere. The
1307 vertical diffusive fluxes can be computed implicitly by setting the
1308 logical variable \textbf{implicitDiffusion} to \texttt{'.TRUE.'}.
1309 In addition, biharmonic diffusivities can be specified as well
1310 through the coefficients \textbf{diffK4T} and \textbf{diffK4S} (in
1311 m$^{4}$/s). Note that the cosine power scaling (specified through
1312 \textbf{cosPower}---see the momentum equations section) is applied to
1313 the tracer diffusivities (Laplacian and biharmonic) as well. The
1314 Gent and McWilliams parameterization for oceanic tracers is
1315 described in the package section. Finally, note that tracers can be
1316 also subject to Fourier and Shapiro filtering (see the corresponding
1317 section on these filters).
1318
1319 \item[ocean convection] \
1320
1321 Two options are available to parameterize ocean convection: one is
1322 to use the convective adjustment scheme. In this case, you need to
1323 set the variable \textbf{cadjFreq}, which represents the frequency
1324 (in s) with which the adjustment algorithm is called, to a non-zero
1325 value (if set to a negative value by the user, the model will set it
1326 to the tracer time step). The other option is to parameterize
1327 convection with implicit vertical diffusion. To do this, set the
1328 logical variable \textbf{implicitDiffusion} to \texttt{'.TRUE.'}
1329 and the real variable \textbf{ivdc\_kappa} to a value (in m$^{2}$/s)
1330 you wish the tracer vertical diffusivities to have when mixing
1331 tracers vertically due to static instabilities. Note that
1332 \textbf{cadjFreq} and \textbf{ivdc\_kappa}can not both have non-zero
1333 value.
1334
1335 \end{description}
1336
1337 \subsection{Simulation controls}
1338
1339 The model ''clock'' is defined by the variable \textbf{deltaTClock}
1340 (in s) which determines the IO frequencies and is used in tagging
1341 output. Typically, you will set it to the tracer time step for
1342 accelerated runs (otherwise it is simply set to the default time step
1343 \textbf{deltaT}). Frequency of checkpointing and dumping of the model
1344 state are referenced to this clock (see below).
1345
1346 \begin{description}
1347 \item[run duration] \
1348
1349 The beginning of a simulation is set by specifying a start time (in
1350 s) through the real variable \textbf{startTime} or by specifying an
1351 initial iteration number through the integer variable
1352 \textbf{nIter0}. If these variables are set to nonzero values, the
1353 model will look for a ''pickup'' file \textit{pickup.0000nIter0} to
1354 restart the integration. The end of a simulation is set through the
1355 real variable \textbf{endTime} (in s). Alternatively, you can
1356 specify instead the number of time steps to execute through the
1357 integer variable \textbf{nTimeSteps}.
1358
1359 \item[frequency of output] \
1360
1361 Real variables defining frequencies (in s) with which output files
1362 are written on disk need to be set up. \textbf{dumpFreq} controls
1363 the frequency with which the instantaneous state of the model is
1364 saved. \textbf{chkPtFreq} and \textbf{pchkPtFreq} control the output
1365 frequency of rolling and permanent checkpoint files, respectively.
1366 See section 1.5.1 Output files for the definition of model state and
1367 checkpoint files. In addition, time-averaged fields can be written
1368 out by setting the variable \textbf{taveFreq} (in s). The precision
1369 with which to write the binary data is controlled by the integer
1370 variable w\textbf{riteBinaryPrec} (set it to \texttt{32} or
1371 \texttt{64}).
1372
1373 \end{description}
1374
1375
1376 %%% Local Variables:
1377 %%% mode: latex
1378 %%% TeX-master: t
1379 %%% End:

  ViewVC Help
Powered by ViewVC 1.1.22