| 39 | 
 \begin{rawhtml} </A> \end{rawhtml} | 
 \begin{rawhtml} </A> \end{rawhtml} | 
| 40 | 
 Essentially all of the MITgcm web pages can be searched using a | 
 Essentially all of the MITgcm web pages can be searched using a | 
| 41 | 
 popular web crawler such as Google or through our own search facility: | 
 popular web crawler such as Google or through our own search facility: | 
| 42 | 
  | 
 \begin{rawhtml} <A href=http://mitgcm.org/mailman/htdig/ target="idontexist"> \end{rawhtml} | 
| 43 | 
 \begin{verbatim} | 
 \begin{verbatim} | 
| 44 | 
 http://mitgcm.org/htdig/ | 
 http://mitgcm.org/htdig/ | 
| 45 | 
 \end{verbatim} | 
 \end{verbatim} | 
| 79 | 
  | 
  | 
| 80 | 
 \end{enumerate} | 
 \end{enumerate} | 
| 81 | 
  | 
  | 
| 82 | 
  | 
 \subsubsection{Checkout from CVS} | 
| 83 | 
  | 
 \label{sect:cvs_checkout} | 
| 84 | 
  | 
  | 
| 85 | 
 If CVS is available on your system, we strongly encourage you to use it. CVS | 
 If CVS is available on your system, we strongly encourage you to use it. CVS | 
| 86 | 
 provides an efficient and elegant way of organizing your code and keeping | 
 provides an efficient and elegant way of organizing your code and keeping | 
| 87 | 
 track of your changes. If CVS is not available on your machine, you can also | 
 track of your changes. If CVS is not available on your machine, you can also | 
| 96 | 
 \begin{verbatim} | 
 \begin{verbatim} | 
| 97 | 
 % export CVSROOT=':pserver:cvsanon@mitgcm.org:/u/gcmpack' | 
 % export CVSROOT=':pserver:cvsanon@mitgcm.org:/u/gcmpack' | 
| 98 | 
 \end{verbatim} | 
 \end{verbatim} | 
| 99 | 
 in your .profile or .bashrc file. | 
 in your \texttt{.profile} or \texttt{.bashrc} file. | 
| 100 | 
  | 
  | 
| 101 | 
  | 
  | 
| 102 | 
 To get MITgcm through CVS, first register with the MITgcm CVS server | 
 To get MITgcm through CVS, first register with the MITgcm CVS server | 
| 112 | 
 \end{verbatim} | 
 \end{verbatim} | 
| 113 | 
 or to get a specific release type: | 
 or to get a specific release type: | 
| 114 | 
 \begin{verbatim} | 
 \begin{verbatim} | 
| 115 | 
 % cvs co -d directory -P -r release1_beta1 MITgcm | 
 % cvs co -P -r checkpoint52i_post  MITgcm | 
| 116 | 
 \end{verbatim} | 
 \end{verbatim} | 
| 117 | 
 The MITgcm web site contains further directions concerning the source | 
 The MITgcm web site contains further directions concerning the source | 
| 118 | 
 code and CVS.  It also contains a web interface to our CVS archive so | 
 code and CVS.  It also contains a web interface to our CVS archive so | 
| 119 | 
 that one may easily view the state of files, revisions, and other | 
 that one may easily view the state of files, revisions, and other | 
| 120 | 
 development milestones: | 
 development milestones: | 
| 121 | 
 \begin{rawhtml} <A href=http://mitgcm.org/download target="idontexist"> \end{rawhtml} | 
 \begin{rawhtml} <A href=''http://mitgcm.org/download'' target="idontexist"> \end{rawhtml} | 
| 122 | 
 \begin{verbatim} | 
 \begin{verbatim} | 
| 123 | 
 http://mitgcm.org/source_code.html | 
 http://mitgcm.org/source_code.html | 
| 124 | 
 \end{verbatim} | 
 \end{verbatim} | 
| 125 | 
 \begin{rawhtml} </A> \end{rawhtml} | 
 \begin{rawhtml} </A> \end{rawhtml} | 
| 126 | 
  | 
  | 
| 127 | 
  | 
 As a convenience, the MITgcm CVS server contains aliases which are | 
| 128 | 
  | 
 named subsets of the codebase.  These aliases can be especially | 
| 129 | 
  | 
 helpful when used over slow internet connections or on machines with | 
| 130 | 
  | 
 restricted storage space.  Table \ref{tab:cvsModules} contains a list | 
| 131 | 
  | 
 of CVS aliases | 
| 132 | 
  | 
 \begin{table}[htb] | 
| 133 | 
  | 
   \centering | 
| 134 | 
  | 
   \begin{tabular}[htb]{|lp{3.25in}|}\hline | 
| 135 | 
  | 
     \textbf{Alias Name}    &  \textbf{Information (directories) Contained}  \\\hline | 
| 136 | 
  | 
     \texttt{MITgcm\_code}  &  Only the source code -- none of the verification examples.  \\ | 
| 137 | 
  | 
     \texttt{MITgcm\_verif\_basic} | 
| 138 | 
  | 
     &  Source code plus a small set of the verification examples  | 
| 139 | 
  | 
     (\texttt{global\_ocean.90x40x15}, \texttt{aim.5l\_cs}, \texttt{hs94.128x64x5},  | 
| 140 | 
  | 
     \texttt{front\_relax}, and \texttt{plume\_on\_slope}).  \\ | 
| 141 | 
  | 
     \texttt{MITgcm\_verif\_atmos}  &  Source code plus all of the atmospheric examples.  \\ | 
| 142 | 
  | 
     \texttt{MITgcm\_verif\_ocean}  &  Source code plus all of the oceanic examples.  \\ | 
| 143 | 
  | 
     \texttt{MITgcm\_verif\_all}    &  Source code plus all of the | 
| 144 | 
  | 
     verification examples. \\\hline | 
| 145 | 
  | 
   \end{tabular} | 
| 146 | 
  | 
   \caption{MITgcm CVS Modules} | 
| 147 | 
  | 
   \label{tab:cvsModules} | 
| 148 | 
  | 
 \end{table} | 
| 149 | 
  | 
  | 
| 150 | 
 The checkout process creates a directory called \textit{MITgcm}. If | 
 The checkout process creates a directory called \textit{MITgcm}. If | 
| 151 | 
 the directory \textit{MITgcm} exists this command updates your code | 
 the directory \textit{MITgcm} exists this command updates your code | 
| 155 | 
 the files in \textit{CVS}!  You can also use CVS to download code | 
 the files in \textit{CVS}!  You can also use CVS to download code | 
| 156 | 
 updates.  More extensive information on using CVS for maintaining | 
 updates.  More extensive information on using CVS for maintaining | 
| 157 | 
 MITgcm code can be found | 
 MITgcm code can be found | 
| 158 | 
 \begin{rawhtml} <A href=http://mitgcm.org/usingcvstoget.html target="idontexist"> \end{rawhtml} | 
 \begin{rawhtml} <A href=''http://mitgcm.org/usingcvstoget.html'' target="idontexist"> \end{rawhtml} | 
| 159 | 
 here | 
 here | 
| 160 | 
 \begin{rawhtml} </A> \end{rawhtml}  | 
 \begin{rawhtml} </A> \end{rawhtml}  | 
| 161 | 
 . | 
 . | 
| 162 | 
  | 
 It is important to note that the CVS aliases in Table | 
| 163 | 
  | 
 \ref{tab:cvsModules} cannot be used in conjunction with the CVS | 
| 164 | 
  | 
 \texttt{-d DIRNAME} option.  However, the \texttt{MITgcm} directories | 
| 165 | 
  | 
 they create can be changed to a different name following the check-out: | 
| 166 | 
  | 
 \begin{verbatim} | 
| 167 | 
  | 
    %  cvs co MITgcm_verif_basic | 
| 168 | 
  | 
    %  mv MITgcm MITgcm_verif_basic | 
| 169 | 
  | 
 \end{verbatim} | 
| 170 | 
  | 
  | 
| 171 | 
  | 
  | 
| 172 | 
 \paragraph*{Conventional download method} | 
 \subsubsection{Conventional download method} | 
| 173 | 
 \label{sect:conventionalDownload} | 
 \label{sect:conventionalDownload} | 
| 174 | 
  | 
  | 
| 175 | 
 If you do not have CVS on your system, you can download the model as a | 
 If you do not have CVS on your system, you can download the model as a | 
| 183 | 
 delete; even if you do not use CVS yourself the information can help | 
 delete; even if you do not use CVS yourself the information can help | 
| 184 | 
 us if you should need to send us your copy of the code.  If a recent | 
 us if you should need to send us your copy of the code.  If a recent | 
| 185 | 
 tar file does not exist, then please contact the developers through | 
 tar file does not exist, then please contact the developers through | 
| 186 | 
 the MITgcm-support list. | 
 the  | 
| 187 | 
  | 
 \begin{rawhtml} <A href=''mailto:MITgcm-support@mitgcm.org"> \end{rawhtml} | 
| 188 | 
  | 
 MITgcm-support@mitgcm.org | 
| 189 | 
  | 
 \begin{rawhtml} </A> \end{rawhtml} | 
| 190 | 
  | 
 mailing list. | 
| 191 | 
  | 
  | 
| 192 | 
 \paragraph*{Upgrading from an earlier version} | 
 \subsubsection{Upgrading from an earlier version} | 
| 193 | 
  | 
  | 
| 194 | 
 If you already have an earlier version of the code you can ``upgrade'' | 
 If you already have an earlier version of the code you can ``upgrade'' | 
| 195 | 
 your copy instead of downloading the entire repository again. First, | 
 your copy instead of downloading the entire repository again. First, | 
| 199 | 
 \end{verbatim} | 
 \end{verbatim} | 
| 200 | 
 and then issue the cvs update command such as: | 
 and then issue the cvs update command such as: | 
| 201 | 
 \begin{verbatim} | 
 \begin{verbatim} | 
| 202 | 
 % cvs -q update -r release1_beta1 -d -P | 
 % cvs -q update -r checkpoint52i_post -d -P | 
| 203 | 
 \end{verbatim} | 
 \end{verbatim} | 
| 204 | 
 This will update the ``tag'' to ``release1\_beta1'', add any new | 
 This will update the ``tag'' to ``checkpoint52i\_post'', add any new | 
| 205 | 
 directories (-d) and remove any empty directories (-P). The -q option | 
 directories (-d) and remove any empty directories (-P). The -q option | 
| 206 | 
 means be quiet which will reduce the number of messages you'll see in | 
 means be quiet which will reduce the number of messages you'll see in | 
| 207 | 
 the terminal. If you have modified the code prior to upgrading, CVS | 
 the terminal. If you have modified the code prior to upgrading, CVS | 
| 215 | 
 cvs update command and it will report the conflicts. Conflicts are | 
 cvs update command and it will report the conflicts. Conflicts are | 
| 216 | 
 indicated in the code by the delimites ``$<<<<<<<$'', ``======='' and | 
 indicated in the code by the delimites ``$<<<<<<<$'', ``======='' and | 
| 217 | 
 ``$>>>>>>>$''. For example, | 
 ``$>>>>>>>$''. For example, | 
| 218 | 
  | 
 {\small | 
| 219 | 
 \begin{verbatim} | 
 \begin{verbatim} | 
| 220 | 
 <<<<<<< ini_parms.F | 
 <<<<<<< ini_parms.F | 
| 221 | 
      & bottomDragLinear,myOwnBottomDragCoefficient, | 
      & bottomDragLinear,myOwnBottomDragCoefficient, | 
| 223 | 
      & bottomDragLinear,bottomDragQuadratic, | 
      & bottomDragLinear,bottomDragQuadratic, | 
| 224 | 
 >>>>>>> 1.18 | 
 >>>>>>> 1.18 | 
| 225 | 
 \end{verbatim} | 
 \end{verbatim} | 
| 226 | 
  | 
 } | 
| 227 | 
 means that you added ``myOwnBottomDragCoefficient'' to a namelist at | 
 means that you added ``myOwnBottomDragCoefficient'' to a namelist at | 
| 228 | 
 the same time and place that we added ``bottomDragQuadratic''. You | 
 the same time and place that we added ``bottomDragQuadratic''. You | 
| 229 | 
 need to resolve this conflict and in this case the line should be | 
 need to resolve this conflict and in this case the line should be | 
| 230 | 
 changed to: | 
 changed to: | 
| 231 | 
  | 
 {\small | 
| 232 | 
 \begin{verbatim} | 
 \begin{verbatim} | 
| 233 | 
      & bottomDragLinear,bottomDragQuadratic,myOwnBottomDragCoefficient, | 
      & bottomDragLinear,bottomDragQuadratic,myOwnBottomDragCoefficient, | 
| 234 | 
 \end{verbatim} | 
 \end{verbatim} | 
| 235 | 
  | 
 } | 
| 236 | 
 and the lines with the delimiters ($<<<<<<$,======,$>>>>>>$) be deleted. | 
 and the lines with the delimiters ($<<<<<<$,======,$>>>>>>$) be deleted. | 
| 237 | 
 Unless you are making modifications which exactly parallel | 
 Unless you are making modifications which exactly parallel | 
| 238 | 
 developments we make, these types of conflicts should be rare. | 
 developments we make, these types of conflicts should be rare. | 
| 266 | 
 \textit{eesupp} directory. The grid point model code is held under the | 
 \textit{eesupp} directory. The grid point model code is held under the | 
| 267 | 
 \textit{model} directory. Code execution actually starts in the | 
 \textit{model} directory. Code execution actually starts in the | 
| 268 | 
 \textit{eesupp} routines and not in the \textit{model} routines. For | 
 \textit{eesupp} routines and not in the \textit{model} routines. For | 
| 269 | 
 this reason the top-level | 
 this reason the top-level \textit{MAIN.F} is in the | 
| 270 | 
 \textit{MAIN.F} is in the \textit{eesupp/src} directory. In general, | 
 \textit{eesupp/src} directory. In general, end-users should not need | 
| 271 | 
 end-users should not need to worry about this level. The top-level routine | 
 to worry about this level. The top-level routine for the numerical | 
| 272 | 
 for the numerical part of the code is in \textit{model/src/THE\_MODEL\_MAIN.F% | 
 part of the code is in \textit{model/src/THE\_MODEL\_MAIN.F}. Here is | 
| 273 | 
 }. Here is a brief description of the directory structure of the model under | 
 a brief description of the directory structure of the model under the | 
| 274 | 
 the root tree (a detailed description is given in section 3: Code structure). | 
 root tree (a detailed description is given in section 3: Code | 
| 275 | 
  | 
 structure). | 
| 276 | 
  | 
  | 
| 277 | 
 \begin{itemize} | 
 \begin{itemize} | 
 | 
 \item \textit{bin}: this directory is initially empty. It is the default | 
  | 
 | 
 directory in which to compile the code. | 
  | 
| 278 | 
  | 
  | 
| 279 | 
  | 
 \item \textit{bin}: this directory is initially empty. It is the | 
| 280 | 
  | 
   default directory in which to compile the code. | 
| 281 | 
  | 
    | 
| 282 | 
 \item \textit{diags}: contains the code relative to time-averaged | 
 \item \textit{diags}: contains the code relative to time-averaged | 
| 283 | 
 diagnostics. It is subdivided into two subdirectories \textit{inc} and  | 
   diagnostics. It is subdivided into two subdirectories \textit{inc} | 
| 284 | 
 \textit{src} that contain include files (*.\textit{h} files) and Fortran | 
   and \textit{src} that contain include files (*.\textit{h} files) and | 
| 285 | 
 subroutines (*.\textit{F} files), respectively. | 
   Fortran subroutines (*.\textit{F} files), respectively. | 
| 286 | 
  | 
  | 
| 287 | 
 \item \textit{doc}: contains brief documentation notes. | 
 \item \textit{doc}: contains brief documentation notes. | 
| 288 | 
  | 
    | 
| 289 | 
 \item \textit{eesupp}: contains the execution environment source code. Also | 
 \item \textit{eesupp}: contains the execution environment source code. | 
| 290 | 
 subdivided into two subdirectories \textit{inc} and \textit{src}. | 
   Also subdivided into two subdirectories \textit{inc} and | 
| 291 | 
  | 
   \textit{src}. | 
| 292 | 
 \item \textit{exe}: this directory is initially empty. It is the default | 
    | 
| 293 | 
 directory in which to execute the code. | 
 \item \textit{exe}: this directory is initially empty. It is the | 
| 294 | 
  | 
   default directory in which to execute the code. | 
| 295 | 
 \item \textit{model}: this directory contains the main source code. Also | 
    | 
| 296 | 
 subdivided into two subdirectories \textit{inc} and \textit{src}. | 
 \item \textit{model}: this directory contains the main source code. | 
| 297 | 
  | 
   Also subdivided into two subdirectories \textit{inc} and | 
| 298 | 
 \item \textit{pkg}: contains the source code for the packages. Each package | 
   \textit{src}. | 
| 299 | 
 corresponds to a subdirectory. For example, \textit{gmredi} contains the | 
    | 
| 300 | 
 code related to the Gent-McWilliams/Redi scheme, \textit{aim} the code | 
 \item \textit{pkg}: contains the source code for the packages. Each | 
| 301 | 
 relative to the atmospheric intermediate physics. The packages are described | 
   package corresponds to a subdirectory. For example, \textit{gmredi} | 
| 302 | 
 in detail in section 3. | 
   contains the code related to the Gent-McWilliams/Redi scheme, | 
| 303 | 
  | 
   \textit{aim} the code relative to the atmospheric intermediate | 
| 304 | 
 \item \textit{tools}: this directory contains various useful tools. For | 
   physics. The packages are described in detail in section 3. | 
| 305 | 
 example, \textit{genmake2} is a script written in csh (C-shell) that should | 
    | 
| 306 | 
 be used to generate your makefile. The directory \textit{adjoint} contains | 
 \item \textit{tools}: this directory contains various useful tools. | 
| 307 | 
 the makefile specific to the Tangent linear and Adjoint Compiler (TAMC) that | 
   For example, \textit{genmake2} is a script written in csh (C-shell) | 
| 308 | 
 generates the adjoint code. The latter is described in details in part V. | 
   that should be used to generate your makefile. The directory | 
| 309 | 
  | 
   \textit{adjoint} contains the makefile specific to the Tangent | 
| 310 | 
  | 
   linear and Adjoint Compiler (TAMC) that generates the adjoint code. | 
| 311 | 
  | 
   The latter is described in details in part V. | 
| 312 | 
  | 
    | 
| 313 | 
 \item \textit{utils}: this directory contains various utilities. The | 
 \item \textit{utils}: this directory contains various utilities. The | 
| 314 | 
 subdirectory \textit{knudsen2} contains code and a makefile that | 
   subdirectory \textit{knudsen2} contains code and a makefile that | 
| 315 | 
 compute coefficients of the polynomial approximation to the knudsen | 
   compute coefficients of the polynomial approximation to the knudsen | 
| 316 | 
 formula for an ocean nonlinear equation of state. The \textit{matlab} | 
   formula for an ocean nonlinear equation of state. The | 
| 317 | 
 subdirectory contains matlab scripts for reading model output directly | 
   \textit{matlab} subdirectory contains matlab scripts for reading | 
| 318 | 
 into matlab. \textit{scripts} contains C-shell post-processing | 
   model output directly into matlab. \textit{scripts} contains C-shell | 
| 319 | 
 scripts for joining processor-based and tiled-based model output. | 
   post-processing scripts for joining processor-based and tiled-based | 
| 320 | 
  | 
   model output. | 
| 321 | 
  | 
    | 
| 322 | 
  | 
 \item \textit{verification}: this directory contains the model | 
| 323 | 
  | 
   examples. See section \ref{sect:modelExamples}. | 
| 324 | 
  | 
  | 
 | 
 \item \textit{verification}: this directory contains the model examples. See | 
  | 
 | 
 section \ref{sect:modelExamples}. | 
  | 
| 325 | 
 \end{itemize} | 
 \end{itemize} | 
| 326 | 
  | 
  | 
| 327 | 
 \section{Example experiments} | 
 \section[MITgcm Example Experiments]{Example experiments} | 
| 328 | 
 \label{sect:modelExamples} | 
 \label{sect:modelExamples} | 
| 329 | 
  | 
  | 
| 330 | 
 %% a set of twenty-four pre-configured numerical experiments | 
 %% a set of twenty-four pre-configured numerical experiments | 
| 343 | 
 \subsection{Full list of model examples} | 
 \subsection{Full list of model examples} | 
| 344 | 
  | 
  | 
| 345 | 
 \begin{enumerate} | 
 \begin{enumerate} | 
| 346 | 
  | 
    | 
| 347 | 
 \item \textit{exp0} - single layer, ocean double gyre (barotropic with | 
 \item \textit{exp0} - single layer, ocean double gyre (barotropic with | 
| 348 | 
   free-surface). This experiment is described in detail in section | 
   free-surface). This experiment is described in detail in section | 
| 349 | 
   \ref{sect:eg-baro}. | 
   \ref{sect:eg-baro}. | 
| 433 | 
  | 
  | 
| 434 | 
 \begin{itemize} | 
 \begin{itemize} | 
| 435 | 
 \item \textit{code}: contains the code particular to the example. At a | 
 \item \textit{code}: contains the code particular to the example. At a | 
| 436 | 
 minimum, this directory includes the following files: | 
   minimum, this directory includes the following files: | 
| 437 | 
  | 
  | 
| 438 | 
 \begin{itemize} | 
   \begin{itemize} | 
| 439 | 
 \item \textit{code/CPP\_EEOPTIONS.h}: declares CPP keys relative to | 
   \item \textit{code/CPP\_EEOPTIONS.h}: declares CPP keys relative to | 
| 440 | 
   the ``execution environment'' part of the code. The default version | 
     the ``execution environment'' part of the code. The default | 
| 441 | 
   is located in \textit{eesupp/inc}. | 
     version is located in \textit{eesupp/inc}. | 
| 442 | 
    | 
    | 
| 443 | 
 \item \textit{code/CPP\_OPTIONS.h}: declares CPP keys relative to the | 
   \item \textit{code/CPP\_OPTIONS.h}: declares CPP keys relative to | 
| 444 | 
   ``numerical model'' part of the code. The default version is located | 
     the ``numerical model'' part of the code. The default version is | 
| 445 | 
   in \textit{model/inc}. | 
     located in \textit{model/inc}. | 
| 446 | 
  | 
    | 
| 447 | 
  | 
   \item \textit{code/SIZE.h}: declares size of underlying | 
| 448 | 
  | 
     computational grid.  The default version is located in | 
| 449 | 
  | 
     \textit{model/inc}. | 
| 450 | 
  | 
   \end{itemize} | 
| 451 | 
  | 
    | 
| 452 | 
  | 
   In addition, other include files and subroutines might be present in | 
| 453 | 
  | 
   \textit{code} depending on the particular experiment. See Section 2 | 
| 454 | 
  | 
   for more details. | 
| 455 | 
    | 
    | 
 | 
 \item \textit{code/SIZE.h}: declares size of underlying computational | 
  | 
 | 
   grid.  The default version is located in \textit{model/inc}. | 
  | 
 | 
 \end{itemize} | 
  | 
 | 
  | 
  | 
 | 
 In addition, other include files and subroutines might be present in | 
  | 
 | 
 \textit{code} depending on the particular experiment. See Section 2 | 
  | 
 | 
 for more details. | 
  | 
 | 
  | 
  | 
| 456 | 
 \item \textit{input}: contains the input data files required to run | 
 \item \textit{input}: contains the input data files required to run | 
| 457 | 
   the example. At a minimum, the \textit{input} directory contains the | 
   the example. At a minimum, the \textit{input} directory contains the | 
| 458 | 
   following files: | 
   following files: | 
| 459 | 
  | 
  | 
| 460 | 
 \begin{itemize} | 
   \begin{itemize} | 
| 461 | 
 \item \textit{input/data}: this file, written as a namelist, specifies | 
   \item \textit{input/data}: this file, written as a namelist, | 
| 462 | 
   the main parameters for the experiment. | 
     specifies the main parameters for the experiment. | 
| 463 | 
    | 
    | 
| 464 | 
 \item \textit{input/data.pkg}: contains parameters relative to the | 
   \item \textit{input/data.pkg}: contains parameters relative to the | 
| 465 | 
   packages used in the experiment. | 
     packages used in the experiment. | 
| 466 | 
    | 
    | 
| 467 | 
 \item \textit{input/eedata}: this file contains ``execution | 
   \item \textit{input/eedata}: this file contains ``execution | 
| 468 | 
   environment'' data. At present, this consists of a specification of | 
     environment'' data. At present, this consists of a specification | 
| 469 | 
   the number of threads to use in $X$ and $Y$ under multithreaded | 
     of the number of threads to use in $X$ and $Y$ under multithreaded | 
| 470 | 
   execution. | 
     execution. | 
| 471 | 
 \end{itemize} | 
   \end{itemize} | 
| 472 | 
  | 
    | 
| 473 | 
 In addition, you will also find in this directory the forcing and topography | 
   In addition, you will also find in this directory the forcing and | 
| 474 | 
 files as well as the files describing the initial state of the experiment. | 
   topography files as well as the files describing the initial state | 
| 475 | 
 This varies from experiment to experiment. See section 2 for more details. | 
   of the experiment.  This varies from experiment to experiment. See | 
| 476 | 
  | 
   section 2 for more details. | 
| 477 | 
 \item \textit{results}: this directory contains the output file \textit{% | 
  | 
| 478 | 
 output.txt} produced by the simulation example. This file is useful for | 
 \item \textit{results}: this directory contains the output file | 
| 479 | 
 comparison with your own output when you run the experiment. | 
   \textit{output.txt} produced by the simulation example. This file is | 
| 480 | 
  | 
   useful for comparison with your own output when you run the | 
| 481 | 
  | 
   experiment. | 
| 482 | 
 \end{itemize} | 
 \end{itemize} | 
| 483 | 
  | 
  | 
| 484 | 
 Once you have chosen the example you want to run, you are ready to compile | 
 Once you have chosen the example you want to run, you are ready to | 
| 485 | 
 the code. | 
 compile the code. | 
| 486 | 
  | 
  | 
| 487 | 
 \section{Building the code} | 
 \section[Building MITgcm]{Building the code} | 
| 488 | 
 \label{sect:buildingCode} | 
 \label{sect:buildingCode} | 
| 489 | 
  | 
  | 
| 490 | 
 To compile the code, we use the {\em make} program. This uses a file | 
 To compile the code, we use the {\em make} program. This uses a file | 
| 491 | 
 ({\em Makefile}) that allows us to pre-process source files, specify | 
 ({\em Makefile}) that allows us to pre-process source files, specify | 
| 492 | 
 compiler and optimization options and also figures out any file | 
 compiler and optimization options and also figures out any file | 
| 493 | 
 dependencies. We supply a script ({\em genmake}), described in section | 
 dependencies. We supply a script ({\em genmake2}), described in | 
| 494 | 
 \ref{sect:genmake}, that automatically creates the {\em Makefile} for | 
 section \ref{sect:genmake}, that automatically creates the {\em | 
| 495 | 
 you. You then need to build the dependencies and compile the code. | 
   Makefile} for you. You then need to build the dependencies and | 
| 496 | 
  | 
 compile the code. | 
| 497 | 
  | 
  | 
| 498 | 
 As an example, let's assume that you want to build and run experiment | 
 As an example, let's assume that you want to build and run experiment | 
| 499 | 
 \textit{verification/exp2}. The are multiple ways and places to actually | 
 \textit{verification/exp2}. The are multiple ways and places to | 
| 500 | 
 do this but here let's build the code in | 
 actually do this but here let's build the code in | 
| 501 | 
 \textit{verification/exp2/input}: | 
 \textit{verification/exp2/input}: | 
| 502 | 
 \begin{verbatim} | 
 \begin{verbatim} | 
| 503 | 
 % cd verification/exp2/input | 
 % cd verification/exp2/input | 
| 504 | 
 \end{verbatim} | 
 \end{verbatim} | 
| 505 | 
 First, build the {\em Makefile}: | 
 First, build the {\em Makefile}: | 
| 506 | 
 \begin{verbatim} | 
 \begin{verbatim} | 
| 507 | 
 % ../../../tools/genmake -mods=../code | 
 % ../../../tools/genmake2 -mods=../code | 
| 508 | 
 \end{verbatim} | 
 \end{verbatim} | 
| 509 | 
 The command line option tells {\em genmake} to override model source | 
 The command line option tells {\em genmake} to override model source | 
| 510 | 
 code with any files in the directory {\em ./code/}. | 
 code with any files in the directory {\em ./code/}. | 
| 511 | 
  | 
  | 
| 512 | 
 If there is no \textit{.genmakerc} in the \textit{input} directory, you have | 
 On many systems, the {\em genmake2} program will be able to | 
| 513 | 
 to use the following options when invoking \textit{genmake}: | 
 automatically recognize the hardware, find compilers and other tools | 
| 514 | 
  | 
 within the user's path (``echo \$PATH''), and then choose an | 
| 515 | 
  | 
 appropriate set of options from the files contained in the {\em | 
| 516 | 
  | 
   tools/build\_options} directory.  Under some circumstances, a user | 
| 517 | 
  | 
 may have to create a new ``optfile'' in order to specify the exact | 
| 518 | 
  | 
 combination of compiler, compiler flags, libraries, and other options | 
| 519 | 
  | 
 necessary to build a particular configuration of MITgcm.  In such | 
| 520 | 
  | 
 cases, it is generally helpful to read the existing ``optfiles'' and | 
| 521 | 
  | 
 mimic their syntax. | 
| 522 | 
  | 
  | 
| 523 | 
  | 
 Through the MITgcm-support list, the MITgcm developers are willing to | 
| 524 | 
  | 
 provide help writing or modifing ``optfiles''.  And we encourage users | 
| 525 | 
  | 
 to post new ``optfiles'' (particularly ones for new machines or | 
| 526 | 
  | 
 architectures) to the  | 
| 527 | 
  | 
 \begin{rawhtml} <A href=''mailto:MITgcm-support@mitgcm.org"> \end{rawhtml} | 
| 528 | 
  | 
 MITgcm-support@mitgcm.org | 
| 529 | 
  | 
 \begin{rawhtml} </A> \end{rawhtml} | 
| 530 | 
  | 
 list. | 
| 531 | 
  | 
  | 
| 532 | 
  | 
 To specify an optfile to {\em genmake2}, the syntax is: | 
| 533 | 
 \begin{verbatim} | 
 \begin{verbatim} | 
| 534 | 
 % ../../../tools/genmake  -mods=../code | 
 % ../../../tools/genmake2 -mods=../code -of /path/to/optfile | 
| 535 | 
 \end{verbatim} | 
 \end{verbatim} | 
| 536 | 
  | 
  | 
| 537 | 
 Next, create the dependencies: | 
 Once a {\em Makefile} has been generated, we create the dependencies: | 
| 538 | 
 \begin{verbatim} | 
 \begin{verbatim} | 
| 539 | 
 % make depend | 
 % make depend | 
| 540 | 
 \end{verbatim} | 
 \end{verbatim} | 
| 541 | 
 This modifies {\em Makefile} by attaching a [long] list of files on | 
 This modifies the {\em Makefile} by attaching a [long] list of files | 
| 542 | 
 which other files depend. The purpose of this is to reduce | 
 upon which other files depend. The purpose of this is to reduce | 
| 543 | 
 re-compilation if and when you start to modify the code. {\tt make | 
 re-compilation if and when you start to modify the code. The {\tt make | 
| 544 | 
 depend} also created links from the model source to this directory. | 
   depend} command also creates links from the model source to this | 
| 545 | 
  | 
 directory. | 
| 546 | 
  | 
  | 
| 547 | 
 Now compile the code: | 
 Next compile the code: | 
| 548 | 
 \begin{verbatim} | 
 \begin{verbatim} | 
| 549 | 
 % make | 
 % make | 
| 550 | 
 \end{verbatim} | 
 \end{verbatim} | 
| 551 | 
 The {\tt make} command creates an executable called \textit{mitgcmuv}. | 
 The {\tt make} command creates an executable called \textit{mitgcmuv}. | 
| 552 | 
  | 
 Additional make ``targets'' are defined within the makefile to aid in | 
| 553 | 
  | 
 the production of adjoint and other versions of MITgcm. | 
| 554 | 
  | 
  | 
| 555 | 
 Now you are ready to run the model. General instructions for doing so are | 
 Now you are ready to run the model. General instructions for doing so are | 
| 556 | 
 given in section \ref{sect:runModel}. Here, we can run the model with: | 
 given in section \ref{sect:runModel}. Here, we can run the model with: | 
| 568 | 
 convenience. You can also configure and compile the code in other | 
 convenience. You can also configure and compile the code in other | 
| 569 | 
 locations, for example on a scratch disk with out having to copy the | 
 locations, for example on a scratch disk with out having to copy the | 
| 570 | 
 entire source tree. The only requirement to do so is you have {\tt | 
 entire source tree. The only requirement to do so is you have {\tt | 
| 571 | 
 genmake} in your path or you know the absolute path to {\tt genmake}. | 
   genmake2} in your path or you know the absolute path to {\tt | 
| 572 | 
  | 
   genmake2}. | 
| 573 | 
  | 
  | 
| 574 | 
 The following sections outline some possible methods of organizing you | 
 The following sections outline some possible methods of organizing | 
| 575 | 
 source and data. | 
 your source and data. | 
| 576 | 
  | 
  | 
| 577 | 
 \subsubsection{Building from the {\em ../code directory}} | 
 \subsubsection{Building from the {\em ../code directory}} | 
| 578 | 
  | 
  | 
| 579 | 
 This is just as simple as building in the {\em input/} directory: | 
 This is just as simple as building in the {\em input/} directory: | 
| 580 | 
 \begin{verbatim} | 
 \begin{verbatim} | 
| 581 | 
 % cd verification/exp2/code | 
 % cd verification/exp2/code | 
| 582 | 
 % ../../../tools/genmake | 
 % ../../../tools/genmake2 | 
| 583 | 
 % make depend | 
 % make depend | 
| 584 | 
 % make | 
 % make | 
| 585 | 
 \end{verbatim} | 
 \end{verbatim} | 
| 608 | 
 % cd verification/exp2 | 
 % cd verification/exp2 | 
| 609 | 
 % mkdir build | 
 % mkdir build | 
| 610 | 
 % cd build | 
 % cd build | 
| 611 | 
 % ../../../tools/genmake -mods=../code | 
 % ../../../tools/genmake2 -mods=../code | 
| 612 | 
 % make depend | 
 % make depend | 
| 613 | 
 % make | 
 % make | 
| 614 | 
 \end{verbatim} | 
 \end{verbatim} | 
| 630 | 
 % ./mitgcmuv > output.txt | 
 % ./mitgcmuv > output.txt | 
| 631 | 
 \end{verbatim} | 
 \end{verbatim} | 
| 632 | 
  | 
  | 
| 633 | 
 \subsubsection{Building from on a scratch disk} | 
 \subsubsection{Building on a scratch disk} | 
| 634 | 
  | 
  | 
| 635 | 
 Model object files and output data can use up large amounts of disk | 
 Model object files and output data can use up large amounts of disk | 
| 636 | 
 space so it is often the case that you will be operating on a large | 
 space so it is often the case that you will be operating on a large | 
| 638 | 
 following commands will build the model in {\em /scratch/exp2-run1}: | 
 following commands will build the model in {\em /scratch/exp2-run1}: | 
| 639 | 
 \begin{verbatim} | 
 \begin{verbatim} | 
| 640 | 
 % cd /scratch/exp2-run1 | 
 % cd /scratch/exp2-run1 | 
| 641 | 
 % ~/MITgcm/tools/genmake -rootdir=~/MITgcm -mods=~/MITgcm/verification/exp2/code | 
 % ~/MITgcm/tools/genmake2 -rootdir=~/MITgcm \ | 
| 642 | 
  | 
   -mods=~/MITgcm/verification/exp2/code | 
| 643 | 
 % make depend | 
 % make depend | 
| 644 | 
 % make | 
 % make | 
| 645 | 
 \end{verbatim} | 
 \end{verbatim} | 
| 655 | 
 % cd /scratch/exp2 | 
 % cd /scratch/exp2 | 
| 656 | 
 % mkdir build | 
 % mkdir build | 
| 657 | 
 % cd build | 
 % cd build | 
| 658 | 
 % ~/MITgcm/tools/genmake -rootdir=~/MITgcm -mods=~/MITgcm/verification/exp2/code | 
 % ~/MITgcm/tools/genmake2 -rootdir=~/MITgcm \ | 
| 659 | 
  | 
   -mods=~/MITgcm/verification/exp2/code | 
| 660 | 
 % make depend | 
 % make depend | 
| 661 | 
 % make | 
 % make | 
| 662 | 
 % cd ../ | 
 % cd ../ | 
| 666 | 
 \end{verbatim} | 
 \end{verbatim} | 
| 667 | 
  | 
  | 
| 668 | 
  | 
  | 
| 669 | 
  | 
 \subsection{Using \texttt{genmake2}} | 
 | 
 \subsection{\textit{genmake}} | 
  | 
| 670 | 
 \label{sect:genmake} | 
 \label{sect:genmake} | 
| 671 | 
  | 
  | 
| 672 | 
 To compile the code, use the script \textit{genmake} located in the \textit{% | 
 To compile the code, first use the program \texttt{genmake2} (located | 
| 673 | 
 tools} directory. \textit{genmake} is a script that generates the makefile. | 
 in the \texttt{tools} directory) to generate a Makefile. | 
| 674 | 
 It has been written so that the code can be compiled on a wide diversity of | 
 \texttt{genmake2} is a shell script written to work with all | 
| 675 | 
 machines and systems. However, if it doesn't work the first time on your | 
 ``sh''--compatible shells including bash v1, bash v2, and Bourne. | 
| 676 | 
 platform, you might need to edit certain lines of \textit{genmake} in the | 
 Internally, \texttt{genmake2} determines the locations of needed | 
| 677 | 
 section containing the setups for the different machines. The file is | 
 files, the compiler, compiler options, libraries, and Unix tools.  It | 
| 678 | 
 structured like this: | 
 relies upon a number of ``optfiles'' located in the | 
| 679 | 
 \begin{verbatim} | 
 \texttt{tools/build\_options} directory. | 
| 680 | 
         . | 
  | 
| 681 | 
         . | 
 The purpose of the optfiles is to provide all the compilation options | 
| 682 | 
         . | 
 for particular ``platforms'' (where ``platform'' roughly means the | 
| 683 | 
 general instructions (machine independent) | 
 combination of the hardware and the compiler) and code configurations. | 
| 684 | 
         . | 
 Given the combinations of possible compilers and library dependencies | 
| 685 | 
         . | 
 ({\it eg.}  MPI and NetCDF) there may be numerous optfiles available | 
| 686 | 
         . | 
 for a single machine.  The naming scheme for the majority of the | 
| 687 | 
     - setup machine 1 | 
 optfiles shipped with the code is | 
| 688 | 
     - setup machine 2 | 
 \begin{center} | 
| 689 | 
     - setup machine 3 | 
   {\bf OS\_HARDWARE\_COMPILER } | 
| 690 | 
     - setup machine 4 | 
 \end{center} | 
| 691 | 
        etc | 
 where | 
| 692 | 
         . | 
 \begin{description} | 
| 693 | 
         . | 
 \item[OS] is the name of the operating system (generally the | 
| 694 | 
         . | 
   lower-case output of the {\tt 'uname'} command) | 
| 695 | 
 \end{verbatim} | 
 \item[HARDWARE] is a string that describes the CPU type and | 
| 696 | 
  | 
   corresponds to output from the  {\tt 'uname -m'} command: | 
| 697 | 
 For example, the setup corresponding to a DEC alpha machine is reproduced | 
   \begin{description} | 
| 698 | 
 here: | 
   \item[ia32] is for ``x86'' machines such as i386, i486, i586, i686, | 
| 699 | 
 \begin{verbatim} | 
     and athlon | 
| 700 | 
   case OSF1+mpi: | 
   \item[ia64] is for Intel IA64 systems (eg. Itanium, Itanium2) | 
| 701 | 
     echo "Configuring for DEC Alpha" | 
   \item[amd64] is AMD x86\_64 systems | 
| 702 | 
     set CPP        = ( '/usr/bin/cpp -P' ) | 
   \item[ppc] is for Mac PowerPC systems | 
| 703 | 
     set DEFINES    = ( ${DEFINES}  '-DTARGET_DEC -DWORDLENGTH=1' ) | 
   \end{description} | 
| 704 | 
     set KPP        = ( 'kapf' ) | 
 \item[COMPILER] is the compiler name (generally, the name of the | 
| 705 | 
     set KPPFILES   = ( 'main.F' ) | 
   FORTRAN executable) | 
| 706 | 
     set KFLAGS1    = ( '-scan=132 -noconc -cmp=' ) | 
 \end{description} | 
 | 
     set FC         = ( 'f77' ) | 
  | 
 | 
     set FFLAGS     = ( '-convert big_endian -r8 -extend_source -automatic -call_shared -notransform_loops -align dcommons' ) | 
  | 
 | 
     set FOPTIM     = ( '-O5 -fast -tune host -inline all' ) | 
  | 
 | 
     set NOOPTFLAGS = ( '-O0' ) | 
  | 
 | 
     set LIBS       = ( '-lfmpi -lmpi -lkmp_osfp10 -pthread' ) | 
  | 
 | 
     set NOOPTFILES = ( 'barrier.F different_multiple.F external_fields_load.F') | 
  | 
 | 
     set RMFILES    = ( '*.p.out' ) | 
  | 
 | 
     breaksw | 
  | 
 | 
 \end{verbatim} | 
  | 
 | 
  | 
  | 
 | 
 Typically, these are the lines that you might need to edit to make \textit{% | 
  | 
 | 
 genmake} work on your platform if it doesn't work the first time. \textit{% | 
  | 
 | 
 genmake} understands several options that are described here: | 
  | 
 | 
  | 
  | 
 | 
 \begin{itemize} | 
  | 
 | 
 \item -rootdir=dir | 
  | 
| 707 | 
  | 
  | 
| 708 | 
 indicates where the model root directory is relative to the directory where | 
 In many cases, the default optfiles are sufficient and will result in | 
| 709 | 
 you are compiling. This option is not needed if you compile in the \textit{% | 
 usable Makefiles.  However, for some machines or code configurations, | 
| 710 | 
 bin} directory (which is the default compilation directory) or within the  | 
 new ``optfiles'' must be written. To create a new optfile, it is | 
| 711 | 
 \textit{verification} tree. | 
 generally best to start with one of the defaults and modify it to suit | 
| 712 | 
  | 
 your needs.  Like \texttt{genmake2}, the optfiles are all written | 
| 713 | 
  | 
 using a simple ``sh''--compatible syntax.  While nearly all variables | 
| 714 | 
  | 
 used within \texttt{genmake2} may be specified in the optfiles, the | 
| 715 | 
  | 
 critical ones that should be defined are: | 
| 716 | 
  | 
  | 
| 717 | 
 \item -mods=dir1,dir2,... | 
 \begin{description} | 
| 718 | 
  | 
 \item[FC] the FORTRAN compiler (executable) to use | 
| 719 | 
  | 
 \item[DEFINES] the command-line DEFINE options passed to the compiler | 
| 720 | 
  | 
 \item[CPP] the C pre-processor to use | 
| 721 | 
  | 
 \item[NOOPTFLAGS] options flags for special files that should not be | 
| 722 | 
  | 
   optimized | 
| 723 | 
  | 
 \end{description} | 
| 724 | 
  | 
  | 
| 725 | 
 indicates the relative or absolute paths directories where the sources | 
 For example, the optfile for a typical Red Hat Linux machine (``ia32'' | 
| 726 | 
 should take precedence over the default versions (located in \textit{model},  | 
 architecture) using the GCC (g77) compiler is | 
| 727 | 
 \textit{eesupp},...). Typically, this option is used when running the | 
 \begin{verbatim} | 
| 728 | 
 examples, see below. | 
 FC=g77 | 
| 729 | 
  | 
 DEFINES='-D_BYTESWAPIO -DWORDLENGTH=4' | 
| 730 | 
  | 
 CPP='cpp  -traditional -P' | 
| 731 | 
  | 
 NOOPTFLAGS='-O0' | 
| 732 | 
  | 
 #  For IEEE, use the "-ffloat-store" option | 
| 733 | 
  | 
 if test "x$IEEE" = x ; then | 
| 734 | 
  | 
     FFLAGS='-Wimplicit -Wunused -Wuninitialized' | 
| 735 | 
  | 
     FOPTIM='-O3 -malign-double -funroll-loops' | 
| 736 | 
  | 
 else | 
| 737 | 
  | 
     FFLAGS='-Wimplicit -Wunused -ffloat-store' | 
| 738 | 
  | 
     FOPTIM='-O0 -malign-double' | 
| 739 | 
  | 
 fi | 
| 740 | 
  | 
 \end{verbatim} | 
| 741 | 
  | 
  | 
| 742 | 
  | 
 If you write an optfile for an unrepresented machine or compiler, you | 
| 743 | 
  | 
 are strongly encouraged to submit the optfile to the MITgcm project | 
| 744 | 
  | 
 for inclusion.  Please send the file to the | 
| 745 | 
  | 
 \begin{rawhtml} <A href="mail-to:MITgcm-support@mitgcm.org"> \end{rawhtml} | 
| 746 | 
  | 
 \begin{center} | 
| 747 | 
  | 
   MITgcm-support@mitgcm.org | 
| 748 | 
  | 
 \end{center} | 
| 749 | 
  | 
 \begin{rawhtml} </A> \end{rawhtml} | 
| 750 | 
  | 
 mailing list. | 
| 751 | 
  | 
  | 
| 752 | 
 \item -enable=pkg1,pkg2,... | 
 In addition to the optfiles, \texttt{genmake2} supports a number of | 
| 753 | 
  | 
 helpful command-line options.  A complete list of these options can be | 
| 754 | 
  | 
 obtained from: | 
| 755 | 
  | 
 \begin{verbatim} | 
| 756 | 
  | 
 % genmake2 -h | 
| 757 | 
  | 
 \end{verbatim} | 
| 758 | 
  | 
  | 
| 759 | 
 enables packages source code \textit{pkg1}, \textit{pkg2},... when creating | 
 The most important command-line options are: | 
| 760 | 
 the makefile. | 
 \begin{description} | 
| 761 | 
  | 
    | 
| 762 | 
  | 
 \item[\texttt{--optfile=/PATH/FILENAME}] specifies the optfile that | 
| 763 | 
  | 
   should be used for a particular build. | 
| 764 | 
  | 
    | 
| 765 | 
  | 
   If no "optfile" is specified (either through the command line or the | 
| 766 | 
  | 
   MITGCM\_OPTFILE environment variable), genmake2 will try to make a | 
| 767 | 
  | 
   reasonable guess from the list provided in {\em | 
| 768 | 
  | 
     tools/build\_options}.  The method used for making this guess is | 
| 769 | 
  | 
   to first determine the combination of operating system and hardware | 
| 770 | 
  | 
   (eg. "linux\_ia32") and then find a working FORTRAN compiler within | 
| 771 | 
  | 
   the user's path.  When these three items have been identified, | 
| 772 | 
  | 
   genmake2 will try to find an optfile that has a matching name. | 
| 773 | 
  | 
    | 
| 774 | 
  | 
 \item[\texttt{--pdefault='PKG1 PKG2 PKG3 ...'}] specifies the default | 
| 775 | 
  | 
   set of packages to be used.  The normal order of precedence for | 
| 776 | 
  | 
   packages is as follows: | 
| 777 | 
  | 
   \begin{enumerate} | 
| 778 | 
  | 
   \item If available, the command line (\texttt{--pdefault}) settings | 
| 779 | 
  | 
     over-rule any others. | 
| 780 | 
  | 
  | 
| 781 | 
  | 
   \item Next, \texttt{genmake2} will look for a file named | 
| 782 | 
  | 
     ``\texttt{packages.conf}'' in the local directory or in any of the | 
| 783 | 
  | 
     directories specified with the \texttt{--mods} option. | 
| 784 | 
  | 
      | 
| 785 | 
  | 
   \item Finally, if neither of the above are available, | 
| 786 | 
  | 
     \texttt{genmake2} will use the \texttt{/pkg/pkg\_default} file. | 
| 787 | 
  | 
   \end{enumerate} | 
| 788 | 
  | 
    | 
| 789 | 
  | 
 \item[\texttt{--pdepend=/PATH/FILENAME}] specifies the dependency file | 
| 790 | 
  | 
   used for packages. | 
| 791 | 
  | 
    | 
| 792 | 
  | 
   If not specified, the default dependency file {\em pkg/pkg\_depend} | 
| 793 | 
  | 
   is used.  The syntax for this file is parsed on a line-by-line basis | 
| 794 | 
  | 
   where each line containes either a comment ("\#") or a simple | 
| 795 | 
  | 
   "PKGNAME1 (+|-)PKGNAME2" pairwise rule where the "+" or "-" symbol | 
| 796 | 
  | 
   specifies a "must be used with" or a "must not be used with" | 
| 797 | 
  | 
   relationship, respectively.  If no rule is specified, then it is | 
| 798 | 
  | 
   assumed that the two packages are compatible and will function | 
| 799 | 
  | 
   either with or without each other. | 
| 800 | 
  | 
    | 
| 801 | 
  | 
 \item[\texttt{--adof=/path/to/file}] specifies the "adjoint" or | 
| 802 | 
  | 
   automatic differentiation options file to be used.  The file is | 
| 803 | 
  | 
   analogous to the ``optfile'' defined above but it specifies | 
| 804 | 
  | 
   information for the AD build process. | 
| 805 | 
  | 
    | 
| 806 | 
  | 
   The default file is located in {\em | 
| 807 | 
  | 
     tools/adjoint\_options/adjoint\_default} and it defines the "TAF" | 
| 808 | 
  | 
   and "TAMC" compilers.  An alternate version is also available at | 
| 809 | 
  | 
   {\em tools/adjoint\_options/adjoint\_staf} that selects the newer | 
| 810 | 
  | 
   "STAF" compiler.  As with any compilers, it is helpful to have their | 
| 811 | 
  | 
   directories listed in your {\tt \$PATH} environment variable. | 
| 812 | 
  | 
    | 
| 813 | 
  | 
 \item[\texttt{--mods='DIR1 DIR2 DIR3 ...'}] specifies a list of | 
| 814 | 
  | 
   directories containing ``modifications''.  These directories contain | 
| 815 | 
  | 
   files with names that may (or may not) exist in the main MITgcm | 
| 816 | 
  | 
   source tree but will be overridden by any identically-named sources | 
| 817 | 
  | 
   within the ``MODS'' directories. | 
| 818 | 
  | 
    | 
| 819 | 
  | 
   The order of precedence for this "name-hiding" is as follows: | 
| 820 | 
  | 
   \begin{itemize} | 
| 821 | 
  | 
   \item ``MODS'' directories (in the order given) | 
| 822 | 
  | 
   \item Packages either explicitly specified or provided by default | 
| 823 | 
  | 
     (in the order given) | 
| 824 | 
  | 
   \item Packages included due to package dependencies (in the order | 
| 825 | 
  | 
     that that package dependencies are parsed) | 
| 826 | 
  | 
   \item The "standard dirs" (which may have been specified by the | 
| 827 | 
  | 
     ``-standarddirs'' option) | 
| 828 | 
  | 
   \end{itemize} | 
| 829 | 
  | 
    | 
| 830 | 
  | 
 \item[\texttt{--mpi}] This option enables certain MPI features (using | 
| 831 | 
  | 
   CPP \texttt{\#define}s) within the code and is necessary for MPI | 
| 832 | 
  | 
   builds (see Section \ref{sect:mpi-build}). | 
| 833 | 
  | 
    | 
| 834 | 
  | 
 \item[\texttt{--make=/path/to/gmake}] Due to the poor handling of | 
| 835 | 
  | 
   soft-links and other bugs common with the \texttt{make} versions | 
| 836 | 
  | 
   provided by commercial Unix vendors, GNU \texttt{make} (sometimes | 
| 837 | 
  | 
   called \texttt{gmake}) should be preferred.  This option provides a | 
| 838 | 
  | 
   means for specifying the make executable to be used. | 
| 839 | 
  | 
    | 
| 840 | 
  | 
 \item[\texttt{--bash=/path/to/sh}] On some (usually older UNIX) | 
| 841 | 
  | 
   machines, the ``bash'' shell is unavailable.  To run on these | 
| 842 | 
  | 
   systems, \texttt{genmake2} can be invoked using an ``sh'' (that is, | 
| 843 | 
  | 
   a Bourne, POSIX, or compatible) shell.  The syntax in these | 
| 844 | 
  | 
   circumstances is: | 
| 845 | 
  | 
   \begin{center} | 
| 846 | 
  | 
     \texttt{\%  /bin/sh genmake2 -bash=/bin/sh [...options...]} | 
| 847 | 
  | 
   \end{center} | 
| 848 | 
  | 
   where \texttt{/bin/sh} can be replaced with the full path and name | 
| 849 | 
  | 
   of the desired shell. | 
| 850 | 
  | 
  | 
| 851 | 
 \item -disable=pkg1,pkg2,... | 
 \end{description} | 
| 852 | 
  | 
  | 
 | 
 disables packages source code \textit{pkg1}, \textit{pkg2},... when creating | 
  | 
 | 
 the makefile. | 
  | 
| 853 | 
  | 
  | 
| 854 | 
 \item -platform=machine | 
 \subsection{Building with MPI} | 
| 855 | 
  | 
 \label{sect:mpi-build} | 
| 856 | 
  | 
  | 
| 857 | 
 specifies the platform for which you want the makefile. In general, you | 
 Building MITgcm to use MPI libraries can be complicated due to the | 
| 858 | 
 won't need this option. \textit{genmake} will select the right machine for | 
 variety of different MPI implementations available, their dependencies | 
| 859 | 
 you (the one you're working on!). However, this option is useful if you have | 
 or interactions with different compilers, and their often ad-hoc | 
| 860 | 
 a choice of several compilers on one machine and you want to use the one | 
 locations within file systems.  For these reasons, its generally a | 
| 861 | 
 that is not the default (ex: \texttt{pgf77} instead of \texttt{f77} under | 
 good idea to start by finding and reading the documentation for your | 
| 862 | 
 Linux). | 
 machine(s) and, if necessary, seeking help from your local systems | 
| 863 | 
  | 
 administrator. | 
| 864 | 
  | 
  | 
| 865 | 
 \item -mpi | 
 The steps for building MITgcm with MPI support are: | 
| 866 | 
  | 
 \begin{enumerate} | 
| 867 | 
  | 
    | 
| 868 | 
  | 
 \item Determine the locations of your MPI-enabled compiler and/or MPI | 
| 869 | 
  | 
   libraries and put them into an options file as described in Section | 
| 870 | 
  | 
   \ref{sect:genmake}.  One can start with one of the examples in: | 
| 871 | 
  | 
   \begin{rawhtml} <A | 
| 872 | 
  | 
     href="http://mitgcm.org/cgi-bin/viewcvs.cgi/MITgcm/tools/build_options/"> | 
| 873 | 
  | 
   \end{rawhtml} | 
| 874 | 
  | 
   \begin{center} | 
| 875 | 
  | 
     \texttt{MITgcm/tools/build\_options/} | 
| 876 | 
  | 
   \end{center} | 
| 877 | 
  | 
   \begin{rawhtml} </A> \end{rawhtml} | 
| 878 | 
  | 
   such as \texttt{linux\_ia32\_g77+mpi\_cg01} or | 
| 879 | 
  | 
   \texttt{linux\_ia64\_efc+mpi} and then edit it to suit the machine at | 
| 880 | 
  | 
   hand.  You may need help from your user guide or local systems | 
| 881 | 
  | 
   administrator to determine the exact location of the MPI libraries. | 
| 882 | 
  | 
   If libraries are not installed, MPI implementations and related | 
| 883 | 
  | 
   tools are available including: | 
| 884 | 
  | 
   \begin{itemize} | 
| 885 | 
  | 
   \item \begin{rawhtml} <A | 
| 886 | 
  | 
       href="http://www-unix.mcs.anl.gov/mpi/mpich/"> | 
| 887 | 
  | 
     \end{rawhtml} | 
| 888 | 
  | 
     MPICH | 
| 889 | 
  | 
     \begin{rawhtml} </A> \end{rawhtml} | 
| 890 | 
  | 
  | 
| 891 | 
  | 
   \item \begin{rawhtml} <A | 
| 892 | 
  | 
       href="http://www.lam-mpi.org/"> | 
| 893 | 
  | 
     \end{rawhtml} | 
| 894 | 
  | 
     LAM/MPI | 
| 895 | 
  | 
     \begin{rawhtml} </A> \end{rawhtml} | 
| 896 | 
  | 
  | 
| 897 | 
  | 
   \item \begin{rawhtml} <A | 
| 898 | 
  | 
       href="http://www.osc.edu/~pw/mpiexec/"> | 
| 899 | 
  | 
     \end{rawhtml} | 
| 900 | 
  | 
     MPIexec | 
| 901 | 
  | 
     \begin{rawhtml} </A> \end{rawhtml} | 
| 902 | 
  | 
   \end{itemize} | 
| 903 | 
  | 
    | 
| 904 | 
  | 
 \item Build the code with the \texttt{genmake2} \texttt{-mpi} option | 
| 905 | 
  | 
   (see Section \ref{sect:genmake}) using commands such as: | 
| 906 | 
  | 
 {\footnotesize \begin{verbatim} | 
| 907 | 
  | 
   %  ../../../tools/genmake2 -mods=../code -mpi -of=YOUR_OPTFILE | 
| 908 | 
  | 
   %  make depend | 
| 909 | 
  | 
   %  make | 
| 910 | 
  | 
 \end{verbatim} } | 
| 911 | 
  | 
    | 
| 912 | 
  | 
 \item Run the code with the appropriate MPI ``run'' or ``exec'' | 
| 913 | 
  | 
   program provided with your particular implementation of MPI. | 
| 914 | 
  | 
   Typical MPI packages such as MPICH will use something like: | 
| 915 | 
  | 
 \begin{verbatim} | 
| 916 | 
  | 
   %  mpirun -np 4 -machinefile mf ./mitgcmuv | 
| 917 | 
  | 
 \end{verbatim} | 
| 918 | 
  | 
   Sightly more complicated scripts may be needed for many machines | 
| 919 | 
  | 
   since execution of the code may be controlled by both the MPI | 
| 920 | 
  | 
   library and a job scheduling and queueing system such as PBS, | 
| 921 | 
  | 
   LoadLeveller, Condor, or any of a number of similar tools.  A few | 
| 922 | 
  | 
   example scripts (those used for our \begin{rawhtml} <A | 
| 923 | 
  | 
     href="http://mitgcm.org/testing.html"> \end{rawhtml}regular | 
| 924 | 
  | 
   verification runs\begin{rawhtml} </A> \end{rawhtml}) are available | 
| 925 | 
  | 
   at: | 
| 926 | 
  | 
   \begin{rawhtml} <A | 
| 927 | 
  | 
     href="http://mitgcm.org/cgi-bin/viewcvs.cgi/MITgcm_contrib/test_scripts/"> | 
| 928 | 
  | 
   \end{rawhtml} | 
| 929 | 
  | 
   {\footnotesize \tt | 
| 930 | 
  | 
     http://mitgcm.org/cgi-bin/viewcvs.cgi/MITgcm\_contrib/test\_scripts/ } | 
| 931 | 
  | 
   \begin{rawhtml} </A> \end{rawhtml} | 
| 932 | 
  | 
  | 
| 933 | 
 this is used when you want to run the model in parallel processing mode | 
 \end{enumerate} | 
 | 
 under mpi (see section on parallel computation for more details). | 
  | 
| 934 | 
  | 
  | 
| 935 | 
 \item -jam | 
 An example of the above process on the MITgcm cluster (``cg01'') using | 
| 936 | 
  | 
 the GNU g77 compiler and the mpich MPI library is: | 
| 937 | 
  | 
  | 
| 938 | 
 this is used when you want to run the model in parallel processing mode | 
 {\footnotesize \begin{verbatim} | 
| 939 | 
 under jam (see section on parallel computation for more details). | 
   %  cd MITgcm/verification/exp5 | 
| 940 | 
 \end{itemize} | 
   %  mkdir build | 
| 941 | 
  | 
   %  cd build | 
| 942 | 
  | 
   %  ../../../tools/genmake2 -mpi -mods=../code \ | 
| 943 | 
  | 
        -of=../../../tools/build_options/linux_ia32_g77+mpi_cg01 | 
| 944 | 
  | 
   %  make depend | 
| 945 | 
  | 
   %  make | 
| 946 | 
  | 
   %  cd ../input | 
| 947 | 
  | 
   %  /usr/local/pkg/mpi/mpi-1.2.4..8a-gm-1.5/g77/bin/mpirun.ch_gm \ | 
| 948 | 
  | 
        -machinefile mf --gm-kill 5 -v -np 2  ../build/mitgcmuv | 
| 949 | 
  | 
 \end{verbatim} } | 
| 950 | 
  | 
  | 
 | 
 For some of the examples, there is a file called \textit{.genmakerc} in the  | 
  | 
 | 
 \textit{input} directory that has the relevant \textit{genmake} options for | 
  | 
 | 
 that particular example. In this way you don't need to type the options when | 
  | 
 | 
 invoking \textit{genmake}. | 
  | 
| 951 | 
  | 
  | 
| 952 | 
  | 
  | 
| 953 | 
 \section{Running the model} | 
 \section[Running MITgcm]{Running the model in prognostic mode} | 
| 954 | 
 \label{sect:runModel} | 
 \label{sect:runModel} | 
| 955 | 
  | 
  | 
| 956 | 
 If compilation finished succesfuully (section \ref{sect:buildModel}) | 
 If compilation finished succesfuully (section \ref{sect:buildingCode}) | 
| 957 | 
 then an executable called {\em mitgcmuv} will now exist in the local | 
 then an executable called \texttt{mitgcmuv} will now exist in the | 
| 958 | 
 directory. | 
 local directory. | 
| 959 | 
  | 
  | 
| 960 | 
 To run the model as a single process (ie. not in parallel) simply | 
 To run the model as a single process (ie. not in parallel) simply | 
| 961 | 
 type: | 
 type: | 
| 973 | 
 % ./mitgcmuv > output.txt | 
 % ./mitgcmuv > output.txt | 
| 974 | 
 \end{verbatim} | 
 \end{verbatim} | 
| 975 | 
  | 
  | 
| 976 | 
 For the example experiments in {\em vericication}, an example of the | 
 For the example experiments in {\em verification}, an example of the | 
| 977 | 
 output is kept in {\em results/output.txt} for comparison. You can compare | 
 output is kept in {\em results/output.txt} for comparison. You can compare | 
| 978 | 
 your {\em output.txt} with this one to check that the set-up works. | 
 your {\em output.txt} with this one to check that the set-up works. | 
| 979 | 
  | 
  | 
| 1059 | 
 >> for n=1:11; imagesc(eta(:,:,n)');axis ij;colorbar;pause(.5);end | 
 >> for n=1:11; imagesc(eta(:,:,n)');axis ij;colorbar;pause(.5);end | 
| 1060 | 
 \end{verbatim} | 
 \end{verbatim} | 
| 1061 | 
  | 
  | 
| 1062 | 
 \section{Doing it yourself: customizing the code} | 
 \section[Customizing MITgcm]{Doing it yourself: customizing the code} | 
| 1063 | 
  | 
  | 
| 1064 | 
 When you are ready to run the model in the configuration you want, the | 
 When you are ready to run the model in the configuration you want, the | 
| 1065 | 
 easiest thing is to use and adapt the setup of the case studies experiment | 
 easiest thing is to use and adapt the setup of the case studies | 
| 1066 | 
 (described previously) that is the closest to your configuration. Then, the | 
 experiment (described previously) that is the closest to your | 
| 1067 | 
 amount of setup will be minimized. In this section, we focus on the setup | 
 configuration. Then, the amount of setup will be minimized. In this | 
| 1068 | 
 relative to the ''numerical model'' part of the code (the setup relative to | 
 section, we focus on the setup relative to the ``numerical model'' | 
| 1069 | 
 the ''execution environment'' part is covered in the parallel implementation | 
 part of the code (the setup relative to the ``execution environment'' | 
| 1070 | 
 section) and on the variables and parameters that you are likely to change. | 
 part is covered in the parallel implementation section) and on the | 
| 1071 | 
  | 
 variables and parameters that you are likely to change. | 
| 1072 | 
  | 
  | 
| 1073 | 
 \subsection{Configuration and setup} | 
 \subsection{Configuration and setup} | 
| 1074 | 
  | 
  | 
| 1075 | 
 The CPP keys relative to the ''numerical model'' part of the code are all | 
 The CPP keys relative to the ``numerical model'' part of the code are | 
| 1076 | 
 defined and set in the file \textit{CPP\_OPTIONS.h }in the directory \textit{% | 
 all defined and set in the file \textit{CPP\_OPTIONS.h }in the | 
| 1077 | 
 model/inc }or in one of the \textit{code }directories of the case study | 
 directory \textit{ model/inc }or in one of the \textit{code | 
| 1078 | 
 experiments under \textit{verification.} The model parameters are defined | 
 }directories of the case study experiments under | 
| 1079 | 
 and declared in the file \textit{model/inc/PARAMS.h }and their default | 
 \textit{verification.} The model parameters are defined and declared | 
| 1080 | 
 values are set in the routine \textit{model/src/set\_defaults.F. }The | 
 in the file \textit{model/inc/PARAMS.h }and their default values are | 
| 1081 | 
 default values can be modified in the namelist file \textit{data }which | 
 set in the routine \textit{model/src/set\_defaults.F. }The default | 
| 1082 | 
 needs to be located in the directory where you will run the model. The | 
 values can be modified in the namelist file \textit{data }which needs | 
| 1083 | 
 parameters are initialized in the routine \textit{model/src/ini\_parms.F}. | 
 to be located in the directory where you will run the model. The | 
| 1084 | 
 Look at this routine to see in what part of the namelist the parameters are | 
 parameters are initialized in the routine | 
| 1085 | 
 located. | 
 \textit{model/src/ini\_parms.F}.  Look at this routine to see in what | 
| 1086 | 
  | 
 part of the namelist the parameters are located. | 
| 1087 | 
 In what follows the parameters are grouped into categories related to the | 
  | 
| 1088 | 
 computational domain, the equations solved in the model, and the simulation | 
 In what follows the parameters are grouped into categories related to | 
| 1089 | 
 controls. | 
 the computational domain, the equations solved in the model, and the | 
| 1090 | 
  | 
 simulation controls. | 
| 1091 | 
  | 
  | 
| 1092 | 
 \subsection{Computational domain, geometry and time-discretization} | 
 \subsection{Computational domain, geometry and time-discretization} | 
| 1093 | 
  | 
  | 
| 1094 | 
 \begin{itemize} | 
 \begin{description} | 
| 1095 | 
 \item dimensions | 
 \item[dimensions] \  | 
| 1096 | 
 \end{itemize} | 
    | 
| 1097 | 
  | 
   The number of points in the x, y, and r directions are represented | 
| 1098 | 
 The number of points in the x, y,\textit{\ }and r\textit{\ }directions are | 
   by the variables \textbf{sNx}, \textbf{sNy} and \textbf{Nr} | 
| 1099 | 
 represented by the variables \textbf{sNx}\textit{, }\textbf{sNy}\textit{, }% | 
   respectively which are declared and set in the file | 
| 1100 | 
 and \textbf{Nr}\textit{\ }respectively which are declared and set in the | 
   \textit{model/inc/SIZE.h}.  (Again, this assumes a mono-processor | 
| 1101 | 
 file \textit{model/inc/SIZE.h. }(Again, this assumes a mono-processor | 
   calculation. For multiprocessor calculations see the section on | 
| 1102 | 
 calculation. For multiprocessor calculations see section on parallel | 
   parallel implementation.) | 
| 1103 | 
 implementation.) | 
  | 
| 1104 | 
  | 
 \item[grid] \  | 
| 1105 | 
 \begin{itemize} | 
    | 
| 1106 | 
 \item grid | 
   Three different grids are available: cartesian, spherical polar, and | 
| 1107 | 
 \end{itemize} | 
   curvilinear (which includes the cubed sphere). The grid is set | 
| 1108 | 
  | 
   through the logical variables \textbf{usingCartesianGrid}, | 
| 1109 | 
 Three different grids are available: cartesian, spherical polar, and | 
   \textbf{usingSphericalPolarGrid}, and \textbf{usingCurvilinearGrid}. | 
| 1110 | 
 curvilinear (including the cubed sphere). The grid is set through the | 
   In the case of spherical and curvilinear grids, the southern | 
| 1111 | 
 logical variables \textbf{usingCartesianGrid}\textit{, }\textbf{% | 
   boundary is defined through the variable \textbf{phiMin} which | 
| 1112 | 
 usingSphericalPolarGrid}\textit{, }and \textit{\ }\textbf{% | 
   corresponds to the latitude of the southern most cell face (in | 
| 1113 | 
 usingCurvilinearGrid}\textit{. }In the case of spherical and curvilinear | 
   degrees). The resolution along the x and y directions is controlled | 
| 1114 | 
 grids, the southern boundary is defined through the variable \textbf{phiMin}% | 
   by the 1D arrays \textbf{delx} and \textbf{dely} (in meters in the | 
| 1115 | 
 \textit{\ }which corresponds to the latitude of the southern most cell face | 
   case of a cartesian grid, in degrees otherwise).  The vertical grid | 
| 1116 | 
 (in degrees). The resolution along the x and y directions is controlled by | 
   spacing is set through the 1D array \textbf{delz} for the ocean (in | 
| 1117 | 
 the 1D arrays \textbf{delx}\textit{\ }and \textbf{dely}\textit{\ }(in meters | 
   meters) or \textbf{delp} for the atmosphere (in Pa).  The variable | 
| 1118 | 
 in the case of a cartesian grid, in degrees otherwise). The vertical grid | 
   \textbf{Ro\_SeaLevel} represents the standard position of Sea-Level | 
| 1119 | 
 spacing is set through the 1D array \textbf{delz }for the ocean (in meters) | 
   in ``R'' coordinate. This is typically set to 0m for the ocean | 
| 1120 | 
 or \textbf{delp}\textit{\ }for the atmosphere (in Pa). The variable \textbf{% | 
   (default value) and 10$^{5}$Pa for the atmosphere. For the | 
| 1121 | 
 Ro\_SeaLevel} represents the standard position of Sea-Level in ''R'' | 
   atmosphere, also set the logical variable \textbf{groundAtK1} to | 
| 1122 | 
 coordinate. This is typically set to 0m for the ocean (default value) and 10$% | 
   \texttt{'.TRUE.'} which puts the first level (k=1) at the lower | 
| 1123 | 
 ^{5}$Pa for the atmosphere. For the atmosphere, also set the logical | 
   boundary (ground). | 
| 1124 | 
 variable \textbf{groundAtK1} to '.\texttt{TRUE}.'. which put the first level | 
    | 
| 1125 | 
 (k=1) at the lower boundary (ground). | 
   For the cartesian grid case, the Coriolis parameter $f$ is set | 
| 1126 | 
  | 
   through the variables \textbf{f0} and \textbf{beta} which correspond | 
| 1127 | 
 For the cartesian grid case, the Coriolis parameter $f$ is set through the | 
   to the reference Coriolis parameter (in s$^{-1}$) and | 
| 1128 | 
 variables \textbf{f0}\textit{\ }and \textbf{beta}\textit{\ }which correspond | 
   $\frac{\partial f}{ \partial y}$(in m$^{-1}$s$^{-1}$) respectively. | 
| 1129 | 
 to the reference Coriolis parameter (in s$^{-1}$) and $\frac{\partial f}{% | 
   If \textbf{beta } is set to a nonzero value, \textbf{f0} is the | 
| 1130 | 
 \partial y}$(in m$^{-1}$s$^{-1}$) respectively. If \textbf{beta }\textit{\ }% | 
   value of $f$ at the southern edge of the domain. | 
| 1131 | 
 is set to a nonzero value, \textbf{f0}\textit{\ }is the value of $f$ at the | 
  | 
| 1132 | 
 southern edge of the domain. | 
 \item[topography - full and partial cells] \  | 
| 1133 | 
  | 
    | 
| 1134 | 
 \begin{itemize} | 
   The domain bathymetry is read from a file that contains a 2D (x,y) | 
| 1135 | 
 \item topography - full and partial cells | 
   map of depths (in m) for the ocean or pressures (in Pa) for the | 
| 1136 | 
 \end{itemize} | 
   atmosphere. The file name is represented by the variable | 
| 1137 | 
  | 
   \textbf{bathyFile}. The file is assumed to contain binary numbers | 
| 1138 | 
 The domain bathymetry is read from a file that contains a 2D (x,y) map of | 
   giving the depth (pressure) of the model at each grid cell, ordered | 
| 1139 | 
 depths (in m) for the ocean or pressures (in Pa) for the atmosphere. The | 
   with the x coordinate varying fastest. The points are ordered from | 
| 1140 | 
 file name is represented by the variable \textbf{bathyFile}\textit{. }The | 
   low coordinate to high coordinate for both axes. The model code | 
| 1141 | 
 file is assumed to contain binary numbers giving the depth (pressure) of the | 
   applies without modification to enclosed, periodic, and double | 
| 1142 | 
 model at each grid cell, ordered with the x coordinate varying fastest. The | 
   periodic domains. Periodicity is assumed by default and is | 
| 1143 | 
 points are ordered from low coordinate to high coordinate for both axes. The | 
   suppressed by setting the depths to 0m for the cells at the limits | 
| 1144 | 
 model code applies without modification to enclosed, periodic, and double | 
   of the computational domain (note: not sure this is the case for the | 
| 1145 | 
 periodic domains. Periodicity is assumed by default and is suppressed by | 
   atmosphere). The precision with which to read the binary data is | 
| 1146 | 
 setting the depths to 0m for the cells at the limits of the computational | 
   controlled by the integer variable \textbf{readBinaryPrec} which can | 
| 1147 | 
 domain (note: not sure this is the case for the atmosphere). The precision | 
   take the value \texttt{32} (single precision) or \texttt{64} (double | 
| 1148 | 
 with which to read the binary data is controlled by the integer variable  | 
   precision). See the matlab program \textit{gendata.m} in the | 
| 1149 | 
 \textbf{readBinaryPrec }which can take the value \texttt{32} (single | 
   \textit{input} directories under \textit{verification} to see how | 
| 1150 | 
 precision) or \texttt{64} (double precision). See the matlab program \textit{% | 
   the bathymetry files are generated for the case study experiments. | 
| 1151 | 
 gendata.m }in the \textit{input }directories under \textit{verification }to | 
    | 
| 1152 | 
 see how the bathymetry files are generated for the case study experiments. | 
   To use the partial cell capability, the variable \textbf{hFacMin} | 
| 1153 | 
  | 
   needs to be set to a value between 0 and 1 (it is set to 1 by | 
| 1154 | 
 To use the partial cell capability, the variable \textbf{hFacMin}\textit{\ }% | 
   default) corresponding to the minimum fractional size of the cell. | 
| 1155 | 
 needs to be set to a value between 0 and 1 (it is set to 1 by default) | 
   For example if the bottom cell is 500m thick and \textbf{hFacMin} is | 
| 1156 | 
 corresponding to the minimum fractional size of the cell. For example if the | 
   set to 0.1, the actual thickness of the cell (i.e. used in the code) | 
| 1157 | 
 bottom cell is 500m thick and \textbf{hFacMin}\textit{\ }is set to 0.1, the | 
   can cover a range of discrete values 50m apart from 50m to 500m | 
| 1158 | 
 actual thickness of the cell (i.e. used in the code) can cover a range of | 
   depending on the value of the bottom depth (in \textbf{bathyFile}) | 
| 1159 | 
 discrete values 50m apart from 50m to 500m depending on the value of the | 
   at this point. | 
| 1160 | 
 bottom depth (in \textbf{bathyFile}) at this point. | 
    | 
| 1161 | 
  | 
   Note that the bottom depths (or pressures) need not coincide with | 
| 1162 | 
 Note that the bottom depths (or pressures) need not coincide with the models | 
   the models levels as deduced from \textbf{delz} or \textbf{delp}. | 
| 1163 | 
 levels as deduced from \textbf{delz}\textit{\ }or\textit{\ }\textbf{delp}% | 
   The model will interpolate the numbers in \textbf{bathyFile} so that | 
| 1164 | 
 \textit{. }The model will interpolate the numbers in \textbf{bathyFile}% | 
   they match the levels obtained from \textbf{delz} or \textbf{delp} | 
| 1165 | 
 \textit{\ }so that they match the levels obtained from \textbf{delz}\textit{% | 
   and \textbf{hFacMin}. | 
| 1166 | 
 \ }or\textit{\ }\textbf{delp}\textit{\ }and \textbf{hFacMin}\textit{. } | 
    | 
| 1167 | 
  | 
   (Note: the atmospheric case is a bit more complicated than what is | 
| 1168 | 
 (Note: the atmospheric case is a bit more complicated than what is written | 
   written here I think. To come soon...) | 
| 1169 | 
 here I think. To come soon...) | 
  | 
| 1170 | 
  | 
 \item[time-discretization] \  | 
| 1171 | 
  | 
    | 
| 1172 | 
  | 
   The time steps are set through the real variables \textbf{deltaTMom} | 
| 1173 | 
  | 
   and \textbf{deltaTtracer} (in s) which represent the time step for | 
| 1174 | 
  | 
   the momentum and tracer equations, respectively. For synchronous | 
| 1175 | 
  | 
   integrations, simply set the two variables to the same value (or you | 
| 1176 | 
  | 
   can prescribe one time step only through the variable | 
| 1177 | 
  | 
   \textbf{deltaT}). The Adams-Bashforth stabilizing parameter is set | 
| 1178 | 
  | 
   through the variable \textbf{abEps} (dimensionless). The stagger | 
| 1179 | 
  | 
   baroclinic time stepping can be activated by setting the logical | 
| 1180 | 
  | 
   variable \textbf{staggerTimeStep} to \texttt{'.TRUE.'}. | 
| 1181 | 
  | 
  | 
| 1182 | 
 \begin{itemize} | 
 \end{description} | 
 | 
 \item time-discretization | 
  | 
 | 
 \end{itemize} | 
  | 
| 1183 | 
  | 
  | 
 | 
 The time steps are set through the real variables \textbf{deltaTMom} | 
  | 
 | 
 and \textbf{deltaTtracer} (in s) which represent the time step for the | 
  | 
 | 
 momentum and tracer equations, respectively. For synchronous | 
  | 
 | 
 integrations, simply set the two variables to the same value (or you | 
  | 
 | 
 can prescribe one time step only through the variable | 
  | 
 | 
 \textbf{deltaT}). The Adams-Bashforth stabilizing parameter is set | 
  | 
 | 
 through the variable \textbf{abEps} (dimensionless). The stagger | 
  | 
 | 
 baroclinic time stepping can be activated by setting the logical | 
  | 
 | 
 variable \textbf{staggerTimeStep} to '.\texttt{TRUE}.'. | 
  | 
| 1184 | 
  | 
  | 
| 1185 | 
 \subsection{Equation of state} | 
 \subsection{Equation of state} | 
| 1186 | 
  | 
  | 
| 1195 | 
  | 
  | 
| 1196 | 
 The form of the equation of state is controlled by the character | 
 The form of the equation of state is controlled by the character | 
| 1197 | 
 variables \textbf{buoyancyRelation} and \textbf{eosType}. | 
 variables \textbf{buoyancyRelation} and \textbf{eosType}. | 
| 1198 | 
 \textbf{buoyancyRelation} is set to '\texttt{OCEANIC}' by default and | 
 \textbf{buoyancyRelation} is set to \texttt{'OCEANIC'} by default and | 
| 1199 | 
 needs to be set to '\texttt{ATMOSPHERIC}' for atmosphere simulations. | 
 needs to be set to \texttt{'ATMOSPHERIC'} for atmosphere simulations. | 
| 1200 | 
 In this case, \textbf{eosType} must be set to '\texttt{IDEALGAS}'. | 
 In this case, \textbf{eosType} must be set to \texttt{'IDEALGAS'}. | 
| 1201 | 
 For the ocean, two forms of the equation of state are available: | 
 For the ocean, two forms of the equation of state are available: | 
| 1202 | 
 linear (set \textbf{eosType} to '\texttt{LINEAR}') and a polynomial | 
 linear (set \textbf{eosType} to \texttt{'LINEAR'}) and a polynomial | 
| 1203 | 
 approximation to the full nonlinear equation ( set | 
 approximation to the full nonlinear equation ( set \textbf{eosType} to | 
| 1204 | 
 \textbf{eosType}\textit{\ }to '\texttt{POLYNOMIAL}'). In the linear | 
 \texttt{'POLYNOMIAL'}). In the linear case, you need to specify the | 
| 1205 | 
 case, you need to specify the thermal and haline expansion | 
 thermal and haline expansion coefficients represented by the variables | 
| 1206 | 
 coefficients represented by the variables \textbf{tAlpha}\textit{\  | 
 \textbf{tAlpha} (in K$^{-1}$) and \textbf{sBeta} (in ppt$^{-1}$). For | 
| 1207 | 
   }(in K$^{-1}$) and \textbf{sBeta} (in ppt$^{-1}$). For the nonlinear | 
 the nonlinear case, you need to generate a file of polynomial | 
| 1208 | 
 case, you need to generate a file of polynomial coefficients called | 
 coefficients called \textit{POLY3.COEFFS}. To do this, use the program | 
 | 
 \textit{POLY3.COEFFS}. To do this, use the program | 
  | 
| 1209 | 
 \textit{utils/knudsen2/knudsen2.f} under the model tree (a Makefile is | 
 \textit{utils/knudsen2/knudsen2.f} under the model tree (a Makefile is | 
| 1210 | 
 available in the same directory and you will need to edit the number | 
 available in the same directory and you will need to edit the number | 
| 1211 | 
 and the values of the vertical levels in \textit{knudsen2.f} so that | 
 and the values of the vertical levels in \textit{knudsen2.f} so that | 
| 1213 | 
  | 
  | 
| 1214 | 
 There there are also higher polynomials for the equation of state: | 
 There there are also higher polynomials for the equation of state: | 
| 1215 | 
 \begin{description} | 
 \begin{description} | 
| 1216 | 
 \item['\texttt{UNESCO}':] The UNESCO equation of state formula of | 
 \item[\texttt{'UNESCO'}:] The UNESCO equation of state formula of | 
| 1217 | 
   Fofonoff and Millard \cite{fofonoff83}. This equation of state | 
   Fofonoff and Millard \cite{fofonoff83}. This equation of state | 
| 1218 | 
   assumes in-situ temperature, which is not a model variable; \emph{its use | 
   assumes in-situ temperature, which is not a model variable; {\em its | 
| 1219 | 
   is therefore discouraged, and it is only listed for completeness}. | 
     use is therefore discouraged, and it is only listed for | 
| 1220 | 
 \item['\texttt{JMD95Z}':] A modified UNESCO formula by Jackett and | 
     completeness}. | 
| 1221 | 
  | 
 \item[\texttt{'JMD95Z'}:] A modified UNESCO formula by Jackett and | 
| 1222 | 
   McDougall \cite{jackett95}, which uses the model variable potential | 
   McDougall \cite{jackett95}, which uses the model variable potential | 
| 1223 | 
   temperature as input. The '\texttt{Z}' indicates that this equation | 
   temperature as input. The \texttt{'Z'} indicates that this equation | 
| 1224 | 
   of state uses a horizontally and temporally constant pressure | 
   of state uses a horizontally and temporally constant pressure | 
| 1225 | 
   $p_{0}=-g\rho_{0}z$.  | 
   $p_{0}=-g\rho_{0}z$.  | 
| 1226 | 
 \item['\texttt{JMD95P}':] A modified UNESCO formula by Jackett and | 
 \item[\texttt{'JMD95P'}:] A modified UNESCO formula by Jackett and | 
| 1227 | 
   McDougall \cite{jackett95}, which uses the model variable potential | 
   McDougall \cite{jackett95}, which uses the model variable potential | 
| 1228 | 
   temperature as input. The '\texttt{P}' indicates that this equation | 
   temperature as input. The \texttt{'P'} indicates that this equation | 
| 1229 | 
   of state uses the actual hydrostatic pressure of the last time | 
   of state uses the actual hydrostatic pressure of the last time | 
| 1230 | 
   step. Lagging the pressure in this way requires an additional pickup | 
   step. Lagging the pressure in this way requires an additional pickup | 
| 1231 | 
   file for restarts. | 
   file for restarts. | 
| 1232 | 
 \item['\texttt{MDJWF}':] The new, more accurate and less expensive | 
 \item[\texttt{'MDJWF'}:] The new, more accurate and less expensive | 
| 1233 | 
   equation of state by McDougall et~al. \cite{mcdougall03}. It also | 
   equation of state by McDougall et~al. \cite{mcdougall03}. It also | 
| 1234 | 
   requires lagging the pressure and therefore an additional pickup | 
   requires lagging the pressure and therefore an additional pickup | 
| 1235 | 
   file for restarts. | 
   file for restarts. | 
| 1239 | 
  | 
  | 
| 1240 | 
 \subsection{Momentum equations} | 
 \subsection{Momentum equations} | 
| 1241 | 
  | 
  | 
| 1242 | 
 In this section, we only focus for now on the parameters that you are likely | 
 In this section, we only focus for now on the parameters that you are | 
| 1243 | 
 to change, i.e. the ones relative to forcing and dissipation for example. | 
 likely to change, i.e. the ones relative to forcing and dissipation | 
| 1244 | 
 The details relevant to the vector-invariant form of the equations and the | 
 for example.  The details relevant to the vector-invariant form of the | 
| 1245 | 
 various advection schemes are not covered for the moment. We assume that you | 
 equations and the various advection schemes are not covered for the | 
| 1246 | 
 use the standard form of the momentum equations (i.e. the flux-form) with | 
 moment. We assume that you use the standard form of the momentum | 
| 1247 | 
 the default advection scheme. Also, there are a few logical variables that | 
 equations (i.e. the flux-form) with the default advection scheme. | 
| 1248 | 
 allow you to turn on/off various terms in the momentum equation. These | 
 Also, there are a few logical variables that allow you to turn on/off | 
| 1249 | 
 variables are called \textbf{momViscosity, momAdvection, momForcing, | 
 various terms in the momentum equation. These variables are called | 
| 1250 | 
 useCoriolis, momPressureForcing, momStepping}\textit{, }and \textit{\ }% | 
 \textbf{momViscosity, momAdvection, momForcing, useCoriolis, | 
| 1251 | 
 \textbf{metricTerms }and are assumed to be set to '.\texttt{TRUE}.' here. | 
   momPressureForcing, momStepping} and \textbf{metricTerms }and are | 
| 1252 | 
 Look at the file \textit{model/inc/PARAMS.h }for a precise definition of | 
 assumed to be set to \texttt{'.TRUE.'} here.  Look at the file | 
| 1253 | 
 these variables. | 
 \textit{model/inc/PARAMS.h }for a precise definition of these | 
| 1254 | 
  | 
 variables. | 
| 1255 | 
  | 
  | 
| 1256 | 
 \begin{itemize} | 
 \begin{description} | 
| 1257 | 
 \item initialization | 
 \item[initialization] \  | 
| 1258 | 
 \end{itemize} | 
    | 
| 1259 | 
  | 
   The velocity components are initialized to 0 unless the simulation | 
| 1260 | 
 The velocity components are initialized to 0 unless the simulation is | 
   is starting from a pickup file (see section on simulation control | 
| 1261 | 
 starting from a pickup file (see section on simulation control parameters). | 
   parameters). | 
| 1262 | 
  | 
  | 
| 1263 | 
 \begin{itemize} | 
 \item[forcing] \  | 
| 1264 | 
 \item forcing | 
    | 
| 1265 | 
 \end{itemize} | 
   This section only applies to the ocean. You need to generate | 
| 1266 | 
  | 
   wind-stress data into two files \textbf{zonalWindFile} and | 
| 1267 | 
 This section only applies to the ocean. You need to generate wind-stress | 
   \textbf{meridWindFile} corresponding to the zonal and meridional | 
| 1268 | 
 data into two files \textbf{zonalWindFile}\textit{\ }and \textbf{% | 
   components of the wind stress, respectively (if you want the stress | 
| 1269 | 
 meridWindFile }corresponding to the zonal and meridional components of the | 
   to be along the direction of only one of the model horizontal axes, | 
| 1270 | 
 wind stress, respectively (if you want the stress to be along the direction | 
   you only need to generate one file). The format of the files is | 
| 1271 | 
 of only one of the model horizontal axes, you only need to generate one | 
   similar to the bathymetry file. The zonal (meridional) stress data | 
| 1272 | 
 file). The format of the files is similar to the bathymetry file. The zonal | 
   are assumed to be in Pa and located at U-points (V-points). As for | 
| 1273 | 
 (meridional) stress data are assumed to be in Pa and located at U-points | 
   the bathymetry, the precision with which to read the binary data is | 
| 1274 | 
 (V-points). As for the bathymetry, the precision with which to read the | 
   controlled by the variable \textbf{readBinaryPrec}.  See the matlab | 
| 1275 | 
 binary data is controlled by the variable \textbf{readBinaryPrec}.\textbf{\ } | 
   program \textit{gendata.m} in the \textit{input} directories under | 
| 1276 | 
 See the matlab program \textit{gendata.m }in the \textit{input }directories | 
   \textit{verification} to see how simple analytical wind forcing data | 
| 1277 | 
 under \textit{verification }to see how simple analytical wind forcing data | 
   are generated for the case study experiments. | 
| 1278 | 
 are generated for the case study experiments.  | 
    | 
| 1279 | 
  | 
   There is also the possibility of prescribing time-dependent periodic | 
| 1280 | 
 There is also the possibility of prescribing time-dependent periodic | 
   forcing. To do this, concatenate the successive time records into a | 
| 1281 | 
 forcing. To do this, concatenate the successive time records into a single | 
   single file (for each stress component) ordered in a (x,y,t) fashion | 
| 1282 | 
 file (for each stress component) ordered in a (x, y, t) fashion and set the | 
   and set the following variables: \textbf{periodicExternalForcing }to | 
| 1283 | 
 following variables: \textbf{periodicExternalForcing }to '.\texttt{TRUE}.',  | 
   \texttt{'.TRUE.'}, \textbf{externForcingPeriod }to the period (in s) | 
| 1284 | 
 \textbf{externForcingPeriod }to the period (in s) of which the forcing | 
   of which the forcing varies (typically 1 month), and | 
| 1285 | 
 varies (typically 1 month), and \textbf{externForcingCycle }to the repeat | 
   \textbf{externForcingCycle} to the repeat time (in s) of the forcing | 
| 1286 | 
 time (in s) of the forcing (typically 1 year -- note: \textbf{% | 
   (typically 1 year -- note: \textbf{ externForcingCycle} must be a | 
| 1287 | 
 externForcingCycle }must be a multiple of \textbf{externForcingPeriod}). | 
   multiple of \textbf{externForcingPeriod}).  With these variables set | 
| 1288 | 
 With these variables set up, the model will interpolate the forcing linearly | 
   up, the model will interpolate the forcing linearly at each | 
| 1289 | 
 at each iteration. | 
   iteration. | 
| 1290 | 
  | 
  | 
| 1291 | 
 \begin{itemize} | 
 \item[dissipation] \  | 
| 1292 | 
 \item dissipation | 
    | 
| 1293 | 
 \end{itemize} | 
   The lateral eddy viscosity coefficient is specified through the | 
| 1294 | 
  | 
   variable \textbf{viscAh} (in m$^{2}$s$^{-1}$). The vertical eddy | 
| 1295 | 
 The lateral eddy viscosity coefficient is specified through the variable  | 
   viscosity coefficient is specified through the variable | 
| 1296 | 
 \textbf{viscAh}\textit{\ }(in m$^{2}$s$^{-1}$). The vertical eddy viscosity | 
   \textbf{viscAz} (in m$^{2}$s$^{-1}$) for the ocean and | 
| 1297 | 
 coefficient is specified through the variable \textbf{viscAz }(in m$^{2}$s$% | 
   \textbf{viscAp} (in Pa$^{2}$s$^{-1}$) for the atmosphere.  The | 
| 1298 | 
 ^{-1}$) for the ocean and \textbf{viscAp}\textit{\ }(in Pa$^{2}$s$^{-1}$) | 
   vertical diffusive fluxes can be computed implicitly by setting the | 
| 1299 | 
 for the atmosphere. The vertical diffusive fluxes can be computed implicitly | 
   logical variable \textbf{implicitViscosity }to \texttt{'.TRUE.'}. | 
| 1300 | 
 by setting the logical variable \textbf{implicitViscosity }to '.\texttt{TRUE}% | 
   In addition, biharmonic mixing can be added as well through the | 
| 1301 | 
 .'. In addition, biharmonic mixing can be added as well through the variable  | 
   variable \textbf{viscA4} (in m$^{4}$s$^{-1}$). On a spherical polar | 
| 1302 | 
 \textbf{viscA4}\textit{\ }(in m$^{4}$s$^{-1}$). On a spherical polar grid, | 
   grid, you might also need to set the variable \textbf{cosPower} | 
| 1303 | 
 you might also need to set the variable \textbf{cosPower} which is set to 0 | 
   which is set to 0 by default and which represents the power of | 
| 1304 | 
 by default and which represents the power of cosine of latitude to multiply | 
   cosine of latitude to multiply viscosity. Slip or no-slip conditions | 
| 1305 | 
 viscosity. Slip or no-slip conditions at lateral and bottom boundaries are | 
   at lateral and bottom boundaries are specified through the logical | 
| 1306 | 
 specified through the logical variables \textbf{no\_slip\_sides}\textit{\ }% | 
   variables \textbf{no\_slip\_sides} and \textbf{no\_slip\_bottom}. If | 
| 1307 | 
 and \textbf{no\_slip\_bottom}. If set to '\texttt{.FALSE.}', free-slip | 
   set to \texttt{'.FALSE.'}, free-slip boundary conditions are | 
| 1308 | 
 boundary conditions are applied. If no-slip boundary conditions are applied | 
   applied. If no-slip boundary conditions are applied at the bottom, a | 
| 1309 | 
 at the bottom, a bottom drag can be applied as well. Two forms are | 
   bottom drag can be applied as well. Two forms are available: linear | 
| 1310 | 
 available: linear (set the variable \textbf{bottomDragLinear}\textit{\ }in s$% | 
   (set the variable \textbf{bottomDragLinear} in s$ ^{-1}$) and | 
| 1311 | 
 ^{-1}$) and quadratic (set the variable \textbf{bottomDragQuadratic}\textit{% | 
   quadratic (set the variable \textbf{bottomDragQuadratic} in | 
| 1312 | 
 \ }in m$^{-1}$). | 
   m$^{-1}$). | 
| 1313 | 
  | 
  | 
| 1314 | 
 The Fourier and Shapiro filters are described elsewhere. | 
   The Fourier and Shapiro filters are described elsewhere. | 
| 1315 | 
  | 
  | 
| 1316 | 
 \begin{itemize} | 
 \item[C-D scheme] \  | 
| 1317 | 
 \item C-D scheme | 
    | 
| 1318 | 
 \end{itemize} | 
   If you run at a sufficiently coarse resolution, you will need the | 
| 1319 | 
  | 
   C-D scheme for the computation of the Coriolis terms. The | 
| 1320 | 
  | 
   variable\textbf{\ tauCD}, which represents the C-D scheme coupling | 
| 1321 | 
  | 
   timescale (in s) needs to be set. | 
| 1322 | 
  | 
    | 
| 1323 | 
  | 
 \item[calculation of pressure/geopotential] \  | 
| 1324 | 
  | 
    | 
| 1325 | 
  | 
   First, to run a non-hydrostatic ocean simulation, set the logical | 
| 1326 | 
  | 
   variable \textbf{nonHydrostatic} to \texttt{'.TRUE.'}. The pressure | 
| 1327 | 
  | 
   field is then inverted through a 3D elliptic equation. (Note: this | 
| 1328 | 
  | 
   capability is not available for the atmosphere yet.) By default, a | 
| 1329 | 
  | 
   hydrostatic simulation is assumed and a 2D elliptic equation is used | 
| 1330 | 
  | 
   to invert the pressure field. The parameters controlling the | 
| 1331 | 
  | 
   behaviour of the elliptic solvers are the variables | 
| 1332 | 
  | 
   \textbf{cg2dMaxIters} and \textbf{cg2dTargetResidual } for | 
| 1333 | 
  | 
   the 2D case and \textbf{cg3dMaxIters} and | 
| 1334 | 
  | 
   \textbf{cg3dTargetResidual} for the 3D case. You probably won't need to | 
| 1335 | 
  | 
   alter the default values (are we sure of this?). | 
| 1336 | 
  | 
    | 
| 1337 | 
  | 
   For the calculation of the surface pressure (for the ocean) or | 
| 1338 | 
  | 
   surface geopotential (for the atmosphere) you need to set the | 
| 1339 | 
  | 
   logical variables \textbf{rigidLid} and \textbf{implicitFreeSurface} | 
| 1340 | 
  | 
   (set one to \texttt{'.TRUE.'} and the other to \texttt{'.FALSE.'} | 
| 1341 | 
  | 
   depending on how you want to deal with the ocean upper or atmosphere | 
| 1342 | 
  | 
   lower boundary). | 
| 1343 | 
  | 
  | 
| 1344 | 
 If you run at a sufficiently coarse resolution, you will need the C-D scheme | 
 \end{description}  | 
 | 
 for the computation of the Coriolis terms. The variable\textbf{\ tauCD}, | 
  | 
 | 
 which represents the C-D scheme coupling timescale (in s) needs to be set. | 
  | 
 | 
  | 
  | 
 | 
 \begin{itemize}  | 
  | 
 | 
 \item calculation of pressure/geopotential | 
  | 
 | 
 \end{itemize}  | 
  | 
 | 
  | 
  | 
 | 
 First, to run a non-hydrostatic ocean simulation, set the logical variable  | 
  | 
 | 
 \textbf{nonHydrostatic} to '.\texttt{TRUE}.'. The pressure field is then | 
  | 
 | 
 inverted through a 3D elliptic equation. (Note: this capability is not | 
  | 
 | 
 available for the atmosphere yet.) By default, a hydrostatic simulation is | 
  | 
 | 
 assumed and a 2D elliptic equation is used to invert the pressure field. The | 
  | 
 | 
 parameters controlling the behaviour of the elliptic solvers are the | 
  | 
 | 
 variables \textbf{cg2dMaxIters}\textit{\ }and \textbf{cg2dTargetResidual }% | 
  | 
 | 
 for the 2D case and \textbf{cg3dMaxIters}\textit{\ }and \textbf{% | 
  | 
 | 
 cg3dTargetResidual }for the 3D case. You probably won't need to alter the | 
  | 
 | 
 default values (are we sure of this?). | 
  | 
 | 
  | 
  | 
 | 
 For the calculation of the surface pressure (for the ocean) or surface | 
  | 
 | 
 geopotential (for the atmosphere) you need to set the logical variables  | 
  | 
 | 
 \textbf{rigidLid} and \textbf{implicitFreeSurface}\textit{\ }(set one to '.% | 
  | 
 | 
 \texttt{TRUE}.' and the other to '.\texttt{FALSE}.' depending on how you | 
  | 
 | 
 want to deal with the ocean upper or atmosphere lower boundary). | 
  | 
| 1345 | 
  | 
  | 
| 1346 | 
 \subsection{Tracer equations} | 
 \subsection{Tracer equations} | 
| 1347 | 
  | 
  | 
| 1348 | 
 This section covers the tracer equations i.e. the potential temperature | 
 This section covers the tracer equations i.e. the potential | 
| 1349 | 
 equation and the salinity (for the ocean) or specific humidity (for the | 
 temperature equation and the salinity (for the ocean) or specific | 
| 1350 | 
 atmosphere) equation. As for the momentum equations, we only describe for | 
 humidity (for the atmosphere) equation. As for the momentum equations, | 
| 1351 | 
 now the parameters that you are likely to change. The logical variables  | 
 we only describe for now the parameters that you are likely to change. | 
| 1352 | 
 \textbf{tempDiffusion}\textit{, }\textbf{tempAdvection}\textit{, }\textbf{% | 
 The logical variables \textbf{tempDiffusion} \textbf{tempAdvection} | 
| 1353 | 
 tempForcing}\textit{,} and \textbf{tempStepping} allow you to turn on/off | 
 \textbf{tempForcing}, and \textbf{tempStepping} allow you to turn | 
| 1354 | 
 terms in the temperature equation (same thing for salinity or specific | 
 on/off terms in the temperature equation (same thing for salinity or | 
| 1355 | 
 humidity with variables \textbf{saltDiffusion}\textit{, }\textbf{% | 
 specific humidity with variables \textbf{saltDiffusion}, | 
| 1356 | 
 saltAdvection}\textit{\ }etc). These variables are all assumed here to be | 
 \textbf{saltAdvection} etc.). These variables are all assumed here to | 
| 1357 | 
 set to '.\texttt{TRUE}.'. Look at file \textit{model/inc/PARAMS.h }for a | 
 be set to \texttt{'.TRUE.'}. Look at file \textit{model/inc/PARAMS.h} | 
| 1358 | 
 precise definition. | 
 for a precise definition. | 
 | 
  | 
  | 
 | 
 \begin{itemize} | 
  | 
 | 
 \item initialization | 
  | 
 | 
 \end{itemize} | 
  | 
 | 
  | 
  | 
 | 
 The initial tracer data can be contained in the binary files \textbf{% | 
  | 
 | 
 hydrogThetaFile }and \textbf{hydrogSaltFile}. These files should contain 3D | 
  | 
 | 
 data ordered in an (x, y, r) fashion with k=1 as the first vertical level. | 
  | 
 | 
 If no file names are provided, the tracers are then initialized with the | 
  | 
 | 
 values of \textbf{tRef }and \textbf{sRef }mentioned above (in the equation | 
  | 
 | 
 of state section). In this case, the initial tracer data are uniform in x | 
  | 
 | 
 and y for each depth level. | 
  | 
 | 
  | 
  | 
 | 
 \begin{itemize}  | 
  | 
 | 
 \item forcing | 
  | 
 | 
 \end{itemize} | 
  | 
 | 
  | 
  | 
 | 
 This part is more relevant for the ocean, the procedure for the atmosphere | 
  | 
 | 
 not being completely stabilized at the moment. | 
  | 
 | 
  | 
  | 
 | 
 A combination of fluxes data and relaxation terms can be used for driving | 
  | 
 | 
 the tracer equations. \ For potential temperature, heat flux data (in W/m$% | 
  | 
 | 
 ^{2}$) can be stored in the 2D binary file \textbf{surfQfile}\textit{. }% | 
  | 
 | 
 Alternatively or in addition, the forcing can be specified through a | 
  | 
 | 
 relaxation term. The SST data to which the model surface temperatures are | 
  | 
 | 
 restored to are supposed to be stored in the 2D binary file \textbf{% | 
  | 
 | 
 thetaClimFile}\textit{. }The corresponding relaxation time scale coefficient | 
  | 
 | 
 is set through the variable \textbf{tauThetaClimRelax}\textit{\ }(in s). The | 
  | 
 | 
 same procedure applies for salinity with the variable names \textbf{EmPmRfile% | 
  | 
 | 
 }\textit{, }\textbf{saltClimFile}\textit{, }and \textbf{tauSaltClimRelax}% | 
  | 
 | 
 \textit{\ }for freshwater flux (in m/s) and surface salinity (in ppt) data | 
  | 
 | 
 files and relaxation time scale coefficient (in s), respectively. Also for | 
  | 
 | 
 salinity, if the CPP key \textbf{USE\_NATURAL\_BCS} is turned on, natural | 
  | 
 | 
 boundary conditions are applied i.e. when computing the surface salinity | 
  | 
 | 
 tendency, the freshwater flux is multiplied by the model surface salinity | 
  | 
 | 
 instead of a constant salinity value. | 
  | 
 | 
  | 
  | 
 | 
 As for the other input files, the precision with which to read the data is | 
  | 
 | 
 controlled by the variable \textbf{readBinaryPrec}. Time-dependent, periodic | 
  | 
 | 
 forcing can be applied as well following the same procedure used for the | 
  | 
 | 
 wind forcing data (see above). | 
  | 
 | 
  | 
  | 
 | 
 \begin{itemize} | 
  | 
 | 
 \item dissipation | 
  | 
 | 
 \end{itemize} | 
  | 
 | 
  | 
  | 
 | 
 Lateral eddy diffusivities for temperature and salinity/specific humidity | 
  | 
 | 
 are specified through the variables \textbf{diffKhT }and \textbf{diffKhS }% | 
  | 
 | 
 (in m$^{2}$/s). Vertical eddy diffusivities are specified through the | 
  | 
 | 
 variables \textbf{diffKzT }and \textbf{diffKzS }(in m$^{2}$/s) for the ocean | 
  | 
 | 
 and \textbf{diffKpT }and \textbf{diffKpS }(in Pa$^{2}$/s) for the | 
  | 
 | 
 atmosphere. The vertical diffusive fluxes can be computed implicitly by | 
  | 
 | 
 setting the logical variable \textbf{implicitDiffusion }to '.\texttt{TRUE}% | 
  | 
 | 
 .'. In addition, biharmonic diffusivities can be specified as well through | 
  | 
 | 
 the coefficients \textbf{diffK4T }and \textbf{diffK4S }(in m$^{4}$/s). Note | 
  | 
 | 
 that the cosine power scaling (specified through \textbf{cosPower }- see the | 
  | 
 | 
 momentum equations section) is applied to the tracer diffusivities | 
  | 
 | 
 (Laplacian and biharmonic) as well. The Gent and McWilliams parameterization | 
  | 
 | 
 for oceanic tracers is described in the package section. Finally, note that | 
  | 
 | 
 tracers can be also subject to Fourier and Shapiro filtering (see the | 
  | 
 | 
 corresponding section on these filters). | 
  | 
| 1359 | 
  | 
  | 
| 1360 | 
 \begin{itemize} | 
 \begin{description} | 
| 1361 | 
 \item ocean convection | 
 \item[initialization] \  | 
| 1362 | 
 \end{itemize} | 
    | 
| 1363 | 
  | 
   The initial tracer data can be contained in the binary files | 
| 1364 | 
  | 
   \textbf{hydrogThetaFile} and \textbf{hydrogSaltFile}. These files | 
| 1365 | 
  | 
   should contain 3D data ordered in an (x,y,r) fashion with k=1 as the | 
| 1366 | 
  | 
   first vertical level.  If no file names are provided, the tracers | 
| 1367 | 
  | 
   are then initialized with the values of \textbf{tRef} and | 
| 1368 | 
  | 
   \textbf{sRef} mentioned above (in the equation of state section). In | 
| 1369 | 
  | 
   this case, the initial tracer data are uniform in x and y for each | 
| 1370 | 
  | 
   depth level. | 
| 1371 | 
  | 
  | 
| 1372 | 
  | 
 \item[forcing] \  | 
| 1373 | 
  | 
    | 
| 1374 | 
  | 
   This part is more relevant for the ocean, the procedure for the | 
| 1375 | 
  | 
   atmosphere not being completely stabilized at the moment. | 
| 1376 | 
  | 
    | 
| 1377 | 
  | 
   A combination of fluxes data and relaxation terms can be used for | 
| 1378 | 
  | 
   driving the tracer equations.  For potential temperature, heat flux | 
| 1379 | 
  | 
   data (in W/m$ ^{2}$) can be stored in the 2D binary file | 
| 1380 | 
  | 
   \textbf{surfQfile}.  Alternatively or in addition, the forcing can | 
| 1381 | 
  | 
   be specified through a relaxation term. The SST data to which the | 
| 1382 | 
  | 
   model surface temperatures are restored to are supposed to be stored | 
| 1383 | 
  | 
   in the 2D binary file \textbf{thetaClimFile}. The corresponding | 
| 1384 | 
  | 
   relaxation time scale coefficient is set through the variable | 
| 1385 | 
  | 
   \textbf{tauThetaClimRelax} (in s). The same procedure applies for | 
| 1386 | 
  | 
   salinity with the variable names \textbf{EmPmRfile}, | 
| 1387 | 
  | 
   \textbf{saltClimFile}, and \textbf{tauSaltClimRelax} for freshwater | 
| 1388 | 
  | 
   flux (in m/s) and surface salinity (in ppt) data files and | 
| 1389 | 
  | 
   relaxation time scale coefficient (in s), respectively. Also for | 
| 1390 | 
  | 
   salinity, if the CPP key \textbf{USE\_NATURAL\_BCS} is turned on, | 
| 1391 | 
  | 
   natural boundary conditions are applied i.e. when computing the | 
| 1392 | 
  | 
   surface salinity tendency, the freshwater flux is multiplied by the | 
| 1393 | 
  | 
   model surface salinity instead of a constant salinity value. | 
| 1394 | 
  | 
    | 
| 1395 | 
  | 
   As for the other input files, the precision with which to read the | 
| 1396 | 
  | 
   data is controlled by the variable \textbf{readBinaryPrec}. | 
| 1397 | 
  | 
   Time-dependent, periodic forcing can be applied as well following | 
| 1398 | 
  | 
   the same procedure used for the wind forcing data (see above). | 
| 1399 | 
  | 
  | 
| 1400 | 
  | 
 \item[dissipation] \  | 
| 1401 | 
  | 
    | 
| 1402 | 
  | 
   Lateral eddy diffusivities for temperature and salinity/specific | 
| 1403 | 
  | 
   humidity are specified through the variables \textbf{diffKhT} and | 
| 1404 | 
  | 
   \textbf{diffKhS} (in m$^{2}$/s). Vertical eddy diffusivities are | 
| 1405 | 
  | 
   specified through the variables \textbf{diffKzT} and | 
| 1406 | 
  | 
   \textbf{diffKzS} (in m$^{2}$/s) for the ocean and \textbf{diffKpT | 
| 1407 | 
  | 
   }and \textbf{diffKpS} (in Pa$^{2}$/s) for the atmosphere. The | 
| 1408 | 
  | 
   vertical diffusive fluxes can be computed implicitly by setting the | 
| 1409 | 
  | 
   logical variable \textbf{implicitDiffusion} to \texttt{'.TRUE.'}. | 
| 1410 | 
  | 
   In addition, biharmonic diffusivities can be specified as well | 
| 1411 | 
  | 
   through the coefficients \textbf{diffK4T} and \textbf{diffK4S} (in | 
| 1412 | 
  | 
   m$^{4}$/s). Note that the cosine power scaling (specified through | 
| 1413 | 
  | 
   \textbf{cosPower}---see the momentum equations section) is applied to | 
| 1414 | 
  | 
   the tracer diffusivities (Laplacian and biharmonic) as well. The | 
| 1415 | 
  | 
   Gent and McWilliams parameterization for oceanic tracers is | 
| 1416 | 
  | 
   described in the package section. Finally, note that tracers can be | 
| 1417 | 
  | 
   also subject to Fourier and Shapiro filtering (see the corresponding | 
| 1418 | 
  | 
   section on these filters). | 
| 1419 | 
  | 
  | 
| 1420 | 
  | 
 \item[ocean convection] \  | 
| 1421 | 
  | 
    | 
| 1422 | 
  | 
   Two options are available to parameterize ocean convection: one is | 
| 1423 | 
  | 
   to use the convective adjustment scheme. In this case, you need to | 
| 1424 | 
  | 
   set the variable \textbf{cadjFreq}, which represents the frequency | 
| 1425 | 
  | 
   (in s) with which the adjustment algorithm is called, to a non-zero | 
| 1426 | 
  | 
   value (if set to a negative value by the user, the model will set it | 
| 1427 | 
  | 
   to the tracer time step). The other option is to parameterize | 
| 1428 | 
  | 
   convection with implicit vertical diffusion. To do this, set the | 
| 1429 | 
  | 
   logical variable \textbf{implicitDiffusion} to \texttt{'.TRUE.'} | 
| 1430 | 
  | 
   and the real variable \textbf{ivdc\_kappa} to a value (in m$^{2}$/s) | 
| 1431 | 
  | 
   you wish the tracer vertical diffusivities to have when mixing | 
| 1432 | 
  | 
   tracers vertically due to static instabilities. Note that | 
| 1433 | 
  | 
   \textbf{cadjFreq} and \textbf{ivdc\_kappa}can not both have non-zero | 
| 1434 | 
  | 
   value. | 
| 1435 | 
  | 
  | 
| 1436 | 
 Two options are available to parameterize ocean convection: one is to use | 
 \end{description} | 
 | 
 the convective adjustment scheme. In this case, you need to set the variable  | 
  | 
 | 
 \textbf{cadjFreq}, which represents the frequency (in s) with which the | 
  | 
 | 
 adjustment algorithm is called, to a non-zero value (if set to a negative | 
  | 
 | 
 value by the user, the model will set it to the tracer time step). The other | 
  | 
 | 
 option is to parameterize convection with implicit vertical diffusion. To do | 
  | 
 | 
 this, set the logical variable \textbf{implicitDiffusion }to '.\texttt{TRUE}% | 
  | 
 | 
 .' and the real variable \textbf{ivdc\_kappa }to a value (in m$^{2}$/s) you | 
  | 
 | 
 wish the tracer vertical diffusivities to have when mixing tracers | 
  | 
 | 
 vertically due to static instabilities. Note that \textbf{cadjFreq }and  | 
  | 
 | 
 \textbf{ivdc\_kappa }can not both have non-zero value. | 
  | 
| 1437 | 
  | 
  | 
| 1438 | 
 \subsection{Simulation controls} | 
 \subsection{Simulation controls} | 
| 1439 | 
  | 
  | 
| 1440 | 
 The model ''clock'' is defined by the variable \textbf{deltaTClock }(in s) | 
 The model ''clock'' is defined by the variable \textbf{deltaTClock} | 
| 1441 | 
 which determines the IO frequencies and is used in tagging output. | 
 (in s) which determines the IO frequencies and is used in tagging | 
| 1442 | 
 Typically, you will set it to the tracer time step for accelerated runs | 
 output.  Typically, you will set it to the tracer time step for | 
| 1443 | 
 (otherwise it is simply set to the default time step \textbf{deltaT}). | 
 accelerated runs (otherwise it is simply set to the default time step | 
| 1444 | 
 Frequency of checkpointing and dumping of the model state are referenced to | 
 \textbf{deltaT}).  Frequency of checkpointing and dumping of the model | 
| 1445 | 
 this clock (see below). | 
 state are referenced to this clock (see below). | 
| 1446 | 
  | 
  | 
| 1447 | 
 \begin{itemize} | 
 \begin{description} | 
| 1448 | 
 \item run duration | 
 \item[run duration] \  | 
| 1449 | 
 \end{itemize} | 
    | 
| 1450 | 
  | 
   The beginning of a simulation is set by specifying a start time (in | 
| 1451 | 
 The beginning of a simulation is set by specifying a start time (in s) | 
   s) through the real variable \textbf{startTime} or by specifying an | 
| 1452 | 
 through the real variable \textbf{startTime }or by specifying an initial | 
   initial iteration number through the integer variable | 
| 1453 | 
 iteration number through the integer variable \textbf{nIter0}. If these | 
   \textbf{nIter0}. If these variables are set to nonzero values, the | 
| 1454 | 
 variables are set to nonzero values, the model will look for a ''pickup'' | 
   model will look for a ''pickup'' file \textit{pickup.0000nIter0} to | 
| 1455 | 
 file \textit{pickup.0000nIter0 }to restart the integration\textit{. }The end | 
   restart the integration. The end of a simulation is set through the | 
| 1456 | 
 of a simulation is set through the real variable \textbf{endTime }(in s). | 
   real variable \textbf{endTime} (in s).  Alternatively, you can | 
| 1457 | 
 Alternatively, you can specify instead the number of time steps to execute | 
   specify instead the number of time steps to execute through the | 
| 1458 | 
 through the integer variable \textbf{nTimeSteps}.  | 
   integer variable \textbf{nTimeSteps}. | 
| 1459 | 
  | 
  | 
| 1460 | 
  | 
 \item[frequency of output] \ | 
| 1461 | 
  | 
    | 
| 1462 | 
  | 
   Real variables defining frequencies (in s) with which output files | 
| 1463 | 
  | 
   are written on disk need to be set up. \textbf{dumpFreq} controls | 
| 1464 | 
  | 
   the frequency with which the instantaneous state of the model is | 
| 1465 | 
  | 
   saved. \textbf{chkPtFreq} and \textbf{pchkPtFreq} control the output | 
| 1466 | 
  | 
   frequency of rolling and permanent checkpoint files, respectively. | 
| 1467 | 
  | 
   See section 1.5.1 Output files for the definition of model state and | 
| 1468 | 
  | 
   checkpoint files. In addition, time-averaged fields can be written | 
| 1469 | 
  | 
   out by setting the variable \textbf{taveFreq} (in s).  The precision | 
| 1470 | 
  | 
   with which to write the binary data is controlled by the integer | 
| 1471 | 
  | 
   variable w\textbf{riteBinaryPrec} (set it to \texttt{32} or | 
| 1472 | 
  | 
   \texttt{64}). | 
| 1473 | 
  | 
  | 
| 1474 | 
 \begin{itemize} | 
 \end{description} | 
 | 
 \item frequency of output | 
  | 
 | 
 \end{itemize} | 
  | 
| 1475 | 
  | 
  | 
 | 
 Real variables defining frequencies (in s) with which output files are | 
  | 
 | 
 written on disk need to be set up. \textbf{dumpFreq }controls the frequency | 
  | 
 | 
 with which the instantaneous state of the model is saved. \textbf{chkPtFreq }% | 
  | 
 | 
 and \textbf{pchkPtFreq }control the output frequency of rolling and | 
  | 
 | 
 permanent checkpoint files, respectively. See section 1.5.1 Output files for the | 
  | 
 | 
 definition of model state and checkpoint files. In addition, time-averaged | 
  | 
 | 
 fields can be written out by setting the variable \textbf{taveFreq} (in s). | 
  | 
 | 
 The precision with which to write the binary data is controlled by the | 
  | 
 | 
 integer variable w\textbf{riteBinaryPrec }(set it to \texttt{32} or \texttt{% | 
  | 
 | 
 64}). | 
  | 
| 1476 | 
  | 
  | 
| 1477 | 
 %%% Local Variables:  | 
 %%% Local Variables:  | 
| 1478 | 
 %%% mode: latex | 
 %%% mode: latex |