8 |
version. Information on how to obtain, compile, and run the code is |
version. Information on how to obtain, compile, and run the code is |
9 |
found here as well as a brief description of the model structure |
found here as well as a brief description of the model structure |
10 |
directory and the case study examples. Information is also provided |
directory and the case study examples. Information is also provided |
11 |
here on how to customize the code when you are ready to try implementing |
here on how to customize the code when you are ready to try implementing |
12 |
the configuration you have in mind. The code and algorithm |
the configuration you have in mind. The code and algorithm |
13 |
are described more fully in chapters \ref{chap:discretization} and |
are described more fully in chapters \ref{chap:discretization} and |
14 |
\ref{chap:sarch}. |
\ref{chap:sarch}. |
15 |
|
|
16 |
\section{Where to find information} |
\section{Where to find information} |
17 |
\label{sec:whereToFindInfo} |
\label{sec:whereToFindInfo} |
20 |
\end{rawhtml} |
\end{rawhtml} |
21 |
|
|
22 |
There is a web-archived support mailing list for the model that |
There is a web-archived support mailing list for the model that |
23 |
you can email at \texttt{MITgcm-support@mitgcm.org} or browse at: |
you can email at \texttt{MITgcm-support@mitgcm.org} after subscribing to: |
24 |
\begin{rawhtml} <A href=http://mitgcm.org/mailman/listinfo/mitgcm-support/ target="idontexist"> \end{rawhtml} |
\begin{rawhtml} <A href=http://mailman.mitgcm.org/mailman/listinfo/mitgcm-support/ target="idontexist"> \end{rawhtml} |
25 |
\begin{verbatim} |
\begin{verbatim} |
26 |
http://mitgcm.org/mailman/listinfo/mitgcm-support/ |
http://mailman.mitgcm.org/mailman/listinfo/mitgcm-support/ |
27 |
http://mitgcm.org/pipermail/mitgcm-support/ |
\end{verbatim} |
28 |
|
\begin{rawhtml} </A> \end{rawhtml} |
29 |
|
or browse at: |
30 |
|
\begin{rawhtml} <A href=http://mailman.mitgcm.org/pipermail/mitgcm-support/ target="idontexist"> \end{rawhtml} |
31 |
|
\begin{verbatim} |
32 |
|
http://mailman.mitgcm.org/pipermail/mitgcm-support/ |
33 |
\end{verbatim} |
\end{verbatim} |
34 |
\begin{rawhtml} </A> \end{rawhtml} |
\begin{rawhtml} </A> \end{rawhtml} |
35 |
|
|
76 |
download a tar file. |
download a tar file. |
77 |
|
|
78 |
Before you can use CVS, the following environment variable(s) should |
Before you can use CVS, the following environment variable(s) should |
79 |
be set within your shell. For a csh or tcsh shell, put the following |
be set within your shell. For a csh or tcsh shell, put the following |
80 |
\begin{verbatim} |
\begin{verbatim} |
81 |
% setenv CVSROOT :pserver:cvsanon@mitgcm.org:/u/gcmpack |
% setenv CVSROOT :pserver:cvsanon@mitgcm.org:/u/gcmpack |
82 |
\end{verbatim} |
\end{verbatim} |
87 |
\end{verbatim} |
\end{verbatim} |
88 |
in your \texttt{.profile} or \texttt{.bashrc} file. |
in your \texttt{.profile} or \texttt{.bashrc} file. |
89 |
|
|
|
|
|
90 |
To get MITgcm through CVS, first register with the MITgcm CVS server |
To get MITgcm through CVS, first register with the MITgcm CVS server |
91 |
using command: |
using command: |
92 |
\begin{verbatim} |
\begin{verbatim} |
127 |
\textbf{Alias Name} & \textbf{Information (directories) Contained} \\\hline |
\textbf{Alias Name} & \textbf{Information (directories) Contained} \\\hline |
128 |
\texttt{MITgcm\_code} & Only the source code -- none of the verification examples. \\ |
\texttt{MITgcm\_code} & Only the source code -- none of the verification examples. \\ |
129 |
\texttt{MITgcm\_verif\_basic} |
\texttt{MITgcm\_verif\_basic} |
130 |
& Source code plus a small set of the verification examples |
& Source code plus a small set of the verification examples |
131 |
(\texttt{global\_ocean.90x40x15}, \texttt{aim.5l\_cs}, \texttt{hs94.128x64x5}, |
(\texttt{global\_ocean.90x40x15}, \texttt{aim.5l\_cs}, \texttt{hs94.128x64x5}, |
132 |
\texttt{front\_relax}, and \texttt{plume\_on\_slope}). \\ |
\texttt{front\_relax}, and \texttt{plume\_on\_slope}). \\ |
133 |
\texttt{MITgcm\_verif\_atmos} & Source code plus all of the atmospheric examples. \\ |
\texttt{MITgcm\_verif\_atmos} & Source code plus all of the atmospheric examples. \\ |
134 |
\texttt{MITgcm\_verif\_ocean} & Source code plus all of the oceanic examples. \\ |
\texttt{MITgcm\_verif\_ocean} & Source code plus all of the oceanic examples. \\ |
246 |
delete; even if you do not use CVS yourself the information can help |
delete; even if you do not use CVS yourself the information can help |
247 |
us if you should need to send us your copy of the code. If a recent |
us if you should need to send us your copy of the code. If a recent |
248 |
tar file does not exist, then please contact the developers through |
tar file does not exist, then please contact the developers through |
249 |
the |
the |
250 |
\begin{rawhtml} <A href="mailto:MITgcm-support@mitgcm.org"> \end{rawhtml} |
\begin{rawhtml} <A href="mailto:MITgcm-support@mitgcm.org"> \end{rawhtml} |
251 |
MITgcm-support@mitgcm.org |
MITgcm-support@mitgcm.org |
252 |
\begin{rawhtml} </A> \end{rawhtml} |
\begin{rawhtml} </A> \end{rawhtml} |
277 |
\begin{itemize} |
\begin{itemize} |
278 |
|
|
279 |
\item \texttt{doc}: contains brief documentation notes. |
\item \texttt{doc}: contains brief documentation notes. |
280 |
|
|
281 |
\item \texttt{eesupp}: contains the execution environment source code. |
\item \texttt{eesupp}: contains the execution environment source code. |
282 |
Also subdivided into two subdirectories \texttt{inc} and |
Also subdivided into two subdirectories \texttt{inc} and |
283 |
\texttt{src}. |
\texttt{src}. |
284 |
|
|
285 |
\item \texttt{model}: this directory contains the main source code. |
\item \texttt{model}: this directory contains the main source code. |
286 |
Also subdivided into two subdirectories \texttt{inc} and |
Also subdivided into two subdirectories \texttt{inc} and |
287 |
\texttt{src}. |
\texttt{src}. |
288 |
|
|
289 |
\item \texttt{pkg}: contains the source code for the packages. Each |
\item \texttt{pkg}: contains the source code for the packages. Each |
290 |
package corresponds to a subdirectory. For example, \texttt{gmredi} |
package corresponds to a subdirectory. For example, \texttt{gmredi} |
291 |
contains the code related to the Gent-McWilliams/Redi scheme, |
contains the code related to the Gent-McWilliams/Redi scheme, |
292 |
\texttt{aim} the code relative to the atmospheric intermediate |
\texttt{aim} the code relative to the atmospheric intermediate |
293 |
physics. The packages are described in detail in chapter \ref{chap:packagesI}. |
physics. The packages are described in detail in chapter \ref{chap:packagesI}. |
294 |
|
|
295 |
\item \texttt{tools}: this directory contains various useful tools. |
\item \texttt{tools}: this directory contains various useful tools. |
296 |
For example, \texttt{genmake2} is a script written in csh (C-shell) |
For example, \texttt{genmake2} is a script written in csh (C-shell) |
297 |
that should be used to generate your makefile. The directory |
that should be used to generate your makefile. The directory |
301 |
This directory also contains the subdirectory build\_options, which |
This directory also contains the subdirectory build\_options, which |
302 |
contains the `optfiles' with the compiler options for the different |
contains the `optfiles' with the compiler options for the different |
303 |
compilers and machines that can run MITgcm. |
compilers and machines that can run MITgcm. |
304 |
|
|
305 |
\item \texttt{utils}: this directory contains various utilities. The |
\item \texttt{utils}: this directory contains various utilities. The |
306 |
subdirectory \texttt{knudsen2} contains code and a makefile that |
subdirectory \texttt{knudsen2} contains code and a makefile that |
307 |
compute coefficients of the polynomial approximation to the knudsen |
compute coefficients of the polynomial approximation to the knudsen |
312 |
model output. The subdirectory exch2 contains the code needed for |
model output. The subdirectory exch2 contains the code needed for |
313 |
the exch2 package to work with different combinations of domain |
the exch2 package to work with different combinations of domain |
314 |
decompositions. |
decompositions. |
315 |
|
|
316 |
\item \texttt{verification}: this directory contains the model |
\item \texttt{verification}: this directory contains the model |
317 |
examples. See section \ref{sec:modelExamples}. |
examples. See section \ref{sec:modelExamples}. |
318 |
|
|
319 |
\item \texttt{jobs}: contains sample job scripts for running MITgcm. |
\item \texttt{jobs}: contains sample job scripts for running MITgcm. |
320 |
|
|
321 |
\item \texttt{lsopt}: Line search code used for optimization. |
\item \texttt{lsopt}: Line search code used for optimization. |
322 |
|
|
323 |
\item \texttt{optim}: Interface between MITgcm and line search code. |
\item \texttt{optim}: Interface between MITgcm and line search code. |
324 |
|
|
325 |
\end{itemize} |
\end{itemize} |
326 |
|
|
327 |
\section[Building MITgcm]{Building the code} |
\section[Building MITgcm]{Building the code} |
366 |
Through the MITgcm-support list, the MITgcm developers are willing to |
Through the MITgcm-support list, the MITgcm developers are willing to |
367 |
provide help writing or modifing ``optfiles''. And we encourage users |
provide help writing or modifing ``optfiles''. And we encourage users |
368 |
to post new ``optfiles'' (particularly ones for new machines or |
to post new ``optfiles'' (particularly ones for new machines or |
369 |
architectures) to the |
architectures) to the |
370 |
\begin{rawhtml} <A href="mailto:MITgcm-support@mitgcm.org"> \end{rawhtml} |
\begin{rawhtml} <A href="mailto:MITgcm-support@mitgcm.org"> \end{rawhtml} |
371 |
MITgcm-support@mitgcm.org |
MITgcm-support@mitgcm.org |
372 |
\begin{rawhtml} </A> \end{rawhtml} |
\begin{rawhtml} </A> \end{rawhtml} |
525 |
% ./mitgcmuv > output.txt |
% ./mitgcmuv > output.txt |
526 |
\end{verbatim} |
\end{verbatim} |
527 |
|
|
|
|
|
528 |
\subsection{Using \texttt{genmake2}} |
\subsection{Using \texttt{genmake2}} |
529 |
\label{sec:genmake} |
\label{sec:genmake} |
530 |
|
|
538 |
%\texttt{tools/build\_options} directory. |
%\texttt{tools/build\_options} directory. |
539 |
\texttt{genmake2} parses information from the following sources: |
\texttt{genmake2} parses information from the following sources: |
540 |
\begin{description} |
\begin{description} |
541 |
\item[-] a {\em gemake\_local} file if one is found in the current |
\item[-] a {\em gemake\_local} file if one is found in the current |
542 |
directory |
directory |
543 |
\item[-] command-line options |
\item[-] command-line options |
544 |
\item[-] an "options file" as specified by the command-line option |
\item[-] an "options file" as specified by the command-line option |
545 |
\texttt{--optfile=/PATH/FILENAME} |
\texttt{--optfile=/PATH/FILENAME} |
546 |
\item[-] a {\em packages.conf} file (if one is found) with the |
\item[-] a {\em packages.conf} file (if one is found) with the |
547 |
specific list of packages to compile. The search path for |
specific list of packages to compile. The search path for |
548 |
file {\em packages.conf} is, first, the current directory and |
file {\em packages.conf} is, first, the current directory and |
549 |
then each of the "MODS" directories in the given order (see below). |
then each of the "MODS" directories in the given order (see below). |
550 |
\end{description} |
\end{description} |
633 |
|
|
634 |
The most important command-line options are: |
The most important command-line options are: |
635 |
\begin{description} |
\begin{description} |
636 |
|
|
637 |
\item[\texttt{--optfile=/PATH/FILENAME}] specifies the optfile that |
\item[\texttt{--optfile=/PATH/FILENAME}] specifies the optfile that |
638 |
should be used for a particular build. |
should be used for a particular build. |
639 |
|
|
640 |
If no "optfile" is specified (either through the command line or the |
If no "optfile" is specified (either through the command line or the |
641 |
MITGCM\_OPTFILE environment variable), genmake2 will try to make a |
MITGCM\_OPTFILE environment variable), genmake2 will try to make a |
642 |
reasonable guess from the list provided in {\em |
reasonable guess from the list provided in {\em |
645 |
(eg. "linux\_ia32") and then find a working FORTRAN compiler within |
(eg. "linux\_ia32") and then find a working FORTRAN compiler within |
646 |
the user's path. When these three items have been identified, |
the user's path. When these three items have been identified, |
647 |
genmake2 will try to find an optfile that has a matching name. |
genmake2 will try to find an optfile that has a matching name. |
648 |
|
|
649 |
\item[\texttt{--mods='DIR1 DIR2 DIR3 ...'}] specifies a list of |
\item[\texttt{--mods='DIR1 DIR2 DIR3 ...'}] specifies a list of |
650 |
directories containing ``modifications''. These directories contain |
directories containing ``modifications''. These directories contain |
651 |
files with names that may (or may not) exist in the main MITgcm |
files with names that may (or may not) exist in the main MITgcm |
652 |
source tree but will be overridden by any identically-named sources |
source tree but will be overridden by any identically-named sources |
653 |
within the ``MODS'' directories. |
within the ``MODS'' directories. |
654 |
|
|
655 |
The order of precedence for this "name-hiding" is as follows: |
The order of precedence for this "name-hiding" is as follows: |
656 |
\begin{itemize} |
\begin{itemize} |
657 |
\item ``MODS'' directories (in the order given) |
\item ``MODS'' directories (in the order given) |
662 |
\item The "standard dirs" (which may have been specified by the |
\item The "standard dirs" (which may have been specified by the |
663 |
``-standarddirs'' option) |
``-standarddirs'' option) |
664 |
\end{itemize} |
\end{itemize} |
665 |
|
|
666 |
\item[\texttt{--pgroups=/PATH/FILENAME}] specifies the file |
\item[\texttt{--pgroups=/PATH/FILENAME}] specifies the file |
667 |
where package groups are defined. If not set, the package-groups |
where package groups are defined. If not set, the package-groups |
668 |
definition will be read from {\em pkg/pkg\_groups}. |
definition will be read from {\em pkg/pkg\_groups}. |
669 |
It also contains the default list of packages (defined |
It also contains the default list of packages (defined |
670 |
as the group ``{\it default\_pkg\_list}'' which is used |
as the group ``{\it default\_pkg\_list}'' which is used |
673 |
|
|
674 |
\item[\texttt{--pdepend=/PATH/FILENAME}] specifies the dependency file |
\item[\texttt{--pdepend=/PATH/FILENAME}] specifies the dependency file |
675 |
used for packages. |
used for packages. |
676 |
|
|
677 |
If not specified, the default dependency file {\em pkg/pkg\_depend} |
If not specified, the default dependency file {\em pkg/pkg\_depend} |
678 |
is used. The syntax for this file is parsed on a line-by-line basis |
is used. The syntax for this file is parsed on a line-by-line basis |
679 |
where each line containes either a comment ("\#") or a simple |
where each line containes either a comment ("\#") or a simple |
682 |
relationship, respectively. If no rule is specified, then it is |
relationship, respectively. If no rule is specified, then it is |
683 |
assumed that the two packages are compatible and will function |
assumed that the two packages are compatible and will function |
684 |
either with or without each other. |
either with or without each other. |
685 |
|
|
686 |
\item[\texttt{--adof=/path/to/file}] specifies the "adjoint" or |
\item[\texttt{--adof=/path/to/file}] specifies the "adjoint" or |
687 |
automatic differentiation options file to be used. The file is |
automatic differentiation options file to be used. The file is |
688 |
analogous to the ``optfile'' defined above but it specifies |
analogous to the ``optfile'' defined above but it specifies |
689 |
information for the AD build process. |
information for the AD build process. |
690 |
|
|
691 |
The default file is located in {\em |
The default file is located in {\em |
692 |
tools/adjoint\_options/adjoint\_default} and it defines the "TAF" |
tools/adjoint\_options/adjoint\_default} and it defines the "TAF" |
693 |
and "TAMC" compilers. An alternate version is also available at |
and "TAMC" compilers. An alternate version is also available at |
694 |
{\em tools/adjoint\_options/adjoint\_staf} that selects the newer |
{\em tools/adjoint\_options/adjoint\_staf} that selects the newer |
695 |
"STAF" compiler. As with any compilers, it is helpful to have their |
"STAF" compiler. As with any compilers, it is helpful to have their |
696 |
directories listed in your {\tt \$PATH} environment variable. |
directories listed in your {\tt \$PATH} environment variable. |
697 |
|
|
698 |
\item[\texttt{--mpi}] This option enables certain MPI features (using |
\item[\texttt{--mpi}] This option enables certain MPI features (using |
699 |
CPP \texttt{\#define}s) within the code and is necessary for MPI |
CPP \texttt{\#define}s) within the code and is necessary for MPI |
700 |
builds (see Section \ref{sec:mpi-build}). |
builds (see Section \ref{sec:mpi-build}). |
701 |
|
|
702 |
\item[\texttt{--make=/path/to/gmake}] Due to the poor handling of |
\item[\texttt{--make=/path/to/gmake}] Due to the poor handling of |
703 |
soft-links and other bugs common with the \texttt{make} versions |
soft-links and other bugs common with the \texttt{make} versions |
704 |
provided by commercial Unix vendors, GNU \texttt{make} (sometimes |
provided by commercial Unix vendors, GNU \texttt{make} (sometimes |
705 |
called \texttt{gmake}) should be preferred. This option provides a |
called \texttt{gmake}) should be preferred. This option provides a |
706 |
means for specifying the make executable to be used. |
means for specifying the make executable to be used. |
707 |
|
|
708 |
\item[\texttt{--bash=/path/to/sh}] On some (usually older UNIX) |
\item[\texttt{--bash=/path/to/sh}] On some (usually older UNIX) |
709 |
machines, the ``bash'' shell is unavailable. To run on these |
machines, the ``bash'' shell is unavailable. To run on these |
710 |
systems, \texttt{genmake2} can be invoked using an ``sh'' (that is, |
systems, \texttt{genmake2} can be invoked using an ``sh'' (that is, |
718 |
|
|
719 |
\end{description} |
\end{description} |
720 |
|
|
|
|
|
721 |
\subsection{Building with MPI} |
\subsection{Building with MPI} |
722 |
\label{sec:mpi-build} |
\label{sec:mpi-build} |
723 |
|
|
731 |
|
|
732 |
The steps for building MITgcm with MPI support are: |
The steps for building MITgcm with MPI support are: |
733 |
\begin{enumerate} |
\begin{enumerate} |
734 |
|
|
735 |
\item Determine the locations of your MPI-enabled compiler and/or MPI |
\item Determine the locations of your MPI-enabled compiler and/or MPI |
736 |
libraries and put them into an options file as described in Section |
libraries and put them into an options file as described in Section |
737 |
\ref{sec:genmake}. One can start with one of the examples in: |
\ref{sec:genmake}. One can start with one of the examples in: |
767 |
MPIexec |
MPIexec |
768 |
\begin{rawhtml} </A> \end{rawhtml} |
\begin{rawhtml} </A> \end{rawhtml} |
769 |
\end{itemize} |
\end{itemize} |
770 |
|
|
771 |
\item Build the code with the \texttt{genmake2} \texttt{-mpi} option |
\item Build the code with the \texttt{genmake2} \texttt{-mpi} option |
772 |
(see Section \ref{sec:genmake}) using commands such as: |
(see Section \ref{sec:genmake}) using commands such as: |
773 |
{\footnotesize \begin{verbatim} |
{\footnotesize \begin{verbatim} |
775 |
% make depend |
% make depend |
776 |
% make |
% make |
777 |
\end{verbatim} } |
\end{verbatim} } |
778 |
|
|
779 |
\item Run the code with the appropriate MPI ``run'' or ``exec'' |
\item Run the code with the appropriate MPI ``run'' or ``exec'' |
780 |
program provided with your particular implementation of MPI. |
program provided with your particular implementation of MPI. |
781 |
Typical MPI packages such as MPICH will use something like: |
Typical MPI packages such as MPICH will use something like: |
856 |
compare your \texttt{output.txt} with the corresponding one for that |
compare your \texttt{output.txt} with the corresponding one for that |
857 |
experiment to check that the set-up works. |
experiment to check that the set-up works. |
858 |
|
|
|
|
|
|
|
|
859 |
\subsection{Output files} |
\subsection{Output files} |
860 |
|
|
861 |
The model produces various output files and, when using \texttt{mnc}, |
The model produces various output files and, when using \texttt{mnc}, |
865 |
flags set (in \texttt{input/data.pkg}), the following output may |
flags set (in \texttt{input/data.pkg}), the following output may |
866 |
appear. |
appear. |
867 |
|
|
|
|
|
868 |
\subsubsection{MDSIO output files} |
\subsubsection{MDSIO output files} |
869 |
|
|
870 |
The ``traditional'' output files are generated by the \texttt{mdsio} |
The ``traditional'' output files are generated by the \texttt{mdsio} |
912 |
|
|
913 |
containing the D-grid velocity data and that has to be written out as well |
containing the D-grid velocity data and that has to be written out as well |
914 |
in order to restart the integration. Rolling checkpoint files are the same |
in order to restart the integration. Rolling checkpoint files are the same |
915 |
as the pickup files but are named differently. Their name contain the chain |
as the pickup files but are named differently. Their name contain the chain |
916 |
\texttt{ckptA} or \texttt{ckptB} instead of \texttt{00000nIter}. They can be |
\texttt{ckptA} or \texttt{ckptB} instead of \texttt{00000nIter}. They can be |
917 |
used to restart the model but are overwritten every other time they are |
used to restart the model but are overwritten every other time they are |
918 |
output to save disk space during long integrations. |
output to save disk space during long integrations. |
921 |
|
|
922 |
Unlike the \texttt{mdsio} output, the \texttt{mnc}--generated output |
Unlike the \texttt{mdsio} output, the \texttt{mnc}--generated output |
923 |
is usually (though not necessarily) placed within a subdirectory with |
is usually (though not necessarily) placed within a subdirectory with |
924 |
a name such as \texttt{mnc\_test\_\${DATE}\_\${SEQ}}. |
a name such as \texttt{mnc\_test\_\${DATE}\_\${SEQ}}. |
925 |
|
|
926 |
\subsection{Looking at the output} |
\subsection{Looking at the output} |
927 |
|
|
976 |
http://meteora.ucsd.edu/~pierce/ncview_home_page.html |
http://meteora.ucsd.edu/~pierce/ncview_home_page.html |
977 |
\end{verbatim} |
\end{verbatim} |
978 |
\begin{rawhtml} </A> \end{rawhtml} |
\begin{rawhtml} </A> \end{rawhtml} |
979 |
|
|
980 |
\item MatLAB(c) and other common post-processing environments provide |
\item MatLAB(c) and other common post-processing environments provide |
981 |
various netCDF interfaces including: |
various netCDF interfaces including: |
982 |
\begin{rawhtml} <A href="http://mexcdf.sourceforge.net/"> \end{rawhtml} |
\begin{rawhtml} <A href="http://mexcdf.sourceforge.net/"> \end{rawhtml} |