| 4 |
\section{Testing} |
\section{Testing} |
| 5 |
\label{sect:testing} |
\label{sect:testing} |
| 6 |
\label{www:testing} |
\label{www:testing} |
| 7 |
|
\begin{rawhtml} |
| 8 |
|
<!-- CMIREDIR:testing: --> |
| 9 |
|
\end{rawhtml} |
| 10 |
|
|
| 11 |
A script (\texttt{testreport}) for automated testing is included in |
A script (\texttt{testreport}) for automated testing is included in |
| 12 |
the model within the {\em verification} directory. While intended |
the model within the {\em verification} directory. While intended |
| 13 |
primarily advanced users, the script can be helpful for beginners. |
mostly for advanced users, the script can be helpful for beginners. |
| 14 |
|
|
| 15 |
\subsection{Using \texttt{testreport}} |
\subsection{Using \texttt{testreport}} |
| 16 |
|
|
| 17 |
On many systems, the utility can be run with a command as simple as |
On many systems, the program can be run with the command: |
| 18 |
\begin{verbatim} |
\begin{verbatim} |
| 19 |
% cd verification |
% cd verification |
| 20 |
% ./testreport -ieee |
% ./testreport |
| 21 |
\end{verbatim} |
\end{verbatim} |
| 22 |
which will do the following: |
which will do the following: |
| 23 |
\begin{enumerate} |
\begin{enumerate} |
| 24 |
\item Locate all directories within the current directory (which is |
\item Locate all ``valid'' test directories. Here, valid tests are |
| 25 |
generally {\em verification}) tha |
defined to be those directories within the current directory (which |
| 26 |
|
is generally {\em verification}) that contain a subdirectory and |
| 27 |
|
file with the names {\em results/output.txt}. |
| 28 |
|
|
| 29 |
|
\item Then within each valid test: |
| 30 |
|
\begin{enumerate} |
| 31 |
|
\item run \texttt{genmake2} to produce a {\em Makefile} |
| 32 |
|
\item build an executable |
| 33 |
|
\item run the executable |
| 34 |
|
\item compare and the output of the executable with the |
| 35 |
|
contents of certain variables within {\em |
| 36 |
|
TESTNAME/results/output.txt} |
| 37 |
|
\item print and, if requested (with the |
| 38 |
|
\texttt{-addr=EMAIL\_ADDRESS} option), send a MIME-encoded email |
| 39 |
|
with the testing results |
| 40 |
|
\end{enumerate} |
| 41 |
|
|
| 42 |
\end{enumerate} |
\end{enumerate} |
| 43 |
|
|
| 44 |
For further \texttt{testreport} details, please see the |
For further details, please see the MITgcm Developers' HOWTO at: |
| 45 |
|
\begin{rawhtml} <A href=''http://mitgcm.org/public/docs.html'' target="idontexist"> \end{rawhtml} |
| 46 |
|
\begin{verbatim} |
| 47 |
|
http://mitgcm.org/public/docs.html |
| 48 |
|
\end{verbatim} |
| 49 |
|
\begin{rawhtml} </A> \end{rawhtml} |
| 50 |
|
|
| 51 |
|
|
| 52 |
\subsection{Automated testing} |
\subsection{Automated testing} |
| 53 |
|
|
| 54 |
|
Automated testing results are produced on a regular basis and they can |
| 55 |
|
be viewed at: |
| 56 |
|
\begin{rawhtml} <A href=''http://mitgcm.org/public/testing.html'' target="idontexist"> \end{rawhtml} |
| 57 |
|
\begin{verbatim} |
| 58 |
|
http://mitgcm.org/public/testing.html |
| 59 |
|
\end{verbatim} |
| 60 |
|
\begin{rawhtml} </A> \end{rawhtml} |
| 61 |
|
which also includes links to various scripts for batch job submission |
| 62 |
|
on a variety of different machines. |
| 63 |
|
|
Parent Directory
| 
Revision Log
| 
Revision Graph
| 
Patch