www.ecco-group.org/abstracts/woce_uwe.txt

Adjoint Compiler Technology and Standards

Uwe Nauman, Patrick Heimbach, Christopher Hill and Carl Wunsch

Adjoint models are important both to understanding the sensitivity of the 
ocean state to initial/boundary conditions, model parameters of all types, 
and in a secondary role as a numerical method for doing data assimilation.  
Although also important in engineering, economics, and most scientific 
disciplines, they have thus far found their widest and most advanced applications 
in physical oceanography. While oceanographers have long experience in 
constructing `direct' or forward models, the construction of the corresponding 
adjoint model has proven, for many, burdensome and tedious. The advent of 
compilers capable of generating the adjoint model nearly automatically from the 
forward code has been revolutionary.
 
The adjoint corresponds to taking the derivatives of the direct model with 
respect to any field or parameter subject to change. Its numerical values 
can be computed using either a tangent-linear or an adjoint model both of 
which can be generated by compilers for Automatic Differentiation (AD). The 
problems arising from making this source transformation fully automatic are 
investigated as part of a collaborative NSF-ITR funded research project between 
MIT, Rice University, and Argonne National Laboratory / University of Chicago. 
The project's goals are to develop a fully-automatic, easy to use open-source tool 
for AD that is immediately applicable to Fortran and C codes and that is designed 
to allow community extension to include more elaborate code transformations, for 
example Hessian calculation. A primary focus of the project is geophysical applications.
 
The poster gives an overview of how compilers for AD work in principle. Various 
successful applications illustrate the feasibility of the general approach. Some 
of the major challenges in the field are discussed. Features of forward model 
implementations that are favorable from the point of view of automatic adjoint code
generation are proposed.  

1	Adjoint Compiler Technology and Standards
2
3	Uwe Nauman, Patrick Heimbach, Christopher Hill and Carl Wunsch
4
5	Adjoint models are important both to understanding the sensitivity of the
6	ocean state to initial/boundary conditions, model parameters of all types,
7	and in a secondary role as a numerical method for doing data assimilation.
8	Although also important in engineering, economics, and most scientific
9	disciplines, they have thus far found their widest and most advanced applications
10	in physical oceanography. While oceanographers have long experience in
11	constructing `direct' or forward models, the construction of the corresponding
12	adjoint model has proven, for many, burdensome and tedious. The advent of
13	compilers capable of generating the adjoint model nearly automatically from the
14	forward code has been revolutionary.
15
16	The adjoint corresponds to taking the derivatives of the direct model with
17	respect to any field or parameter subject to change. Its numerical values
18	can be computed using either a tangent-linear or an adjoint model both of
19	which can be generated by compilers for Automatic Differentiation (AD). The
20	problems arising from making this source transformation fully automatic are
21	investigated as part of a collaborative NSF-ITR funded research project between
22	MIT, Rice University, and Argonne National Laboratory / University of Chicago.
23	The project's goals are to develop a fully-automatic, easy to use open-source tool
24	for AD that is immediately applicable to Fortran and C codes and that is designed
25	to allow community extension to include more elaborate code transformations, for
26	example Hessian calculation. A primary focus of the project is geophysical applications.
27
28	The poster gives an overview of how compilers for AD work in principle. Various
29	successful applications illustrate the feasibility of the general approach. Some
30	of the major challenges in the field are discussed. Features of forward model
31	implementations that are favorable from the point of view of automatic adjoint code
32	generation are proposed.
33