/[MITgcm]/MITgcm_contrib/llc_hires/llc_1080/readme.txt
ViewVC logotype

Contents of /MITgcm_contrib/llc_hires/llc_1080/readme.txt

Parent Directory Parent Directory | Revision Log Revision Log | View Revision Graph Revision Graph


Revision 1.1 - (show annotations) (download)
Fri Sep 20 12:19:58 2013 UTC (11 years, 10 months ago) by dimitri
Branch: MAIN
File MIME type: text/plain
adding llc_1080 instructions, code, and input files

1 For interactive session, Ivy Bridge nodes:
2 qsub -I -q devel -l select=24:ncpus=20:model=ivy,walltime=02:00:00
3 qsub -I -q long -l select=24:ncpus=20:model=ivy,walltime=120:00:00
4
5 For batch submission:
6 qsub -q devel -l select=24:ncpus=20:model=ivy,walltime=02:00:00 runscript
7 qsub qsub_llc1080_468.csh
8
9 These will give you 24 x 20 = 480 cores. Launch 468 ranks with
10
11 ==============
12
13 cvs co MITgcm_code
14 cd MITgcm
15 module purge
16 module load comp-intel/2011.2 mpi-sgi/mpt.2.06a67 netcdf/4.0
17 #module load comp-intel/2011.7.256 mpi-sgi/mpt.2.08r7 netcdf/4.0
18 mkdir build run
19 cd build
20 ../tools/genmake2 -of ~/tarballs/llc_1080/code/linux_amd64_ifort+mpi_ice_nas -mpi -mods ~/tarballs/llc_1080/code
21 make depend
22 make -j 16
23 cd ../run
24 ln -sf ../build/mitgcmuv .
25 ln -sf /nobackup/dmenemen/tarballs/llc_1080/run_template/* .
26 ln -sf /nobackup/dmenemen/forcing/era_interim/EIG_*_2* .
27 ln -sf /nobackup/dmenemen/forcing/era_interim_corrected/EIG_dlw_sub5p_2* .
28 cp /nobackup/dmenemen/tarballs/llc_1080/input/* .
29 mpiexec -n 379 ./mitgcmuv
30
31 ==============
32
33 look at output
34
35 for ts=[1920:240:8880]
36 fld=quikread_llc(['Eta.' myint2str(ts,10) '.data'],1080);
37 clf,quikplot_llc(fld),caxis([-2.5 2]),thincolorbar
38 title(ts)
39 pause(.1)
40 end
41
42 ts=14040;
43 for fld={'S','T','U','V','W','HEFF'}
44 tmp=quikread_llc([fld{1} '.' myint2str(ts,10) '.data'],1080);
45 clf,quikplot_llc(tmp),thincolorbar
46 title(fld{1})
47 pause
48 end
49
50 ==============
51
52 to determine empty tiles:
53 grep Empty STDOUT.*
54
55 ==============
56
57 memory requirements:
58 nPx sNx sNy nSx node0 total rank0 rank1
59 702 60 60 6 17,642,924kb 770,168,568kb
60 468 60 60 9 22,083,004kb 643,301,784kb
61 468 180 180 1 24,719,776kb 720,415,552kb 1678MB 1563MB
62 351 60 60 12 26,660,020kb 582,815,544kb
63 351 120 120 3 25,110,324kb 548,819,772kb 1711MB 1586MB
64 351 120 120 3 6,543,780kb 56,729,484kb - with globalFiles - run out of time
65 325 54 54 16 29,029,744kb 587,831,344kb
66 325 216 216 1 29,249,232kb 426,554,484kb - node ran out of memory and crashed
67 234 90 90 8 30,590,952kb 431,252,200kb - node ran out of memory and crashed
68 234 180 180 2 27,682,360kb 307,181,152kb - node ran out of memory and crashed
69
70 =============
71 factor(3240) = 2 2 2 3 3 3 3 5
72 factor(1080) = 2 2 2 3 3 3 5
73
74 2 = 2
75 3 = 3
76 2*2 = 4
77 5 = 5
78 2*3 = 6
79 2*2*2 = 8
80 3*3 = 9
81 2*5 = 10
82 2*2*3 = 12
83 3*5 = 15
84 2*3*3 = 18
85 2*2*5 = 20
86 2*2*2*3 = 24
87 3*3*3 = 27
88 2*3*5 = 30
89 2*2*3*3 = 36 * 30
90 2*2*2*5 = 40 * 27
91 3*3*5 = 45 * 24
92 2*3*3*3 = 54 * 20
93 2*2*3*5 = 60 * 18
94 2*2*2*3*3 = 72 * 15
95 2*3*3*5 = 90 * 12
96 2*2*3*3*3 = 108 * 10
97 2*2*2*3*5 = 120 * 9
98 3*3*3*5 = 135 * 8
99 2*2*3*3*5 = 180 * 6
100 2*2*2*3*3*3 = 216 * 5
101 2*3*3*3*5 = 270 * 4
102 2*2*2*3*3*5 = 360 * 3
103 2*2*3*3*3*5 = 540 * 2

  ViewVC Help
Powered by ViewVC 1.1.22