Ocean Modeling Discussion

Dear Sir/Madam

I ran ROMS for 64 to 1024 ranks with intel mpi and got very poor results.Then I ran ROMS with open mpi and got good results.I am very confused as to why intel mpi is so slow as compared to open mpi.Please help

Thanks and Regards
Prakrati

Yes I do have a directory called output

Dear Sir/Madam

This is to request that when I am running ROMS with intel mpi for 256 ranks it gives me Abnormal Termination NETCDF OUTPUT. I am using NETCDF 4 with HDF5.
The output is as follows:

Prologue finished, program starts:

Process Information:

Benchmark Test, Idealized Southern Ocean ...

I ran ROMS 1 rank per node for 64 ranks for 17532 iterations and it is failing.It ran for 100 iterations.
The following is the error file :

oceanM: posixio.c:248: px_pgin: Assertion `*posp == ((off_t)(-1)) || *posp == lseek(nciop->fd, 0, 1)' failed.
forrtl: error (76): Abort trap signal
Image PC ...

Thanks a lot !!! Got it !!!

Yes I am running BENCHMARK and please can you be a bit more explicit as to what I have to do exactly
Thanks!!!

I did mention ocean_benchmark4.in quite correctly int the script and its running for all sizes except for 1024

Hey

When I run ROMS in the end when it has run successfully my outpot directory is empty.Is it normal??
Please clarify.

Thanks and Regards
Prakrati

I was using intel mpi earlier.I dont know why it wasnt working with it .I couldnt find any tunable parameter for buffer size for intel mpi.

The following is the error that I am getting when running ROMS on 64 cores for 100 iterations using mvapich

Resource usage summary:

CPU time : 1.44 sec.
Max Memory : 5 MB
Max Swap : 36 MB


The output (if any) follows:

Process Information:

Node # 19 (pid= 8769) is active.
Node # 27 (pid ...

Please can you tell me why openmp and MPI can't be used simulataneously?

I tried to run ROMS with mvapich on 64 cores for 100 iterations but it is failing with SIGSEGV 11 fault
Please can you guide what should I do?

Thanks It ran with open mpi!!!!

hey

I ran by setting the MPIEXEC_TIMEOUT=3600 and NHIS > 17532 but still the same error is coming.Will try to change the buffer size and let you know what happens.Till then please think of what can I do to make it work as it is very crucial.

Thanks a lot !!!!

Thanks for your quick response.Will try what you told and then let you know what happens
Thanks again!

Hello
I ran ROMS on 512 ranks. In the output file no error message is displayed. But in the end of the output file total time is displayed as asterisks. On the other hand after displaying time taken by individual rank total time is displayed. Here I am pasting appropriate parts of output file. Can ...

I did as you told and included mkdir output in the batch script so now its giving me the following error with 1024 ranks for 17532 iterations.Please help


Initial basin volumes: TotVolume = 1.65993987026488E+17 m3
MinVolume = 1.97754634567622E+08 m3
MaxVolume = 1.80931355725002E+10 m3
Max/Min ...

Thanks for your quick response
I already created output directory and it is running for lesser iterations for the same ranks .So I feel the problem is not with the output file.Please guide

Yes it is working fine with less processor cores.I am using netCDF 3.6.2 so I guess it doesnt support parallel output.So what should I do to make it run successfully. Please help

Hello

I ran ocean_benchmark4.in on 1024 cores for 17532 iterations but its giving NetCDF output error
Kindly help

Resource usage summary:

CPU time : 1.56 sec.
Max Memory : 5 MB
Max Swap : 36 MB


The output (if any) follows:


Process Information:

Model Input Parameters: ROMS/TOMS version 3 ...

Also the NetCDF library has been compiled with the same compilers as the ROMS
Please help

Please can you help and tell me where this output file should be? I created the output file in the same directory which contains my executable but it still gave the same error .

Benchmark Test, Idealized Southern Ocean, Large Grid

Operating system : Linux
CPU/hardware : x86_64
Compiler system : ifort
Compiler command : /app/intel/impi/3.1/bin64/mpiifort
Compiler flags : -heap-arrays -g -ftrapuv -traceback -free

Input Script : /homenc/ipaes84/FinalROMS/ROMS/ROMS ...

Hey Folks

I am running ROMS with the input file ocean_benchmark4.in with NtileI = 2 and NtileJ = 4 and number of processes = 8 on 1 node.It is giving the following error in the output file :
ERROR: Abnormal termination: NetCDF OUTPUT.
REASON: No such file or directory

Please help asap

Thanks ...