PSTSWM SP3-375 Communication Protocol Performance

Performance Studies using

PSTSWM

IBM SP3-375 Winterhawk II Protocol Performance

(transpose LT experiment I-C / O(log P) transpose algorithm)

Date/Person: December 12, 1999 / P. Worley
Platform: IBM SP3 at Oak Ridge National Laboratory (bobcat.ccs.ornl.gov):
     62 4-way Winterhawk II SMP nodes (375 MHz POWER3 with 8MB L2 cache)
Environment: AIX 4.3.3;   PSSP 3.1.1
Code Version: 6.6.4
Compilation Options: mpxlf -O3 -qarch=auto -qtune=auto -qcache=auto
Link Options: -bmaxdata:0x70000000
Environment Variables: export MP_SHARED_MEMORY="yes"
Math Library: ESSL
Communication Library: MPI over the switch using user space for internode communication
MPI using shared memory for intranode communication
Parallel Algorithm: logtrans
(assuming distributed FFT)
Number of Timesteps: 12
Results:

4x16 Processors (Column Major Ordering) / Problem T21L16
Runtime Statistics
min(mean-min)/min(median-min)/min(max-min)/min
  2.3230e-01   0.04   0.03   0.09 
Three Fastest
Protocols
1st2nd3rd
  c4   c5   a5 
       Number of Proctocols With
Runtimes Within X% of Min
1%5%25%
  2   15   25 

2x32 Processors (Column Major Ordering) / Problem T21L16
Runtime Statistics
min(mean-min)/min(median-min)/min(max-min)/min
  2.8375e-01   0.05   0.06   0.09 
Three Fastest
Protocols
1st2nd3rd
  c4   c5   d5 
       Number of Proctocols With
Runtimes Within X% of Min
1%5%25%
  1   5   14 

8x8 Processors (Column Major Ordering) / Problem T42L16
Runtime Statistics
min(mean-min)/min(median-min)/min(max-min)/min
  5.7352e-01   0.03   0.03   0.09 
Three Fastest
Protocols
1st2nd3rd
  c4   c2   c3 
       Number of Proctocols With
Runtimes Within X% of Min
1%5%25%
  3   23   25 

4x16 Processors (Column Major Ordering) / Problem T42L16
Runtime Statistics
min(mean-min)/min(median-min)/min(max-min)/min
  5.8197e-01   0.03   0.03   0.07 
Three Fastest
Protocols
1st2nd3rd
  a4   c1   c4 
       Number of Proctocols With
Runtimes Within X% of Min
1%5%25%
  3   22   25 

2x32 Processors (Column Major Ordering) / Problem T42L32
Runtime Statistics
min(mean-min)/min(median-min)/min(max-min)/min
  9.0238e-01   0.04   0.04   0.09 
Three Fastest
Protocols
1st2nd3rd
  a1   a5   c1 
       Number of Proctocols With
Runtimes Within X% of Min
1%5%25%
  3   16   25 

8x8 Processors (Column Major Ordering) / Problem T85L32
Runtime Statistics
min(mean-min)/min(median-min)/min(max-min)/min
  4.4753e+00   0.02   0.03   0.04 
Three Fastest
Protocols
1st2nd3rd
  c5   b1   b2 
       Number of Proctocols With
Runtimes Within X% of Min
1%5%25%
  4   25   25 

Patrick H. Worley / ( worleyph@ornl.gov)
Last Modified Monday, 15-Jul-2002 10:19:20 EDT.