PSTSWM POWER4-1.3 Serial Performance

Performance Studies using

PSTSWM

Date/Person:	October 18, 2001 / P. Worley
Platform:	IBM Regatta H system at Oak Ridge National Laboratory (cheetah.ccs.ornl.gov):
	1 16-way Regatta H SMP nodes (1.3 GHz POWER4, 2 8-way Mulitchip Modules)
Environment:	AIX 5.1
Code Version:	6.7.4
Make Options:	MACH=sp COMM=mpi PRECISION=8 PERF=n WORKSPACE=20000000 MATH=essl
Compilation Options:	mpxlf -O3 -qarch=auto -qtune=auto -qcache=auto
Link Options:	-bmaxdata:0x70000000
Number of steps:	T5, T10, T21, T42: 241 or 481
	T85: 49 or 97
	T170: 49 or 97
Number of processors per node:	1, 2, 3, or 4
Notes:	using ESSL library routines for Fourier transforms and BLAS (-lessl)

T5 MFlop rates

Per Processor Rate

Per Node Rate

**T5 MFlop rates**
Per Processor Rate	Per Node Rate

T10 MFlop rates

Per Processor Rate

Per Node Rate

**T10 MFlop rates**
Per Processor Rate	Per Node Rate

T21 MFlop rates

Per Processor Rate

Per Node Rate

**T21 MFlop rates**
Per Processor Rate	Per Node Rate

T42 MFlop rates

Per Processor Rate

Per Node Rate

**T42 MFlop rates**
Per Processor Rate	Per Node Rate

T85 MFlop rates

Per Processor Rate

Per Node Rate

**T85 MFlop rates**
Per Processor Rate	Per Node Rate

T170 MFlop rates

Per Processor Rate

Per Node Rate

**T170 MFlop rates**
Per Processor Rate	Per Node Rate

The performance discrepancy here indicates the cost of contention for memory (bandwidth) when multiple processors are running simultaneously. The total memory required per node goes up as the number of processors increases, but the per processor cache behavior and memory access patterns is constant.
This experiment indicates the difference in performance one might see in a space sharing context, sharing the node with other users, or in a scaled speed-up experiment, where the size of a parallel job is increased as the number of processors used increases.
Note that two different metrics are displayed - per processor computational rate and per node computational rate. The per node rate is the best measure of the performance of the architecture, but the per processor rate is a convenient way to observe performance degradation.