After the introduction of labels in ctest it is rather easy to run a simple performance test on Elmer. The tests with label 'benchmark' may be run with
- Code: Select all
ctest -L benchmark
This should give roughly the following ouput:
- Code: Select all
elmeruser@elmeruser-VM64bit ~/Source/builddir $ ctest -L benchmark
Test project /home/elmeruser/Source/builddir
Start 62: LimitTemperature
1/14 Test #62: LimitTemperature ................. Passed 19.91 sec
Start 63: mgdyn_steady
2/14 Test #63: mgdyn_steady ..................... Passed 8.31 sec
Start 86: VectorHelmholtzWaveguide
3/14 Test #86: VectorHelmholtzWaveguide ......... Passed 11.06 sec
Start 106: RichardsDyke2
4/14 Test #106: RichardsDyke2 .................... Passed 9.38 sec
Start 138: diffuser_v2f
5/14 Test #138: diffuser_v2f ..................... Passed 13.01 sec
Start 186: FlowResNoslip
6/14 Test #186: FlowResNoslip .................... Passed 5.80 sec
Start 224: ConstantBCDisplacement
7/14 Test #224: ConstantBCDisplacement ........... Passed 10.45 sec
Start 232: structmap3
8/14 Test #232: structmap3 ....................... Passed 16.44 sec
Start 268: Step_sst-kw-wf
9/14 Test #268: Step_sst-kw-wf ................... Passed 20.11 sec
Start 273: mgdyn_harmonic
10/14 Test #273: mgdyn_harmonic ................... Passed 14.05 sec
Start 275: diffuser_sa
11/14 Test #275: diffuser_sa ...................... Passed 7.41 sec
Start 288: mgdyn_steady_periodic
12/14 Test #288: mgdyn_steady_periodic ............ Passed 19.65 sec
Start 298: levelset3b
13/14 Test #298: levelset3b ....................... Passed 8.45 sec
Start 306: RotatingBCPoisson3DGeneric
14/14 Test #306: RotatingBCPoisson3DGeneric ....... Passed 13.40 sec
100% tests passed, 0 tests failed out of 14
Label Time Summary:
benchmark = 177.41 sec
Total Test time (real) = 177.77 sec
The tests can be used for mainly for two purposes
1) To rate the performance of different platforms for typical small Elmer cases
2) To ensure that the code does not become slower after new features are introduced
Because we cannot guarantee exact same performance between versions it may not really be useful to compare different platforms with different Elmer versions. Still we hope that this could be of use.
I encourage everybody to run the tests and specify their setup and code performance.
-Peter