Skip to content

Instantly share code, notes, and snippets.

@arijitlaik
Created September 30, 2018 14:17
Show Gist options
  • Select an option

  • Save arijitlaik/d7cea9cbc8dab53143070fd45c87872e to your computer and use it in GitHub Desktop.

Select an option

Save arijitlaik/d7cea9cbc8dab53143070fd45c87872e to your computer and use it in GitHub Desktop.

MPICH

time mpirun -np 1 python solver_1.py

Global element size: 32x32
Local offset of rank 0: 0x0
Local range of rank 0: 32x32

Linear solver (AMBUSAN8__system-execute)

BSSCR -- Block Stokes Schur Compliment Reduction Solver AUGMENTED LAGRANGIAN K2 METHOD - Penalty = 0.000000

SROpGenerator_SimpleFinestLevel: time = 1.43003e-03 [4] SROpGenerator_SimpleCoarserLevel: time = 6.95944e-04 [3] SROpGenerator_SimpleCoarserLevel: time = 2.87056e-04 [2] SROpGenerator_SimpleCoarserLevel: time = 1.71900e-04 [1] SROpGenerator_SimpleCoarserLevel: time = 9.10759e-05 Linear A11_ solve converged due to CONVERGED_RTOL iterations 7 Setting schur_pc to "uw" Linear A11_ solve converged due to CONVERGED_RTOL iterations 6 Linear A11_ solve converged due to CONVERGED_RTOL iterations 6 Linear A11_ solve converged due to CONVERGED_RTOL iterations 6 Linear A11_ solve converged due to CONVERGED_RTOL iterations 7

SCR Solver Summary:

Multigrid setup: = 0.00283 secs RHS V Solve: = 0.004737 secs / 7 its Pressure Solve: = 0.006481 secs / 3 its Final V Solve: = 0.00242 secs / 7 its

Total BSSCR Linear solve time: 0.020435 seconds

Linear solver (AMBUSAN8__system-execute), solution time 2.123785e-02 (secs)

Pressure iterations: 3 Velocity iterations: 7 (presolve) Velocity iterations: 18 (pressure solve) Velocity iterations: 7 (backsolve) Velocity iterations: 32 (total solve)

SCR RHS setup time: 2.8450e-03 SCR RHS solve time: 4.7369e-03 Pressure setup time: 1.9884e-04 Pressure solve time: 6.4812e-03 Velocity setup time: 0.0000e+00 (backsolve) Velocity solve time: 2.4199e-03 (backsolve) Total solve time : 2.0435e-02

Velocity solution min/max: 0.0000e+00/0.0000e+00 Pressure solution min/max: 0.0000e+00/0.0000e+00

real 0m0.748s user 0m0.894s sys 0m0.214s

np 2

mpirun -np 2 python solver_1.py

Global element size: 32x32
Local offset of rank 0: 0x0
Local range of rank 0: 32x16

Linear solver (K2XHSXSS__system-execute)

BSSCR -- Block Stokes Schur Compliment Reduction Solver AUGMENTED LAGRANGIAN K2 METHOD - Penalty = 0.000000

SROpGenerator_SimpleFinestLevel: time = 2.08211e-03 [4] SROpGenerator_SimpleCoarserLevel: time = 1.53208e-03 [3] SROpGenerator_SimpleCoarserLevel: time = 1.42717e-03 [2] SROpGenerator_SimpleCoarserLevel: time = 1.25599e-03 [1] SROpGenerator_SimpleCoarserLevel: time = 1.20711e-03 Linear A11_ solve converged due to CONVERGED_RTOL iterations 7 Setting schur_pc to "uw" Linear A11_ solve converged due to CONVERGED_RTOL iterations 6 Linear A11_ solve converged due to CONVERGED_RTOL iterations 6 Linear A11_ solve converged due to CONVERGED_RTOL iterations 6 Linear A11_ solve converged due to CONVERGED_RTOL iterations 7

SCR Solver Summary:

Multigrid setup: = 0.007676 secs RHS V Solve: = 0.01337 secs / 7 its Pressure Solve: = 0.01783 secs / 3 its Final V Solve: = 0.005883 secs / 7 its

Total BSSCR Linear solve time: 0.056969 seconds

Linear solver (K2XHSXSS__system-execute), solution time 6.103683e-02 (secs)

Pressure iterations: 3 Velocity iterations: 7 (presolve)
Velocity iterations: 18 (pressure solve) Velocity iterations: 7 (backsolve)
Velocity iterations: 32 (total solve)

SCR RHS setup time: 9.5980e-03 SCR RHS solve time: 1.3370e-02 Pressure setup time: 3.1781e-04 Pressure solve time: 1.7834e-02 Velocity setup time: 9.5367e-07 (backsolve) Velocity solve time: 5.8830e-03 (backsolve) Total solve time : 5.6969e-02

Velocity solution min/max: 0.0000e+00/0.0000e+00 Pressure solution min/max: 0.0000e+00/0.0000e+00

real 0m0.830s user 0m1.593s sys 0m0.632s

np 3

mpirun -np 3 python solver_1.py

Global element size: 32x32
Local offset of rank 0: 0x0
Local range of rank 0: 32x11

Linear solver (RY7WDLOL__system-execute)

BSSCR -- Block Stokes Schur Compliment Reduction Solver AUGMENTED LAGRANGIAN K2 METHOD - Penalty = 0.000000

SROpGenerator_SimpleFinestLevel: time = 2.34103e-03 [4] SROpGenerator_SimpleCoarserLevel: time = 2.02203e-03 [3] SROpGenerator_SimpleCoarserLevel: time = 1.88398e-03 [2] SROpGenerator_SimpleCoarserLevel: time = 1.80602e-03 [1] SROpGenerator_SimpleCoarserLevel: time = 1.80602e-03 Linear A11_ solve converged due to CONVERGED_RTOL iterations 7 Setting schur_pc to "uw" Linear A11_ solve converged due to CONVERGED_RTOL iterations 6 Linear A11_ solve converged due to CONVERGED_RTOL iterations 6 Linear A11_ solve converged due to CONVERGED_RTOL iterations 6 Linear A11_ solve converged due to CONVERGED_RTOL iterations 7

SCR Solver Summary:

Multigrid setup: = 0.01004 secs RHS V Solve: = 0.02075 secs / 7 its Pressure Solve: = 0.0236 secs / 3 its Final V Solve: = 0.008762 secs / 7 its

Total BSSCR Linear solve time: 0.078789 seconds

Linear solver (RY7WDLOL__system-execute), solution time 8.298397e-02 (secs)

Pressure iterations: 3 Velocity iterations: 7 (presolve)
Velocity iterations: 18 (pressure solve) Velocity iterations: 7 (backsolve)
Velocity iterations: 32 (total solve)

SCR RHS setup time: 1.2172e-02 SCR RHS solve time: 2.0750e-02 Pressure setup time: 5.0998e-04 Pressure solve time: 2.3597e-02 Velocity setup time: 9.5367e-07 (backsolve) Velocity solve time: 8.7621e-03 (backsolve) Total solve time : 7.8789e-02

Velocity solution min/max: 0.0000e+00/0.0000e+00 Pressure solution min/max: 0.0000e+00/0.0000e+00

real 0m0.853s user 0m1.845s sys 0m1.147s

np 4

time mpirun -np 4 python solver_1.py

Global element size: 32x32
Local offset of rank 0: 0x0
Local range of rank 0: 16x16

Linear solver (PARYLHWM__system-execute)

BSSCR -- Block Stokes Schur Compliment Reduction Solver AUGMENTED LAGRANGIAN K2 METHOD - Penalty = 0.000000

SROpGenerator_SimpleFinestLevel: time = 3.37815e-03 [4] SROpGenerator_SimpleCoarserLevel: time = 2.97689e-03 [3] SROpGenerator_SimpleCoarserLevel: time = 2.84195e-03 [2] SROpGenerator_SimpleCoarserLevel: time = 2.85721e-03 [1] SROpGenerator_SimpleCoarserLevel: time = 2.95305e-03 Linear A11_ solve converged due to CONVERGED_RTOL iterations 7 Setting schur_pc to "uw" Linear A11_ solve converged due to CONVERGED_RTOL iterations 6 Linear A11_ solve converged due to CONVERGED_RTOL iterations 6 Linear A11_ solve converged due to CONVERGED_RTOL iterations 6 Linear A11_ solve converged due to CONVERGED_RTOL iterations 7

SCR Solver Summary:

Multigrid setup: = 0.01525 secs RHS V Solve: = 0.03105 secs / 7 its Pressure Solve: = 0.0409 secs / 3 its Final V Solve: = 0.018 secs / 7 its

Total BSSCR Linear solve time: 0.128895 seconds

Linear solver (PARYLHWM__system-execute), solution time 1.341848e-01 (secs)

Pressure iterations: 3 Velocity iterations: 7 (presolve)
Velocity iterations: 18 (pressure solve) Velocity iterations: 7 (backsolve)
Velocity iterations: 32 (total solve)

SCR RHS setup time: 1.9235e-02 SCR RHS solve time: 3.1055e-02 Pressure setup time: 6.3705e-04 Pressure solve time: 4.0902e-02 Velocity setup time: 1.1921e-06 (backsolve) Velocity solve time: 1.8003e-02 (backsolve) Total solve time : 1.2890e-01

Velocity solution min/max: 0.0000e+00/0.0000e+00 Pressure solution min/max: 0.0000e+00/0.0000e+00

real 0m0.942s user 0m2.479s sys 0m1.452s

openmpi

time mpirun -np 1 python solver_1.py

Global element size: 32x32
Local offset of rank 0: 0x0
Local range of rank 0: 32x32

Linear solver (5M0D06PY__system-execute)

BSSCR -- Block Stokes Schur Compliment Reduction Solver AUGMENTED LAGRANGIAN K2 METHOD - Penalty = 0.000000

SROpGenerator_SimpleFinestLevel: time = 1.20400e-03 [4] SROpGenerator_SimpleCoarserLevel: time = 5.24000e-04 [3] SROpGenerator_SimpleCoarserLevel: time = 2.01000e-04 [2] SROpGenerator_SimpleCoarserLevel: time = 1.19000e-04 [1] SROpGenerator_SimpleCoarserLevel: time = 9.50000e-05 Linear A11_ solve converged due to CONVERGED_RTOL iterations 7 Setting schur_pc to "uw" Linear A11_ solve converged due to CONVERGED_RTOL iterations 6 Linear A11_ solve converged due to CONVERGED_RTOL iterations 6 Linear A11_ solve converged due to CONVERGED_RTOL iterations 6 Linear A11_ solve converged due to CONVERGED_RTOL iterations 7

SCR Solver Summary:

Multigrid setup: = 0.002311 secs RHS V Solve: = 0.005711 secs / 7 its Pressure Solve: = 0.005909 secs / 3 its Final V Solve: = 0.002177 secs / 7 its

Total BSSCR Linear solve time: 0.021095 seconds

Linear solver (5M0D06PY__system-execute), solution time 2.235600e-02 (secs)

Pressure iterations: 3 Velocity iterations: 7 (presolve)
Velocity iterations: 18 (pressure solve) Velocity iterations: 7 (backsolve)
Velocity iterations: 32 (total solve)

SCR RHS setup time: 3.2460e-03 SCR RHS solve time: 5.7110e-03 Pressure setup time: 1.8200e-04 Pressure solve time: 5.9090e-03 Velocity setup time: 0.0000e+00 (backsolve) Velocity solve time: 2.1770e-03 (backsolve) Total solve time : 2.1095e-02

Velocity solution min/max: 0.0000e+00/0.0000e+00 Pressure solution min/max: 0.0000e+00/0.0000e+00

real 0m0.934s user 0m0.814s sys 0m0.319s

np2

time mpirun -np 2 python solver_1.py

Global element size: 32x32
Local offset of rank 0: 0x0
Local range of rank 0: 32x16

Linear solver (91I1YXYN__system-execute)

BSSCR -- Block Stokes Schur Compliment Reduction Solver AUGMENTED LAGRANGIAN K2 METHOD - Penalty = 0.000000

SROpGenerator_SimpleFinestLevel: time = 8.40000e-04 [4] SROpGenerator_SimpleCoarserLevel: time = 5.09000e-04 [3] SROpGenerator_SimpleCoarserLevel: time = 2.83000e-04 [2] SROpGenerator_SimpleCoarserLevel: time = 2.75000e-04 [1] SROpGenerator_SimpleCoarserLevel: time = 3.12000e-04 Linear A11_ solve converged due to CONVERGED_RTOL iterations 7 Setting schur_pc to "uw" Linear A11_ solve converged due to CONVERGED_RTOL iterations 6 Linear A11_ solve converged due to CONVERGED_RTOL iterations 6 Linear A11_ solve converged due to CONVERGED_RTOL iterations 6 Linear A11_ solve converged due to CONVERGED_RTOL iterations 7

SCR Solver Summary:

Multigrid setup: = 0.00239 secs RHS V Solve: = 0.003182 secs / 7 its Pressure Solve: = 0.0036 secs / 3 its Final V Solve: = 0.001295 secs / 7 its

Total BSSCR Linear solve time: 0.016190 seconds

Linear solver (91I1YXYN__system-execute), solution time 1.732800e-02 (secs)

Pressure iterations: 3 Velocity iterations: 7 (presolve)
Velocity iterations: 18 (pressure solve) Velocity iterations: 7 (backsolve)
Velocity iterations: 32 (total solve)

SCR RHS setup time: 4.4620e-03 SCR RHS solve time: 3.1820e-03 Pressure setup time: 1.0500e-04 Pressure solve time: 3.6000e-03 Velocity setup time: 0.0000e+00 (backsolve) Velocity solve time: 1.2950e-03 (backsolve) Total solve time : 1.6190e-02

Velocity solution min/max: 0.0000e+00/0.0000e+00 Pressure solution min/max: 0.0000e+00/0.0000e+00

real 0m0.687s user 0m1.416s sys 0m0.577s

np3

time mpirun -np 3 python solver_1.py

Global element size: 32x32
Local offset of rank 0: 0x0
Local range of rank 0: 32x11

Linear solver (IFXKL9AM__system-execute)

BSSCR -- Block Stokes Schur Compliment Reduction Solver AUGMENTED LAGRANGIAN K2 METHOD - Penalty = 0.000000

SROpGenerator_SimpleFinestLevel: time = 8.30000e-04 [4] SROpGenerator_SimpleCoarserLevel: time = 4.97000e-04 [3] SROpGenerator_SimpleCoarserLevel: time = 3.40000e-04 [2] SROpGenerator_SimpleCoarserLevel: time = 3.20000e-04 [1] SROpGenerator_SimpleCoarserLevel: time = 2.92000e-04 Linear A11_ solve converged due to CONVERGED_RTOL iterations 7 Setting schur_pc to "uw" Linear A11_ solve converged due to CONVERGED_RTOL iterations 6 Linear A11_ solve converged due to CONVERGED_RTOL iterations 6 Linear A11_ solve converged due to CONVERGED_RTOL iterations 6 Linear A11_ solve converged due to CONVERGED_RTOL iterations 7

SCR Solver Summary:

Multigrid setup: = 0.002485 secs RHS V Solve: = 0.002765 secs / 7 its Pressure Solve: = 0.002963 secs / 3 its Final V Solve: = 0.001036 secs / 7 its

Total BSSCR Linear solve time: 0.014927 seconds

Linear solver (IFXKL9AM__system-execute), solution time 1.615800e-02 (secs)

Pressure iterations: 3 Velocity iterations: 7 (presolve)
Velocity iterations: 18 (pressure solve) Velocity iterations: 7 (backsolve)
Velocity iterations: 32 (total solve)

SCR RHS setup time: 4.2380e-03 SCR RHS solve time: 2.7650e-03 Pressure setup time: 1.1000e-04 Pressure solve time: 2.9630e-03 Velocity setup time: 0.0000e+00 (backsolve) Velocity solve time: 1.0360e-03 (backsolve) Total solve time : 1.4927e-02

Velocity solution min/max: 0.0000e+00/0.0000e+00 Pressure solution min/max: 0.0000e+00/0.0000e+00

real 0m0.695s user 0m1.515s sys 0m1.059s

np 4

time mpirun -np 4 python solver_1.py

Global element size: 32x32
Local offset of rank 0: 0x0
Local range of rank 0: 16x16

Linear solver (9JAW4QXR__system-execute)

BSSCR -- Block Stokes Schur Compliment Reduction Solver AUGMENTED LAGRANGIAN K2 METHOD - Penalty = 0.000000

SROpGenerator_SimpleFinestLevel: time = 6.69000e-04 [4] SROpGenerator_SimpleCoarserLevel: time = 5.25000e-04 [3] SROpGenerator_SimpleCoarserLevel: time = 4.00000e-04 [2] SROpGenerator_SimpleCoarserLevel: time = 3.84000e-04 [1] SROpGenerator_SimpleCoarserLevel: time = 3.71000e-04 Linear A11_ solve converged due to CONVERGED_RTOL iterations 7 Setting schur_pc to "uw" Linear A11_ solve converged due to CONVERGED_RTOL iterations 6 Linear A11_ solve converged due to CONVERGED_RTOL iterations 6 Linear A11_ solve converged due to CONVERGED_RTOL iterations 6 Linear A11_ solve converged due to CONVERGED_RTOL iterations 7

SCR Solver Summary:

Multigrid setup: = 0.002552 secs RHS V Solve: = 0.00261 secs / 7 its Pressure Solve: = 0.002885 secs / 3 its Final V Solve: = 0.000955 secs / 7 its

Total BSSCR Linear solve time: 0.014983 seconds

Linear solver (9JAW4QXR__system-execute), solution time 1.624400e-02 (secs)

Pressure iterations: 3 Velocity iterations: 7 (presolve)
Velocity iterations: 18 (pressure solve) Velocity iterations: 7 (backsolve)
Velocity iterations: 32 (total solve)

SCR RHS setup time: 4.3570e-03 SCR RHS solve time: 2.6100e-03 Pressure setup time: 1.4500e-04 Pressure solve time: 2.8850e-03 Velocity setup time: 0.0000e+00 (backsolve) Velocity solve time: 9.5500e-04 (backsolve) Total solve time : 1.4983e-02

Velocity solution min/max: 0.0000e+00/0.0000e+00 Pressure solution min/max: 0.0000e+00/0.0000e+00

real 0m0.774s user 0m2.059s sys 0m1.243s

MPI MPICH OPENMPI MPICH OPENMPI MPICH OPENMPI MPICH OPENMPI
NP 1 1 2 2 3 3 4 4
Multigrid setup 0.00283 0.002311 0.007676 0.00239 0.01004 0.002485 0.01525 0.002552
RHS V Solve 0.004737 0.005711 0.01337 0.003182 0.02075 0.002765 0.03105 0.00261
Pressure Solve 0.006481 0.005909 0.01783 0.0036 0.0236 0.002963 0.0409 0.002885
Final V Solve 0.00242 0.002177 0.005883 0.001295 0.008762 0.001036 0.018 0.000955
Total BSSCR 0.020435 0.021095 0.056969 0.016190 0.078789 0.014927 0.128895 0.014983
real 0m0.748 0m0.934s 0m0.830 0m0.687s 0m0.853 0m0.695s 0m0.942 0m0.774s
user 0m0.894 0m0.814s 0m1.593 0m1.416s 0m1.845 0m1.515s 0m2.479 0m2.059s
sys 0m0.214 0m0.319s 0m0.632 0m0.577s 0m1.147 0m1.059s 0m1.452 0m1.243s
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment