[buildbot] Add slave to test libomp for ppc64le targets.

[sfantao]

Summary

This patch adds a slave to test libomp for powerpc64 little endian. This configuration is known to work but didn't have a bot to actually do the testing.

The configuration uses the existing builder infrastructure already in place for x86. The intent is to extend the testing to cover OpenMP offloading (libomptarget) when it is ready in the OpenMP project. The slave has an NVIDIA K40 GPU ready for that purpose.

[gkistanova]

LGTM.

Thanks

Galina

[Hahnfeld]

Will you (as the bot owner) take care that /home/bbot/opt/clang is updated?

Ideally I think libomp should be built together with a full LLVM stack. So, building llvm + clang + openmp for all commits to these subprojects.

This would
a) enable us to catch regressions in clang itself because the libomp (and libomptarget in the future) tests are triggered for each commit to clang
b) remove the necessity to rebuild clang separately for each commit to libomp which is quite time consuming and doesn't give full coverage of all commits to clang.

[sfantao]

Hi Jonas

In D28492#641053, @Hahnfeld wrote:

Will you (as the bot owner) take care that /home/bbot/opt/clang is updated?

The version of clang in /home/bbot/opt/clang is last clang release and it is the stable c/c++ compiler in the machine. I expect to update it when a new release is available.

Ideally I think libomp should be built together with a full LLVM stack. So, building llvm + clang + openmp for all commits to these subprojects.

This would
a) enable us to catch regressions in clang itself because the libomp (and libomptarget in the future) tests are triggered for each commit to clang
b) remove the necessity to rebuild clang separately for each commit to libomp which is quite time consuming and doesn't give full coverage of all commits to clang.

I agree. I think that we should also have separate in-tree and standalone builds for openmp given that there is a lot of stuff in the build system that depends on that. In summary:
i) llvm+clang+openmp in tree build with machine stable compiler
ii) standalone openmp build with the compiler built in i)
iii) standalone openmp build with the machine stable compiler

We could skip iii), but it is a fairly quick build. I don't mind working on a patch to do this on ppc64le-nvidia-K40. Was there any discussion to do that on the existing slave?

Thanks,
Samuel

[Hahnfeld]

In D28492#641276, @sfantao wrote:

I agree. I think that we should also have separate in-tree and standalone builds for openmp given that there is a lot of stuff in the build system that depends on that. In summary:
i) llvm+clang+openmp in tree build with machine stable compiler
ii) standalone openmp build with the compiler built in i)
iii) standalone openmp build with the machine stable compiler

Why do we need ii)? i) will use the just-built compiler to test the openmp runtime AFAIK

We could skip iii), but it is a fairly quick build. I don't mind working on a patch to do this on ppc64le-nvidia-K40. Was there any discussion to do that on the existing slave?

Thanks,
Samuel

There was some discussion last year but I think nothing has happened so far :-/ http://lists.llvm.org/pipermail/openmp-dev/2016-March/001179.html

[sfantao]

Why do we need ii)? i) will use the just-built compiler to test the openmp runtime AFAIK

The reason I am proposing ii) is to test the build of the library itself. Making sure the library build without issues with the latest clang would be something good to have. In terms of the runtime tests, they would basically use similar builds but exercising different logic in the build system.

Thanks,
Samuel

[Hahnfeld]

In D28492#641317, @sfantao wrote:

Why do we need ii)? i) will use the just-built compiler to test the openmp runtime AFAIK

The reason I am proposing ii) is to test the build of the library itself. Making sure the library build without issues with the latest clang would be something good to have. In terms of the runtime tests, they would basically use similar builds but exercising different logic in the build system.

Thanks,
Samuel

Ok, SGTM

buildbot/osuosl/master/config/builders.py

return [
         {'name': "libomp-ompt-clang-x86_64-linux-debian",
          'slavenames':["gribozavr4"],
          'builddir':"libomp-ompt-clang-x86_64-linux-debian",
          'factory' : Libiomp5Builder.getLibompCMakeBuildFactory(
                          c_compiler="clang",
                          cxx_compiler="clang++",
                          ompt=True,
                          env={'PATH':'/home/llvmbb/bin/clang-latest/bin:/home/llvmbb/bin:/usr/local/bin:/usr/local/bin:/usr/bin:/bin'})},
+                         
+        {'name': "libomp-clang-ppc64le-linux-debian",
+         'slavenames':["ppc64le-nvidia-K40"],
+         'builddir':"libomp-clang-ppc64le-linux-debian",
+         'factory' : Libiomp5Builder.getLibompCMakeBuildFactory(
+                         c_compiler="/home/bbot/opt/clang/bin/clang",
+                         cxx_compiler="/home/bbot/opt/clang/bin/clang++",
+                         env={'PATH':'/home/bbot/opt/cmake/bin:/home/bbot/opt/ninja/bin:/usr/local/bin:/usr/bin:/bin'})},
+
         ]
 
 def _get_libcxx_builders():
     return [
         # gribozavr's builders on gribozavr4 
         {'name': 'libcxx-libcxxabi-x86_64-linux-debian',
          'slavenames': ['gribozavr4'],
          'builddir': 'libcxx-libcxxabi-x86_64-linux-debian',

buildbot/osuosl/master/config/slaves.py

return [
         create_slave("ppc64be-clang-multistage-test", properties={'jobs': 16}, max_builds=1),
         create_slave("ppc64be-sanitizer", properties={'jobs': 16}, max_builds=1),
 
         # POWER 8 PowerPC little endian (powerpc64le)
         create_slave("ppc64le-clang-test", properties={'jobs': 4}, max_builds=1),
         create_slave("ppc64le-clang-lnt-test", properties={'jobs': 6}, max_builds=1),
         create_slave("ppc64le-clang-multistage-test", properties={'jobs': 8}, max_builds=1),
         create_slave("ppc64le-sanitizer", properties={'jobs': 4}, max_builds=1),
         
+        # POWER 8 PowerPC little endian (powerpc64le) with NVIDIA GPUs
+        create_slave("ppc64le-nvidia-K40", properties={'jobs': 4}, max_builds=1),
+
         # Ubuntu x86-64, Intel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz
         create_slave("hexagon-build-02", properties={'jobs': 12, 'loadaverage': 32},
             max_builds=1),
 
         # Ubuntu x86-64, Intel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz
         create_slave("hexagon-build-03", properties={'jobs': 16, 'loadaverage':32},
             max_builds=1),