Add BOLT builder and worker configurations

[Amir]

Summary

Worker runs on a Meta-managed buildbot. Builder uses BOLTBuilder defined in D116060.
The configuration is tested with a temporary build master, which points to the current BOLT repo instead of the monorepo.

This diff is a part of BOLT upstreaming:
https://lists.llvm.org/pipermail/llvm-dev/2021-December/154290.html

Will only be pushed once BOLT is in monorepo.

[gkistanova]

Looks good with one cosmetic nit pick.

'-DLLVM_TARGETS_TO_BUILD=X86;AArch64',
"-DCMAKE_C_COMPILER_LAUNCHER=ccache",

Could you be consistent with the quotation marks, please?

With this fixed, please feel free to commit once D116060 is in.

[mehdi_amini]

buildbot/osuosl/master/config/builders.py

2276

Nit: there is an option for ccache: -DLLVM_CCACHE_BUILD=ON

[Amir]

Address review comments: uniform quotation, ccache option

[Amir]

Remove contents of D116060 that was accidentally added to this diff

[Amir]

This comment was removed by Amir.

[Amir]

Rename worker, specify jobs and max_builds

[Amir]

@gkistanova,

BOLT is now merged and ready to be built: https://github.com/llvm/llvm-project/commit/4c106cfdf7cf7eec861ad3983a3dd9a9e8f3a8ae
This diff is ready to be merged to enable BOLT buildbot.
I've sent you access credentials for bolt-worker, did you have a chance to add them to buildbot-master?

[gkistanova]

Hi Amir,

Please feel free to connect your worker to the staging buildbot.

[Amir]

Hi Galina!

The worker is now connected to the staging buildmaster and successfully completed the first build.

Thanks for helping us set up the buildbot!

[gkistanova]

You are welcome, Amir!

Now let's wait for enough commits and builds to demonstrate the reliability of the bot. :)

buildbot/osuosl/master/config/builders.py

 from zorg.buildbot.builders import ClangLTOBuilder
 from zorg.buildbot.builders import UnifiedTreeBuilder
 from zorg.buildbot.builders import AOSPBuilder
 from zorg.buildbot.builders import AnnotatedBuilder
 from zorg.buildbot.builders import LLDPerformanceTestsuite
 from zorg.buildbot.builders import FuchsiaBuilder
 from zorg.buildbot.builders import XToolchainBuilder
 from zorg.buildbot.builders import TestSuiteBuilder
+from zorg.buildbot.builders import BOLTBuilder
 
 from zorg.buildbot.builders import HtmlDocsBuilder
 from zorg.buildbot.builders import DoxygenDocsBuilder
 
 reload(HtmlDocsBuilder)
 reload(DoxygenDocsBuilder)
 
 
'factory': UnifiedTreeBuilder.getCmakeWithNinjaBuildFactory(
              "-DLLVM_ENABLE_ASSERTIONS:BOOL=ON",
              "-DLLVM_TOOL_CLANG_TOOLS_EXTRA_BUILD=0",
              "-DLLVM_ENABLE_LIBPFM=OFF",
              "-DLLVM_TARGETS_TO_BUILD=X86",
              "-DLLVM_EXPERIMENTAL_TARGETS_TO_BUILD=ARC",
          ])},
 
 
+    # BOLT builder managed by Meta
+    {'name': "bolt-x86_64-ubuntu",
+    'tags': ["bolt"],
+    'collapseRequests': False,
+    'workernames':["bolt-worker"],
+    'builddir': "bolt-x86_64-ubuntu-bolttests",
+    'factory' : BOLTBuilder.getBOLTCmakeBuildFactory(
+                    bolttests=True,
+                    extra_configure_args=[
+                        "-DLLVM_CCACHE_BUILD=ON",
+                        "-DLLVM_ENABLE_PROJECTS=clang;lld;bolt",
+                        "-DLLVM_TARGETS_TO_BUILD=X86;AArch64",
+                        ],
+                    )},
+
 ]

buildbot/osuosl/master/config/workers.py

return [
         create_worker("xcore-ubuntu20-x64", properties={'jobs': 4}, max_builds=1),
 
         # ARC Worker, CentOS 7.9 x86_64 Intel Xeon Platinum 8000 @ 3.6GHz, 32GB RAM
         create_worker("arc-worker", properties={'jobs': 16}, max_builds=1),
 
         # OpenMP on AMDGPU, Ubuntu 18.04.5, Intel(R) Xeon(R) Gold 5218 @ 2.30GHz with 64GB Memory, 1 Vega20 GPU with 16GB Memory
         create_worker("omp-vega20-0", properties={'jobs': 32}, max_builds=1),
         create_worker("omp-vega20-1", properties={'jobs': 32}, max_builds=1),
+
+        # BOLT worker
+        create_worker("bolt-worker", properties={'jobs' : 16}, max_builds=1),
         ]