workflows: Use new custom runners from github

[tstellar]

Summary

Github now provides custom runners for us to use with more CPU,
memory, and disk, so we are switching from the default runners
to 8 core runners for Linux and Windows. This change also allows
us to consolidate jobs now that we have runners with more disk space.

[alexbatashev]

Comments below are totally unrelated to this patch, I'm just curious.

.github/workflows/clang-tests.yml

12–17

What's the reason to include pull_request here if all pull requests are automatically closed?

.github/workflows/llvm-project-tests.yml

39–45

Did you consider using sccache here? I see that right now this job takes ~4 hours, and the majority of time is spent on builds, which correlates with my experience building llvm in github actions. Enabling sccache should bring that down to ~3-15 minutes (windows is still much slower than linux, but that's a big improvement over a few hours).

[tstellar]

.github/workflows/clang-tests.yml

12–17

This patch is for the release branch where we use pull requests for pre-commit testing. We put the pull requests in the llvm/llvm-project-release-prs repo to keep them separate, so they aren't automatically closed.

.github/workflows/llvm-project-tests.yml

39–45

Is sccache something that is integrated with GitHub or do we have to set up our own server somewhere?

With these new runners, most jobs take around 30 minutes which is a big improvement over the old runners. Here is an example pull requests that uses the new runners: https://github.com/llvm/llvm-project-release-prs/pull/1

[alexbatashev]

.github/workflows/clang-tests.yml

12–17

Oh, I see, makes sense then.

.github/workflows/llvm-project-tests.yml

39–45

That’s a fantastic improvement. But builds are still 39 minutes long.

For github-hosted machines I’ve had success with github.com/actions/cache (see for example https://github.com/intel/llvm/commit/95104c079bacd4dd2920c8439d97d3f93e601b18). In my config llvm produced ~1,5 gigs of binaries. 10 gigs cache was more than enough for that task.

On self-hosted machines that’s even easier. You can persist data on the machine itself: https://github.com/intel/llvm/blob/f6420c769d473c00be736b8df361e10dd98a6009/.github/workflows/sycl_windows_build_and_test.yml#L32

[tstellar]

.github/workflows/llvm-project-tests.yml

39–45

Thanks for this information. I will look into enabling this in a follow-up patch.

[asl]

Looks like there are some typos in runner names

.github/workflows/libclang-abi-tests.yml

78

Should be ubuntu-20.04-16x64, no?

.github/workflows/llvm-project-tests.yml

34

ubuntu-20.04-16x64 and windows-2022-16x64

.github/workflows/llvm-tests.yml

64

See above

[tstellar]

.github/workflows/libclang-abi-tests.yml

78

I created generic labels for the machines, so we can change the machine types without updating the workflow definition.

[tstellar]

.github/workflows/libclang-abi-tests.yml

78

I just checked and it looks like the labels are gone now. It says that unassigned labels will be removed periodically, so maybe they were removed, because we weren't using them? I can add them back after I commit the patch, or if you think it's better, we can just use the labels provided by github.

[asl]

.github/workflows/clang-tests.yml

3

I'd probably suggest to ignore forks here as well. And allow manual triggering

[tstellar]

.github/workflows/clang-tests.yml

3

Alright this patch is meant to be applied on top of D129526, so I will fix it in that patch.

[tstellar]

Rebase on top of the latest version of D129526.

[Trass3r]

.github/workflows/llvm-project-tests.yml

39–45

There is also hendrikmuhs/ccache-action which specializes the cache action for ccache/sccache. It's also of interest to cache the ThinLTO cache. The cache sizes need to be tuned a bit since GH limits the total size.
https://github.com/Trass3r/llvm-project/blob/main/.github/workflows/CI.yml

[kwk]

This is just a ping. About the status of this patch.

[tstellar]

This is on hold, until we figure out if GitHub will charge us from the custom runners.

.github/workflows/clang-tests.yml

 name: Clang Tests
 
 on:
   push:
     branches:
       - 'release/**'
     paths:
       - 'clang/**'
       - '.github/workflows/clang-tests.yml'
       - '.github/workflows/llvm-project-tests.yml'
       - '!llvm/**'
   pull_request:
     paths:
       - 'clang/**'
       - '.github/workflows/clang-tests.yml'
       - '.github/workflows/llvm-project-tests.yml'
       - '!llvm/**'
 
 concurrency:
   # Skip intermediate builds: always.
   # Cancel intermediate builds: only if it is a pull request build.
   group: ${{ github.workflow }}-${{ github.ref }}
   cancel-in-progress: ${{ startsWith(github.ref, 'refs/pull/') }}
 
 jobs:
   check_clang:
     name: Test clang,lldb,libclc
-    uses: llvm/llvm-project/.github/workflows/llvm-project-tests.yml@release/14.x
+    uses: ./.github/workflows/llvm-project-tests.yml
     with:
       build_target: check-clang
       projects: clang;lldb;libclc

.github/workflows/libclang-abi-tests.yml

steps:
             echo ::set-output name=BASELINE_REF::llvmorg-${{ steps.version.outputs.LLVM_VERSION_MAJOR }}.0.0
             echo ::set-output name=ABI_HEADERS::.
             echo ::set-output name=ABI_LIBS::libclang.so libclang-cpp.so
           fi
 
 
   abi-dump:
     needs: abi-dump-setup
-    runs-on: ubuntu-latest
+    runs-on: ubuntu-20.04-llvm
     strategy:
       matrix:
         name:
           - build-baseline
           - build-latest
         include:
           - name: build-baseline
             llvm_version_major: ${{ needs.abi-dump-setup.outputs.BASELINE_VERSION_MAJOR }}

.github/workflows/libclc-tests.yml

concurrency:
   # Skip intermediate builds: always.
   # Cancel intermediate builds: only if it is a pull request build.
   group: ${{ github.workflow }}-${{ github.ref }}
   cancel-in-progress: ${{ startsWith(github.ref, 'refs/pull/') }}
 
 jobs:
   check_libclc:
     name: Test libclc
-    uses: llvm/llvm-project/.github/workflows/llvm-project-tests.yml@release/14.x
+    uses: ./.github/workflows/llvm-project-tests.yml
     with:
       build_target: ''
       projects: clang;libclc

.github/workflows/lld-tests.yml

concurrency:
   # Skip intermediate builds: always.
   # Cancel intermediate builds: only if it is a pull request build.
   group: ${{ github.workflow }}-${{ github.ref }}
   cancel-in-progress: ${{ startsWith(github.ref, 'refs/pull/') }}
 
 jobs:
   check_lld:
     name: Test lld
-    uses: llvm/llvm-project/.github/workflows/llvm-project-tests.yml@release/14.x
+    uses: ./.github/workflows/llvm-project-tests.yml
     with:
       build_target: check-lld
       projects: lld

.github/workflows/lldb-tests.yml

concurrency:
   # Cancel intermediate builds: only if it is a pull request build.
   group: ${{ github.workflow }}-${{ github.ref }}
   cancel-in-progress: ${{ startsWith(github.ref, 'refs/pull/') }}
 
 
 jobs:
   build_lldb:
     name: Build lldb
-    uses: llvm/llvm-project/.github/workflows/llvm-project-tests.yml@release/14.x
+    uses: ./.github/workflows/llvm-project-tests.yml
     with:
       build_target: ''
       projects: clang;lldb

.github/workflows/llvm-project-tests.yml

 jobs:
   lit-tests:
     name: Lit Tests
     runs-on: ${{ matrix.os }}
     strategy:
       fail-fast: false
       matrix:
         os:
-          - ubuntu-latest
-          - windows-latest
+          - ubuntu-20.04-llvm
+          - windows-2022-llvm
           # Use a specific version of macOS to ensure the CPLUS_INCLUDE_PATH workaround works.
           - macOS-10.15
     steps:
       - name: Setup Windows
         if: startsWith(matrix.os, 'windows')
         uses: llvm/actions/setup-windows@main
         with:
           arch: amd64
       - name: Install Ninja
         uses: llvm/actions/install-ninja@main
       - uses: actions/checkout@v1
         with:
           fetch-depth: 250
       - name: Build and Test
         uses: llvm/actions/build-test-llvm-project@main
         with:
           cmake_args: '-GNinja -DLLVM_ENABLE_PROJECTS="${{ inputs.projects }}" -DCMAKE_BUILD_TYPE=Release -DLLDB_INCLUDE_TESTS=OFF'
           build_target:  '${{ inputs.build_target }}'

.github/workflows/llvm-tests.yml

concurrency:
   # Skip intermediate builds: always.
   # Cancel intermediate builds: only if it is a pull request build.
   group: ${{ github.workflow }}-${{ github.ref }}
   cancel-in-progress: ${{ startsWith(github.ref, 'refs/pull/') }}
 
 
 jobs:
   check_all:
-    name: Test llvm,clang,libclc
-    uses: llvm/llvm-project/.github/workflows/llvm-project-tests.yml@release/14.x
+    name: Test llvm,clang,lld,lldb,libclc
+    uses: ./.github/workflows/llvm-project-tests.yml
     with:
       build_target: check-all
-      projects: clang;libclc
-
-  # These need to be separate from the check_all job, becuase there is not enough disk
-  # space to build all these projects on Windows.
-  build_lldb:
-    name: Build lldb
-    uses: llvm/llvm-project/.github/workflows/llvm-project-tests.yml@release/14.x
-    with:
-      build_target: ''
-      projects: clang;lldb
-
-  check_lld:
-    name: Test lld
-    uses: llvm/llvm-project/.github/workflows/llvm-project-tests.yml@release/14.x
-    with:
-      build_target: check-lld
-      projects: lld
+      projects: clang;lld;lldb;libclc
 
   abi-dump-setup:
     runs-on: ubuntu-latest
     outputs:
       BASELINE_REF: ${{ steps.vars.outputs.BASELINE_REF }}
       ABI_HEADERS: ${{ steps.vars.outputs.ABI_HEADERS }}
       BASELINE_VERSION_MAJOR: ${{ steps.vars.outputs.BASELINE_VERSION_MAJOR }}
       LLVM_VERSION_MAJOR: ${{ steps.version.outputs.LLVM_VERSION_MAJOR }}
steps:
             echo ::set-output name=ABI_HEADERS::llvm-c
           else
             echo ::set-output name=BASELINE_VERSION_MAJOR::${{ steps.version.outputs.LLVM_VERSION_MAJOR }}
             echo ::set-output name=ABI_HEADERS::.
           fi
 
   abi-dump:
     needs: abi-dump-setup
-    runs-on: ubuntu-latest
+    runs-on: ubuntu-20.04-llvm
     strategy:
       matrix:
         name:
           - build-baseline
           - build-latest
         include:
           - name: build-baseline
             llvm_version_major: ${{ needs.abi-dump-setup.outputs.BASELINE_VERSION_MAJOR }}