diff --git a/buildbot/google/README.md b/buildbot/google/README.md --- a/buildbot/google/README.md +++ b/buildbot/google/README.md @@ -1,41 +1,3 @@ -# LLVM buildbot workers configuration +# Configuration files for various buildbots run by Google. -This folder contains some of the configuration of the buildbots managed -at Google. The workers are deployed on Google Cloud. - -# The cloud stack - -To deploy build bots workers, we need to create a bunch of virtual machines -on Google Cloud. There are multiple ways to do this. *Terraform* is convenient -as it offers to declare the required machines in config files and then -create/update the machines in the cloud. - -This way we have version control over the infrastructure -and we can review changes before applying them. In case something goes wrong, -we can easily revert changes. It also allows us to copy & paste parts of the -infrastructure for additional machines. - -Internally, Terraform is using *Kubernetes* to manage the deployment of software -to machines. The software installed on the build machines is defined -in *Docker* images. An image is a (layered) file system with all the tools and -settings required for the worker. - -The images are stored in a "registry" (gcr.io in this case) and are then -pulled from the machines where they are executed. The -images can be versioned so that we can pick exactly which version of the image -we want to run. - -The contents of a Docker image is again defined in a config file called -`Dockerfile`. A Dockerfile is a sort of script defining on how to install and -configure the software for a machine. We keep those files in this repository as -well so we can review changes and revert changes if something breaks. - -The docker images also allow contributors to reproduce a failing test locally, -as they will get the same machine configuration as used on the server. - -# Folder structure - -* `docker` - Dockerfiles for the workers and some scripting -* `terraform` - cluster configuration and deployment -* `config.sh` - variables used in other scripts -* `gcloud_config.sh` - configure cloud tooling +* mlir diff --git a/buildbot/google/README.md b/buildbot/google/mlir/README.md copy from buildbot/google/README.md copy to buildbot/google/mlir/README.md diff --git a/buildbot/google/config.sh b/buildbot/google/mlir/config.sh rename from buildbot/google/config.sh rename to buildbot/google/mlir/config.sh diff --git a/buildbot/google/docker/README.md b/buildbot/google/mlir/docker/README.md rename from buildbot/google/docker/README.md rename to buildbot/google/mlir/docker/README.md diff --git a/buildbot/google/docker/build_deploy.sh b/buildbot/google/mlir/docker/build_deploy.sh rename from buildbot/google/docker/build_deploy.sh rename to buildbot/google/mlir/docker/build_deploy.sh diff --git a/buildbot/google/docker/build_run.sh b/buildbot/google/mlir/docker/build_run.sh rename from buildbot/google/docker/build_run.sh rename to buildbot/google/mlir/docker/build_run.sh diff --git a/buildbot/google/docker/buildbot-mlir-nvidia/Dockerfile b/buildbot/google/mlir/docker/buildbot-mlir-nvidia/Dockerfile rename from buildbot/google/docker/buildbot-mlir-nvidia/Dockerfile rename to buildbot/google/mlir/docker/buildbot-mlir-nvidia/Dockerfile diff --git a/buildbot/google/docker/buildbot-mlir-nvidia/VERSION b/buildbot/google/mlir/docker/buildbot-mlir-nvidia/VERSION rename from buildbot/google/docker/buildbot-mlir-nvidia/VERSION rename to buildbot/google/mlir/docker/buildbot-mlir-nvidia/VERSION diff --git a/buildbot/google/docker/buildbot-mlir-nvidia/run.sh b/buildbot/google/mlir/docker/buildbot-mlir-nvidia/run.sh rename from buildbot/google/docker/buildbot-mlir-nvidia/run.sh rename to buildbot/google/mlir/docker/buildbot-mlir-nvidia/run.sh diff --git a/buildbot/google/docker/pod_login.sh b/buildbot/google/mlir/docker/pod_login.sh rename from buildbot/google/docker/pod_login.sh rename to buildbot/google/mlir/docker/pod_login.sh diff --git a/buildbot/google/docker/pod_logs.sh b/buildbot/google/mlir/docker/pod_logs.sh rename from buildbot/google/docker/pod_logs.sh rename to buildbot/google/mlir/docker/pod_logs.sh diff --git a/buildbot/google/gcloud_config.sh b/buildbot/google/mlir/gcloud_config.sh rename from buildbot/google/gcloud_config.sh rename to buildbot/google/mlir/gcloud_config.sh diff --git a/buildbot/google/terraform/README.md b/buildbot/google/mlir/terraform/README.md rename from buildbot/google/terraform/README.md rename to buildbot/google/mlir/terraform/README.md diff --git a/buildbot/google/terraform/deployment-mlir-nvidia.yaml b/buildbot/google/mlir/terraform/deployment-mlir-nvidia.yaml rename from buildbot/google/terraform/deployment-mlir-nvidia.yaml rename to buildbot/google/mlir/terraform/deployment-mlir-nvidia.yaml diff --git a/buildbot/google/terraform/main.tf b/buildbot/google/mlir/terraform/main.tf rename from buildbot/google/terraform/main.tf rename to buildbot/google/mlir/terraform/main.tf diff --git a/buildbot/google/terraform/outputs.tf b/buildbot/google/mlir/terraform/outputs.tf rename from buildbot/google/terraform/outputs.tf rename to buildbot/google/mlir/terraform/outputs.tf diff --git a/buildbot/google/terraform/terraform.tfvars b/buildbot/google/mlir/terraform/terraform.tfvars rename from buildbot/google/terraform/terraform.tfvars rename to buildbot/google/mlir/terraform/terraform.tfvars diff --git a/buildbot/google/terraform/variables.tf b/buildbot/google/mlir/terraform/variables.tf rename from buildbot/google/terraform/variables.tf rename to buildbot/google/mlir/terraform/variables.tf