added section on CI system

[kuhnel]

Summary

Add documentation for working with the CI systems.

This is based on the discussion in the Infrastructure Working Group:
https://github.com/ChristianKuehnel/iwg-workspace/issues/37

[kuhnel]

added missing information on worker tab

[kuhnel]

ping @reames

[kuhnel]

added screenshot

[kuhnel]

@reames I added a screenshot as you wanted. Please let me know if that addresses your usecase.

[reames]

LGTM

[kuhnel]

@gkistanova are you OK with this documentation change?

[gkistanova]

Thanks for updating the LLVM Developer Policy, Christian.
It looks good with a couple nit picks.

llvm/docs/DeveloperPolicy.rst

572

There is a set of builders with the name suffix "-release", for example https://lab.llvm.org/buildbot/#/builders/clang-with-thin-lto-ubuntu-release. These builders track the commits on the release branches to do the release testing.

610

LNT is a performance tracking system, not quite a CI.

[fhahn]

llvm/docs/DeveloperPolicy.rst

609

I'm not sure about the official status of green dragon, but I think in practice breaking one of those is considered similar to breaking bots at https://lab.llvm.org/buildbot/ (most bots for various Apple platforms are on green dragon rather than https://lab.llvm.org/buildbot)

[kuhnel]

addressed Galinas comments

llvm/docs/DeveloperPolicy.rst

609

I'm also not aware of any official policy around green dragons. So as I did not find any policy, I would assume they are optional as well...

[tschuett]

There is now an official revert policy:
https://reviews.llvm.org/D99305

[kuhnel]

@tschuett, thx I missed that update, just added a link to that...

[kuhnel]

added link to revert policy

[azharudd]

llvm/docs/DeveloperPolicy.rst

566–567

572

606–612

I think it is best to just remove this part.

• Issues reported by any CI system are to be fixed
• LNT is not CI, whereas this section is talking about CI system
• pre-merge testing is optional, covers only Phab reviews and already posts updates on the review

[kuhnel]

llvm/docs/DeveloperPolicy.rst

606–612

you're right, this does not really add value here.

[kuhnel]

addressed azharudd's comments

llvm/docs/DeveloperPolicy.rst

will only be done through the following process:
   * Start using the new features in LLVM's codebase.
 
 Here's a `sample RFC
 <http://lists.llvm.org/pipermail/llvm-dev/2019-January/129452.html>`_ and the
 `corresponding change <https://reviews.llvm.org/D57264>`_.
 
 .. _new-llvm-components:
 
+Working with the CI system
+--------------------------
+
+The main continuous integration (CI) tool for the LLVM project are the 
+`BuildBots <https://lab.llvm.org/buildbot/>`_. These use different *builders* to
+cover a wide variety of sub-projects and configurations. The builds are executed
+on different *workers*. Builders and workers are configured and provided by
+community members.
+
+The BuildBots track the commits on the main branch. This means that patches are
+built and tested after they are merged to the main branch (aka. post-merge 
+testing). This also means it's okay to break the build occasionally, as it's
+unreasonable to expect contributors to build and test their patch with every
+possible configuration.
+
+*If your commit broke the build*
+
+* Fix the build as soon as possible as this might block other contributors or
+  downstream users.
+* If you need more time analyze and fix the bug, please revert your change to
+  unblock others.
+
+*If someone else broke the build and this blocks your work*
+
+* Comment on the code review in `Phabricator <https://reviews.llvm.org/>`_ 
+  (if available) or email the author, explain the problem and how this impacts
+  you. Add a link to the broken build and the error message so folks can
+  understand the problem.
+* Revert the commit if this blocks your work.
+
+*If a build/worker is permanently broken*
+
+* 1st step: contact the owner of the worker. You can find the name and contact
+  information for the owner of worker on the page of the build in the tab 
+  "Worker: <name of worker>".
+* 2nd step: If the owner does not respond or fix the worker, please escalate 
+  to Galina Kostanova, the maintainer of the BuildBot master.
+* 3rd step: If Galina could not help you, please escalate to the 
+  Infrastructure Working Group `mailto:[e-mail]`.
+
+There are other CI systems provided by the community, however it is optional
+to monitor these:
+
+* `Green Dragon <http://green.lab.llvm.org/green/>`_
+* `LNT <http://lnt.llvm.org/>`_
+* `gn bot <http://45.33.8.238/>`_
+* `pre-merge testing <https://github.com/google/llvm-premerge-checks/>`_
+
 Introducing New Components into LLVM
 ====================================
 
 The LLVM community is a vibrant and exciting place to be, and we look to be
 inclusive of new projects and foster new communities, and increase
 collaboration across industry and academia.
 
 That said, we need to strike a balance between being inclusive of new ideas and
 people and the cost of ongoing maintenance that new code requires.  As such, we
 have a general :doc:`support policy<SupportPolicy>` for introducing major new