Add a Dockerfile for clang-proto-fuzzer

[kcc]

Summary

Add a Dockerfile for clang-proto-fuzzer

[morehouse]

tools/clang-fuzzer/Dockerfile

23

What if the latest revision breaks the build?

25

Should this be svn co ... compiler-rt?

[kcc]

fix 'svn co' command (apparently it did not matter though)

[kcc]

tools/clang-fuzzer/Dockerfile

23

Then we will know that!

I hope to have clang-proto-fuzzer on a bot of some kind at some point, maybe on oss-fuzz, so we will know if the TotT is broken

25

Of course, fixed. !
Very surprisingly, this still worked!

[hintonda]

You may want to add an ARG instruction to force docker to rerun the svn commands each time you invoke docker build. Otherwise it will reuse the cache since docker only looks at the RUN text, not it's result.

To get around that, you can add an ARG REVISION instruction before the first RUN command, and use $REVISION in your subsequent svn co commands. The ARG instruction, will invalidate the cache for the subsequent RUN instruction, since docker passes ARG as an environment variable and can't know how it's used.

Then you could invoke docker like this:

docker build --build-arg REV=$(svn info --show-item revision http://llvm.org/svn/llvm-project/llvm/trunk) .

[kcc]

I'd avoid such extra complexity, after all this is just an example.
One can force the full rebuild with --no-cache. It'll take just a bit more time since most of the time is consumed by the compiler builds.
BTW, my old svn (1.8.8, Ubuntu 14.04) does't have "info --show-item revision"

[hintonda]

I'd avoid such extra complexity, after all this is just an example.

Understood... LGTM

BTW, my old svn (1.8.8, Ubuntu 14.04) does't have "info --show-item revision"

Guess my new macbook pro spoiled me...

tools/clang-fuzzer/Dockerfile

+#===- llvm/tools/clang/tools/clang-fuzzer ---------------------------------===//
+#
+#                     The LLVM Compiler Infrastructure
+#
+# This file is distributed under the University of Illinois Open Source
+# License. See LICENSE.TXT for details.
+#
+#===----------------------------------------------------------------------===//
+# Produces an image that builds clang-proto-fuzzer
+FROM ubuntu:16.04
+RUN apt-get update -y
+RUN apt-get install -y autoconf automake libtool curl make g++ unzip wget git \
+    binutils liblzma-dev libz-dev python-all cmake ninja-build subversion \
+    pkg-config docbook2x
+
+WORKDIR /root
+
+# Get protobuf
+RUN wget -qO- https://github.com/google/protobuf/releases/download/v3.3.0/protobuf-cpp-3.3.0.tar.gz | tar zxf -
+RUN cd protobuf-3.3.0 && ./autogen.sh && ./configure && make -j $(nproc) && make check -j $(nproc) && make install && ldconfig
+# Get LLVM
+RUN svn co http://llvm.org/svn/llvm-project/llvm/trunk llvm
+RUN cd llvm/tools && svn co http://llvm.org/svn/llvm-project/cfe/trunk clang -r $(cd ../ && svn info | grep Revision | awk '{print $2}')
+RUN cd llvm/projects && svn co http://llvm.org/svn/llvm-project/compiler-rt/trunk compiler-rt -r $(cd ../ && svn info | grep Revision | awk '{print $2}')
+# Build plain LLVM (stage 0)
+RUN mkdir build0 && cd build0 && cmake -GNinja -DCMAKE_BUILD_TYPE=Release ../llvm && ninja
+# Configure instrumented LLVM (stage 1)
+RUN mkdir build1 && cd build1 && cmake -GNinja -DCMAKE_BUILD_TYPE=Release ../llvm \
+    -DLLVM_ENABLE_ASSERTIONS=ON \
+    -DCMAKE_C_COMPILER=`pwd`/../build0/bin/clang \
+    -DCMAKE_CXX_COMPILER=`pwd`/../build0/bin/clang++ \
+    -DLLVM_USE_SANITIZE_COVERAGE=YES \
+    -DLLVM_USE_SANITIZER=Address -DCLANG_ENABLE_PROTO_FUZZER=ON
+# Build the fuzzers
+RUN cd build1 && ninja clang-fuzzer
+RUN cd build1 && ninja clang-proto-fuzzer
+RUN cd build1 && ninja clang-proto-to-cxx

tools/clang-fuzzer/README.txt

 Example:
   cd $LLVM_SOURCE_DIR
   mkdir build && cd build
   cmake .. -GNinja -DCMAKE_C_COMPILER=clang -DCMAKE_CXX_COMPILER=clang++ \
     -DLLVM_USE_SANITIZE_COVERAGE=YES -DLLVM_USE_SANITIZER=Address \
     -DCLANG_ENABLE_PROTO_FUZZER=ON
   ninja clang-proto-fuzzer clang-proto-to-cxx
 
+This directory also contains a Dockerfile which sets up all required
+dependencies and builds the fuzzers.
 
 =====================
  Running the fuzzers
 =====================
 clang-fuzzer:
   bin/clang-fuzzer CORPUS_DIR
 
 clang-proto-fuzzer:
   bin/clang-proto-fuzzer CORPUS_DIR
 
 Translating a clang-proto-fuzzer corpus output to C++:
   bin/clang-proto-to-cxx CORPUS_OUTPUT_FILE