Increase memory of BOLT runtime instrumentation bump allocator used for writing resulting profile

[Kobzol]

Summary

The BOLT instrumentation runtime uses a bump allocator that has a fixed amount of maximum memory. In some cases, this memory limit is not large enough (https://github.com/llvm/llvm-project/issues/59174). We are hitting this limit when instrumenting the Rust compiler with BOLT.

This change increases the memory of the bump allocator used for writing the resulting BOLT profile.

[rafauler]

Thanks for the patch. This change is mostly OK, except that at the moment the arena size is not very simple. We actually have 3 different arenas during runtime, and by changing the default, you're changing the size of just one of them. I've highlighted in the code the different allocation arenas that we use. It would be weird to have a parameter that only changes the size of a single arena while we have two others that might overflow. What happens if we remove the calls to setMaxSize on the 2 other arenas, so all of them have the same space, the one you're parameterizing? Do we have a slowdown?

bolt/runtime/instr.cpp

196

Note: This is used to change the arena size. We have two other arenas that actually specify a custom size of 100MB using "setMaxSize", so you are overriding the size of just one of the 3 arenas.

1465

Setting hash arena to 100MB

1473

Note: This is the only arena that does not call setMaxSize, so that's the one you're parameterizing. It is used to write function profile.

1564

Note: setting global arena to 100MB

1637

This is just a clone of the other arena used for writing function profile, but for apple .

[Kobzol]

bolt/runtime/instr.cpp

1473

Hmm, I wonder, since the arena size situation is a bit complex, maybe a simpler solution would just be to set this specific arena to 100 MiB too?

[rafauler]

bolt/runtime/instr.cpp

1473

Yes, that makes sense

[Kobzol]

I removed the configuration and instead increased the size of the bump allocator that had the default size.

(I wasn't sure if I should upload a diff containing only the memory increase or if the diff should also "undo" the first diff. Hopefully I didn't mess this up).

[Kobzol]

Looks like I did mess up and I should have uploaded the complete diff without any relative changes to previous diffs. Did that now.

[Kobzol]

I checked that this change fixes our rustc issue, so the problem was indeed with this one specific bump allocator instance.

[rafauler]

Thanks!

[Kobzol]

Thank you! I'm not familiar with the landing process (and OFC I don't have merge rights) - do I have to do something else or will this eventually find its way into the main branch? :)

[Amir]

@Kobzol: "Jakub Beránek <[e-mail]>" as commit author line is OK?

[Kobzol]

Yes :)

bolt/CMakeLists.txt

   endif()
 endif()
 
-option(BOLT_RT_MAX_MEM "Maximum memory for runtime allocations." 0xa00000)
-
 if (BOLT_ENABLE_RUNTIME)
   message(STATUS "Building BOLT runtime libraries for X86")
   ExternalProject_Add(bolt_rt

                -DCMAKE_BUILD_TYPE=Release
                -DCMAKE_MAKE_PROGRAM=${CMAKE_MAKE_PROGRAM}
                -DCMAKE_INSTALL_PREFIX=${LLVM_BINARY_DIR}
-               -DBOLT_RT_MAX_MEM=${BOLT_RT_MAX_MEM}
-          BUILD_ALWAYS True
+    BUILD_ALWAYS True
     )
   install(CODE "execute_process\(COMMAND \${CMAKE_COMMAND} -DCMAKE_INSTALL_PREFIX=\${CMAKE_INSTALL_PREFIX} -P ${CMAKE_CURRENT_BINARY_DIR}/bolt_rt-bins/cmake_install.cmake \)"
     COMPONENT bolt)

bolt/runtime/CMakeLists.txt

   instr.cpp
   ${CMAKE_CURRENT_BINARY_DIR}/config.h
   )
-option(BOLT_RT_MAX_MEM "Maximum memory for runtime allocations.")
-target_compile_definitions(bolt_rt_instr PRIVATE RUNTIME_MAX_MEMORY=${BOLT_RT_MAX_MEM})
-
 add_library(bolt_rt_hugify STATIC
   hugify.cpp
   ${CMAKE_CURRENT_BINARY_DIR}/config.h

bolt/runtime/instr.cpp

 
 private:
   static constexpr uint64_t Magic = 0x1122334455667788ull;
-  uint64_t MaxSize = RUNTIME_MAX_MEMORY;
+  uint64_t MaxSize = 0xa00000;
   uint8_t *StackBase{nullptr};
   uint64_t StackSize{0};
   bool Shared{false};

   int FD = openProfile();
 
   BumpPtrAllocator Alloc;
+  Alloc.setMaxSize(0x6400000);
   const uint8_t *FuncDesc = Ctx.FuncDescriptions;
   for (int I = 0, E = __bolt_instr_num_funcs; I < E; ++I) {
     FuncDesc = writeFunctionProfile(FD, Ctx, FuncDesc, Alloc);