[clangd] Add benchmark for measuring latency of DecisionForest model.

[usaxena95]

Minor fixes.

[usaxena95]

Added benchmark.

[usaxena95]

Distribution change and better formatting.

[adamcz]

Would it make sense to set random seed to something fixed to make this more reproducible?

clang-tools-extra/clangd/benchmarks/CompletionModel/DecisionForestBenchmark.cpp

2 ↗

(On Diff #295479)

nit: this is supposed to be one-line comment, I think.

22 ↗

(On Diff #295479)

There are few lint warnings in this file. Please address them.

73 ↗

(On Diff #295479)

These should not be comments.

[adamcz]

Also typo in commit description: bencmark

[usaxena95]

Addressed comments: Default seeded the RNG for the benchmark.

[usaxena95]

Added newline at end of files.

[adamcz]

Still a couple of lint warnings, otherwise LGTM

clang-tools-extra/clangd/benchmarks/CompletionModel/DecisionForestBenchmark.cpp

74 ↗

(On Diff #295797)

Move this out of the loop. Right now we re-generate "random" dataset, but it's always the same dataset ;-)

[usaxena95]

Addressed comments.

clang-tools-extra/clangd/benchmarks/CompletionModel/DecisionForestBenchmark.cpp

74 ↗

(On Diff #295797)

I added it inside the loop since there is only one state right now. But probably moving it out makes it more meaningful.

clang-tools-extra/clangd/benchmarks/CMakeLists.txt

 include_directories(${CMAKE_CURRENT_SOURCE_DIR}/../)
 
 add_benchmark(IndexBenchmark IndexBenchmark.cpp)
 
 target_link_libraries(IndexBenchmark
   PRIVATE
   clangDaemon
   LLVMSupport
   )
+
+add_benchmark(DecisionForestBenchmark DecisionForestBenchmark.cpp)
+
+target_link_libraries(DecisionForestBenchmark
+  PRIVATE
+  clangDaemon
+  LLVMSupport
+  )
 No newline at end of file

clang-tools-extra/clangd/benchmarks/DecisionForestBenchmark.cpp

+//===--- DecisionForestBenchmark.cpp - Benchmark for code completion ranking
+//latency -----------*- C++ -*-===//
+//
+// Part of the LLVM Project, under the Apache License v2.0 with LLVM Exceptions.
+// See https://llvm.org/LICENSE.txt for license information.
+// SPDX-License-Identifier: Apache-2.0 WITH LLVM-exception
+//
+//===----------------------------------------------------------------------===//
+
+#include "CompletionModel.h"
+#include "benchmark/benchmark.h"
+
+const char *IndexFilename;
+const char *RequestsFilename;
+
+namespace clang {
+namespace clangd {
+namespace {
+void RunDecisionForestPrediciton() {
+  Example E;
+
+  // E.setIsDeprecated(Quality.Deprecated);
+  // E.setIsReservedName(Quality.ReservedName);
+  // E.setIsImplementationDetail(Quality.ImplementationDetail);
+  // E.setNumReferences(Quality.References);
+  // E.setSymbolCategory(Quality.Category);
+
+  // E.setIsNameInContext(Derived.NameMatchesContext);
+  // E.setIsForbidden(Relevance.Forbidden);
+  // E.setIsInBaseClass(Relevance.InBaseClass);
+  // E.setFileProximityDistance(Derived.FileProximityDistance);
+  // E.setSemaFileProximityScore(Relevance.SemaFileProximityScore);
+  // E.setSymbolScopeDistance(Derived.ScopeProximityDistance);
+  // E.setSemaSaysInScope(Relevance.SemaSaysInScope);
+  // E.setScope(Relevance.Scope);
+  // E.setContextKind(Relevance.Context);
+  // E.setIsInstanceMember(Relevance.IsInstanceMember);
+  // E.setHadContextType(Relevance.HadContextType);
+  // E.setHadSymbolType(Relevance.HadSymbolType);
+  // E.setTypeMatchesPreferred(Relevance.TypeMatchesPreferred);
+  // E.setFilterLength(Relevance.FilterLength);
+  return Evaluate(E);
+}
+static void DecisionForestPredict(benchmark::State &State) {
+  for (auto _ : State)
+    RunDecisionForestPrediciton();
+}
+BENCHMARK(DecisionForestPredict);
+
+} // namespace
+} // namespace clangd
+} // namespace clang
+
+int main(int argc, char *argv[]) {
+  ::benchmark::Initialize(&argc, argv);
+  ::benchmark::RunSpecifiedBenchmarks();
+}