[OMPT] Add interoperability testcase

[sconvent]

Summary

Test whether OMPT-callbacks for two threads that initiate a parallel region are correct.

[protze.joachim]

runtime/test/ompt/misc/interoperability.cpp

1

I think, this is not needed for this case. Just run the sorted checks.

• Remove the first line
• Replace THREADS by CHECK

[sconvent]

Implemented suggestions

[hbae]

LGTM.

[omalyshe]

runtime/test/ompt/misc/interoperability.cpp

40

These three checks relates to the second master thread, so to make it clear I'd suggest naming it MASTER_ID_2.

47

Two checks above should has different thread ids, that is THREAD_ID_1, THREAD_ID_2 (something like that).

I also suggest adding CHECK for *_end events for all *_begin events above.

[Hahnfeld]

I think if you re-capture a variable with FileCheck that's the same as capturing another variable except that you can't use the old value. So I'm not sure if the changes make any difference, besides naming...

[omalyshe]

In D41942#1001675, @Hahnfeld wrote:

I think if you re-capture a variable with FileCheck that's the same as capturing another variable except that you can't use the old value. So I'm not sure if the changes make any difference, besides naming...

Yes, I understand that. But it is difficult to understand what the test is actually checking due to no comments and same identifiers usage.

[sconvent]

Implemented suggestions

[omalyshe]

Implemented changes look good.

However, it's probably worth to apply re-formatting suggested by @Hahnfeld in https://reviews.llvm.org/D43191.

[sconvent]

Add some comments to checks and reformat as suggested

[omalyshe]

LGTM.

[Hahnfeld]

In D41942#1008570, @sconvent wrote:

Add some comments to checks and reformat as suggested

Could you please reformat the full file with clang-format? The indention doesn't look right...

[protze.joachim]

I applied clang-format on commit.

Having the tests after the end of the main function gives us actually 2 more characters :)

[Hahnfeld]

This test doesn't work if threads are not scheduled as expected: http://lab.llvm.org:8011/builders/openmp-gcc-x86_64-linux-debian/builds/58
I think in that case a worker thread started before the second master which makes sense as there is no synchronization between the two initial threads. We should be able to fix this by either starting a serialized region or calling an API function and putting an OMPT_WAIT before the real parallel region. Thoughts?

Btw: What do you need the OMPT_WAIT(condition, 6) for?

[protze.joachim]

The idea was that the WAIT in line 11 should ensure that both initial threads arrived.
But actually the runtime is not initialized before line 11. To fix the race, we need to call into the runtime in a way, that makes both threads initial threads before the SIGNAL in line 9.

The WAIT in line 16 is to ensure that both worker threads are recruited separately. Not sure whether it would be possible that the same thread is recruited by both initial threads.

runtime/test/ompt/misc/interoperability.cpp

+// RUN: %libomp-cxx-compile-and-run | FileCheck %s
+// RUN: %libomp-cxx-compile-and-run | %sort-threads | FileCheck --check-prefix=THREADS %s
+// REQUIRES: ompt
+
+#include <iostream>
+#include <thread>
+#include "callback.h"
+int condition=0;
+void f() {
+    OMPT_SIGNAL(condition);
+    // wait for both pthreads to arrive
+    OMPT_WAIT(condition,2);
+    int i=0;
+    #pragma omp parallel num_threads(2)
+    {
+    OMPT_SIGNAL(condition);
+    OMPT_WAIT(condition,6);
+    }
+}
+int main() {
+    std::thread t1(f);
+    std::thread t2(f);
+    t1.join();
+    t2.join();
+}
+
+  // Check if libomp supports the callbacks for this test.
+  // CHECK-NOT: {{^}}0: Could not register callback 'ompt_callback_task_create'
+  // CHECK-NOT: {{^}}0: Could not register callback 'ompt_callback_task_schedule'
+  // CHECK-NOT: {{^}}0: Could not register callback 'ompt_callback_parallel_begin'
+  // CHECK-NOT: {{^}}0: Could not register callback 'ompt_callback_parallel_end'
+  // CHECK-NOT: {{^}}0: Could not register callback 'ompt_callback_implicit_task'
+  // CHECK-NOT: {{^}}0: Could not register callback 'ompt_callback_thread_begin'
+
+  // THREADS: 0: NULL_POINTER=[[NULL:.*$]]
+  // THREADS: {{^}}[[MASTER_ID:[0-9]+]]: ompt_event_thread_begin: thread_type=ompt_thread_initial=1, thread_id=[[MASTER_ID]]
+  // THREADS: {{^}}[[MASTER_ID]]: ompt_event_task_create: parent_task_id=0, parent_task_frame.exit=[[NULL]], parent_task_frame.reenter=[[NULL]], new_task_id=[[PARENT_TASK_ID:[0-9]+]], codeptr_ra=[[NULL]], task_type=ompt_task_initial=1, has_dependences=no
+  // THREADS: {{^}}[[MASTER_ID]]: ompt_event_parallel_begin: parent_task_id=[[PARENT_TASK_ID]], parent_task_frame.exit=[[NULL]], parent_task_frame.reenter={{0x[0-f]+}}, parallel_id=[[PARALLEL_ID:[0-9]+]], requested_team_size=2, codeptr_ra=0x{{[0-f]+}}, invoker={{.*}}
+
+  // THREADS: {{^}}[[THREAD_ID:[0-9]+]]: ompt_event_thread_begin: thread_type=ompt_thread_initial=1, thread_id=[[THREAD_ID]]
+  // THREADS: {{^}}[[THREAD_ID]]: ompt_event_task_create: parent_task_id=0, parent_task_frame.exit=[[NULL]], parent_task_frame.reenter=[[NULL]], new_task_id=[[OTHER_PARENT_TASK_ID:[0-9]+]], codeptr_ra=[[NULL]], task_type=ompt_task_initial=1, has_dependences=no
+  // THREADS: {{^}}[[THREAD_ID]]: ompt_event_parallel_begin: parent_task_id=[[OTHER_PARENT_TASK_ID]], parent_task_frame.exit=[[NULL]], parent_task_frame.reenter={{0x[0-f]+}}, parallel_id=[[OTHER_PARALLEL_ID:[0-9]+]], requested_team_size=2, codeptr_ra=0x{{[0-f]+}}, invoker={{.*}}
+
+  // THREADS: {{^}}[[THREAD_ID:[0-9]+]]: ompt_event_thread_begin: thread_type=ompt_thread_worker=2, thread_id=[[THREAD_ID]]
+
+  // THREADS: {{^}}[[THREAD_ID:[0-9]+]]: ompt_event_thread_begin: thread_type=ompt_thread_worker=2, thread_id=[[THREAD_ID]]
+