This is an archive of the discontinued LLVM Phabricator instance.

[OpenMPOpt] ICV tracking for calls
ClosedPublic

Authored by sstefan1 on Aug 7 2020, 12:12 PM.

Details

Summary

Introduce two new AAs. AAICVTrackerFunctionReturned which checks if a
function can have a unique ICV value after it is finished, and
AAICVCallSiteReturned which checks AAICVTrackerFunctionReturned for a
call site. This enables us to check the value of a call and if it
changes the ICV. This also changes the approach in
getReplacementValues() to a worklist-based approach so we can explore
all relevant BBs.

Diff Detail

Event Timeline

sstefan1 created this revision.Aug 7 2020, 12:12 PM
Herald added a project: Restricted Project. · View Herald TranscriptAug 7 2020, 12:12 PM
sstefan1 requested review of this revision.Aug 7 2020, 12:12 PM

Note: I've added D85052 as a parent revision. However this can also be considered as a slight change in approach. If needed, those 2 can be merged together.

Things like ICVValue struct could be deleted if this approach turns out to be the one we go with. But I'd like to hear from others first.

Cool! Can you describe in the commit message in more detail what is different in this approach, how it works in general. Maybe pros and cons compared to before?

llvm/test/Transforms/OpenMP/icv_tracking.ll
281

Can we have more negative test cases too?

  1. this function with weak linkage, should be handled by the Attributor already but let's make sure we verify.
  2. two returns with different ICV values, e.g. unknown and known, or two different known ones.
  3. not a call but an invoke of a function with a call to a unknown one that may throw. I guess we can/should just not propagate over invokes now.
sstefan1 updated this revision to Diff 284046.Aug 7 2020, 2:08 PM

Better commit message.
Will add more tests tomorrow.

sstefan1 edited the summary of this revision. (Show Details)Aug 7 2020, 2:09 PM
sstefan1 updated this revision to Diff 284131.Aug 8 2020, 8:18 AM

adding more tests

We need a test with more basic blocks between the setter and getter.

llvm/lib/Transforms/IPO/OpenMPOpt.cpp
1145

The comment of getUniqueValue is not helpful. It looks like this will compute the value of ICV after the function was called, correct? Whatever it does, write it here ;)

1339

If this is only for calls, why not take a CallBase &CB instead?

1353–1355

UniqueReplVal should not be needed anywhere here.

1447

We should have a worklist of instructions we need to look at. Initially it is the argument, if we go through the prdedecessor blocks we add their terminator to the worklist. I'm not sure we need the explorer at all in that case.

sstefan1 updated this revision to Diff 284867.Aug 11 2020, 1:11 PM
  • worklist approach
  • don't use MBEC explorer
  • more tests

Unclear if we still want D85052 to go in before this, since most of the login is replaced with this patch.

Should I just merge the good parts with this patch?

jdoerfert added inline comments.Aug 11 2020, 2:35 PM
llvm/test/Transforms/OpenMP/icv_tracking.ll
369

this should not happen. The weak function should not be used in IPO. I guess we could make the AA actually work on all IRPositions. (call site) return for the value after a call, and function for the body. Then, I hope, the Attributor should not give you the Return value if you query the call site return value of a weak function.

sstefan1 updated this revision to Diff 284928.Aug 11 2020, 4:17 PM

don't track values in weak functions

Unclear if we still want D85052 to go in before this, since most of the login is replaced with this patch.

Should I just merge the good parts with this patch?

Yes I think so.

TBH, I'm thinking we should embrace the IRPositions and Attributor design fully, as it seems a bit messy right now (= we reason about returns, calls, and instructions all somewhat together).

  • AAICVTrackerFunction for the function body, given an ICV and an instruction, what is the value by backwards lookup (as you have it now). When you hit a call, ask AAICVTrackerCallSiteReturn
  • AAICVTrackerFunctionReturn which should forward queries to AAICVTrackerFunction if it is not invalid. The queries are done for all return inst.
  • AAICVTrackerCallSiteReturn which should forward queries to AAICVTrackerFunctionReturn.

WDYT?

llvm/lib/Transforms/IPO/OpenMPOpt.cpp
1142

I am unsure about the difference of these two functions from the declarations. If we need two member functions we should name them appropriately and elaborate in the description.

1145

The description is now better, we should also change the name to match it. Maybe getICVValueAfterOnReturn ?

At first, I thought it wouldn't be very useful to have AAs for multiple positions since we only interact with the function one.
Now that I actually tried to make it work, turns out it is quiet a nice clean up and makes much more sense.

I'll update shortly.

llvm/lib/Transforms/IPO/OpenMPOpt.cpp
1142

With the new AAs for CSRet and Ret positions, one of those goes away and I think it will be clearer then.

sstefan1 updated this revision to Diff 285128.Aug 12 2020, 9:56 AM

Introduce 2 new AAs
Merge good parts of D85052

jdoerfert added inline comments.Aug 15 2020, 3:00 PM
llvm/lib/Transforms/IPO/OpenMPOpt.cpp
1502–1505
1519

Never reset Changed, see also below

1526

leftover

1572–1575

Never reset Changed

jdoerfert added inline comments.Aug 15 2020, 3:21 PM
llvm/lib/Transforms/IPO/OpenMPOpt.cpp
1348–1350

Here and below, we should cache this, right?

1358–1361

leftover.

1371

why do we need the hasTrackedValue call (and function)?
Caching again. And a TODO that we should look at call sites if possible.

1449–1454

Caching.

sstefan1 updated this revision to Diff 285908.Aug 16 2020, 3:40 PM
  • Add AAICVTrackerCallSite
  • Move manifest to AAICVTrackerCallSite
  • Only register callsite AAs for getters.
llvm/lib/Transforms/IPO/OpenMPOpt.cpp
1371

Turns out hasTrackedValue is actually not needed.

As for caching, values are kind of cached inside appropriate AAICVTrackerFunctionReturned, AAICVTrackerCallSiteReturned or AAICVTrackerCallSite

sstefan1 updated this revision to Diff 285909.Aug 16 2020, 3:41 PM
  • Remove hasTrackedValue()

Looks much better now. Mostly minor comments.

llvm/lib/Transforms/IPO/OpenMPOpt.cpp
923

Nit: We can now get rid of the outer loop and the conditional as well by using the SCC version of foreachUse.

1264

Don't we need to check if we already assumed this value?

1299

What is this about?

1302

I feel this update doesn't need to look at everything but only the things we have in the cache. Right now it will look at all calls for all ICVs, which is probably not necessary.

1347

Arguably, the value for the ICV is the getter call, so I.

1540

This seems unfortunate but OK for now.

sstefan1 updated this revision to Diff 286145.Aug 17 2020, 2:14 PM

addressing comments

llvm/lib/Transforms/IPO/OpenMPOpt.cpp
1299

As per IRC discussion, added TODO to avoid this. Probably in a follow up, I'll try to introduce new state and possibly make other AAs not depend on function AA as much.

This applies to the comment bellow as well.

1347

The reason we return None here is because getters don't change the ICV.
Maybe a different name for the function would be the best solution?

This revision is now accepted and ready to land.Aug 18 2020, 6:39 PM
This revision was landed with ongoing or failed builds.Aug 19 2020, 2:44 AM
This revision was automatically updated to reflect the committed changes.
jdoerfert reopened this revision.Aug 19 2020, 10:00 PM

I'll revert this one in a second as it breaks some codes (at least on power).
The reason is that this extended the Attributor scope to the module slice. The Attributor thinks all of this is the SCC and when it tries to remove a function we see an assertion (as the function is actually not in the SCC).
The fix is to teach the Attributor about the module slice properly. Maybe in a pre-commit. For now we just revert this to unblock the build.

Here is the reproducer we should include in the OpenMP tests as well:

define internal fastcc void @"_omp$reduction$reduction_func14"() unnamed_addr {
  %call = call i8 @_ZStplIdESt7complexIT_ERKS2_S4_()
  ret void
}

define linkonce_odr hidden i8 @_ZStplIdESt7complexIT_ERKS2_S4_() local_unnamed_addr {
  ret i8 undef
}

declare void @__omp_offloading_2b_4010cad__ZN11qmcplusplus7ompBLAS17gemv_batched_implIfEEiRiciiPKT_PKS5_iS7_iS5_PKPS3_ii_l148(i64, i64, i64, float**, float**, i64, float**, float*, float*, i64) local_unnamed_addr

declare dso_local fastcc void @__kmpc_for_static_init_8u() unnamed_addr

!nvvm.annotations = !{!0}

!0 = !{void (i64, i64, i64, float**, float**, i64, float**, float*, float*, i64)* @__omp_offloading_2b_4010cad__ZN11qmcplusplus7ompBLAS17gemv_batched_implIfEEiRiciiPKT_PKS5_iS7_iS5_PKPS3_ii_l148, !"kernel", i32 1}
This revision is now accepted and ready to land.Aug 19 2020, 10:00 PM
jdoerfert requested changes to this revision.Aug 19 2020, 10:01 PM
This revision now requires changes to proceed.Aug 19 2020, 10:01 PM
This revision was not accepted when it landed; it landed in state Needs Revision.Aug 30 2020, 2:30 AM
This revision was automatically updated to reflect the committed changes.