Now that we track users of SCEV expressions, we should be able to always
invalidate containing expressions.
With that, I think the case where a value gets removed but
SCEVs containing references to it should not be possible any longer.
Turn check into an assert.
This slightly reduces compile-time: