Comes up in the [most ugliest] signed int -> signed char case of
Previously, we were stuck with not:
But now we are able to completely get rid of it:
(FIXME: why are we loosing the metadata? that seems wrong/strange.)
Not sure if we want to do it always, or only when it is free to invert?