This isn't a real patch, it's simply a POC of what SCEV without pointer subtraction might look like. This is triggered by discussion on D104498.
This "mostly doesn't crash", but has huge perf impact. Running make check shows the impact of not being able to query the difference between two pointers.