This is an archive of the discontinued LLVM Phabricator instance.

[lit] don't skip test times when executions are instantaneous
AbandonedPublic

Authored by ashay-github on Jan 12 2023, 10:38 AM.

Details

Summary

If a test executes quickly or if the timing resolution is too coarse,
the running time associated with a test could be zero. This happens
often for the //llvm/utils/lit/tests/reorder.py test on Windows, which
causes the test to fail non-deterministically.

This patch modifies the existing check, so that instead of skipping
zeros, lit now skips if the timing is None (presumably due to an error
in measurement). Recurring executions of the reorder.py test on Windows
seem to indicate that the test no longer exhibits occasional failure.

Diff Detail

Event Timeline

ashay-github created this revision.Jan 12 2023, 10:38 AM
Herald added a project: Restricted Project. · View Herald TranscriptJan 12 2023, 10:38 AM
Herald added a subscriber: delcypher. · View Herald Transcript
ashay-github requested review of this revision.Jan 12 2023, 10:38 AM
Herald added a project: Restricted Project. · View Herald TranscriptJan 12 2023, 10:38 AM

Thanks for fixing this long-standing bug!

This revision is now accepted and ready to land.Jan 12 2023, 11:11 AM

Rebased with main branch.

Rebased with main branch.

ashay-github abandoned this revision.Feb 3 2023, 9:22 AM