This is an archive of the discontinued LLVM Phabricator instance.

Differential D116373

[docs] Add documentation for the plot option
Needs ReviewPublic

Authored by dmilosevic141 on Dec 29 2021, 6:41 AM.

Details

Reviewers
djtodoro
Summary

This patch adds documentation for the new plot option for the LLVM test-suite's utils/compare.py script, which was introduced in https://reviews.llvm.org/D116302.

Diff Detail

Unit TestsFailed

TimeTest
60 msx64 debian > LLVM.Bindings/Go::go.test

Event Timeline

dmilosevic141 requested review of this revision.Dec 29 2021, 6:41 AM
dmilosevic141 created this revision.
Herald added a project: Restricted Project. · View Herald TranscriptDec 29 2021, 6:41 AM
Herald added a subscriber: llvm-commits. · View Herald Transcript
dmilosevic141 added a parent revision: D116302: [utils][compare.py] Add a plotting option.Dec 29 2021, 6:42 AM
Harbormaster completed remote builds in B140893: Diff 396523.Dec 29 2021, 7:32 AM

Revision Contents

Diff 396523

llvm/docs/TestSuiteGuide.md

Show First 20 Lines • Show All 283 Lines • ▼ Show 20 Lines
- Merge multiple baseline and experiment result files by taking the minimum - Merge multiple baseline and experiment result files by taking the minimum
runtime each: runtime each:
```bash ```bash
% test-suite/utils/compare.py base0.json base1.json base2.json vs exp0.json exp1.json exp2.json % test-suite/utils/compare.py base0.json base1.json base2.json vs exp0.json exp1.json exp2.json
``` ```
- Compare two result files and plot the mean values and the most differing test results:
```bash
% test-suite/utils/compare.py results1.json results2.json -plot
```
![Plot](test-suite-guide-plot.png)
### Continuous Tracking with LNT ### Continuous Tracking with LNT
LNT is a set of client and server tools for continuously monitoring LNT is a set of client and server tools for continuously monitoring
performance. You can find more information at performance. You can find more information at
[https://llvm.org/docs/lnt](https://llvm.org/docs/lnt). The official LNT instance [https://llvm.org/docs/lnt](https://llvm.org/docs/lnt). The official LNT instance
of the LLVM project is hosted at [http://lnt.llvm.org](http://lnt.llvm.org). of the LLVM project is hosted at [http://lnt.llvm.org](http://lnt.llvm.org).
▲ Show 20 Lines • Show All 118 Lines • Show Last 20 Lines

llvm/docs/test-suite-guide-plot.png

  • This binary file was added.