Use lexical ordering for test-suite tests

LIT's default order is "smart", which on subsequent runs orders tests based on
their execution time (negated for failure). Unfortunately, while great for
llvm's regression suite, that ordering is not great for benchmark stability,
where we want things to be as consistent as possible from run to run.

Thanks to Ahmad Yasin for spotting this.

rdar://185192119
3 files changed
tree: c6b4d87f392198fb1ac3158ea666ef938c91bbcd
  1. .github/
  2. deployment/
  3. docker/
  4. docs/
  5. examples/
  6. lnt/
  7. schemas/
  8. tests/
  9. utils/
  10. .gitignore
  11. LICENSE.TXT
  12. MANIFEST.in
  13. pyproject.toml
  14. README.md
  15. requirements.client.txt
  16. requirements.server.txt
  17. requirements.txt
README.md

LNT: LLVM Nightly Test Infrastructure

About

LNT is an infrastructure for performance testing. The software itself consists of two main parts, a web application for accessing and visualizing performance data, and command line utilities to allow users to generate and submit test results to the server.

The package was originally written for use in testing LLVM compiler technologies, but is designed to be usable for the performance testing of any software.

Documentation

The official LNT documentation is available online at: https://llvm.org/docs/lnt

Source

The LNT source is available in the llvm-lnt repository: https://github.com/llvm/llvm-lnt

Contributing

To get started, please look at the Developer Guide in the official documentation.