summaryrefslogtreecommitdiff
path: root/utils/lit/lit
Commit message (Collapse)AuthorAge
* Lit: LIT_PRESERVES_TMP should be aware of TMPDIR, too.NAKAMURA Takumi2013-10-17
| | | | | | TMPDIR is preferred in Unix. git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@192891 91177308-0d34-0410-b5e6-96231b3b80d8
* Lit: Introduce an environment variable, $LIT_PRESERVES_TMP, to preserve TMP ↵NAKAMURA Takumi2013-10-17
| | | | | | | | (and TEMP). This is intended to check how many temporary files would be generated in automated builders. git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@192887 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Add an --output option, for writing results in a machine readable form.Daniel Dunbar2013-09-14
| | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@190738 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Add support for attach arbitrary metrics to test results.Daniel Dunbar2013-09-11
| | | | | | | | | - This is a work-in-progress and all details are subject to change, but I am trying to build up support for allowing lit to be used as a driver for performance tests (or other tests which might want to record information beyond simple PASS/FAIL). git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@190535 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Allow config files to pass arbitrary values to child configs.Daniel Dunbar2013-09-03
| | | | | | | - This aligns with how existing test suites end up wanting to use the local config files, conceptually it makes sense to consider them to be inherited. git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@189885 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Fix internal shell's argv[0] handling.Daniel Dunbar2013-08-29
| | | | | | | - At least on OS X, it is important for correct behavior of /bin/[ that argv[0] is passed as written, and not as the full executable path. git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@189559 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Add support for multiprocessing, under --use-processes for now.Daniel Dunbar2013-08-29
| | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@189556 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Implement --max-time support by using provider cancel method.Daniel Dunbar2013-08-29
| | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@189555 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Refactor test execution logic into lit.run.Run.Daniel Dunbar2013-08-29
| | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@189554 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Put display lock inside the ThreadResultsConsumer.Daniel Dunbar2013-08-29
| | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@189553 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Factor out a results consumer interface for test execution.Daniel Dunbar2013-08-29
| | | | | | - Also, change TestProvider interface to operate on test indices. git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@189552 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Move top-level execute code into Run object.Daniel Dunbar2013-08-29
| | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@189551 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Factor out Run class to capture configuration + discovered tests.Daniel Dunbar2013-08-29
| | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@189550 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Change lit.Test.ResultCode to be unique across pickling.Daniel Dunbar2013-08-29
| | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@189549 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Update shtest format to return lit.Test.Result objects.Daniel Dunbar2013-08-29
| | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@189545 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Update LitTestCase to support lit.Test.Result.Daniel Dunbar2013-08-29
| | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@189544 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Fix a couple lingering Py3 compat issues in ProgressBar.Daniel Dunbar2013-08-21
| | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@188951 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Lift XFAIL handling to core infrastructure.Daniel Dunbar2013-08-21
| | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@188949 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Allow formats to return lit.Test.Result instances directly.Daniel Dunbar2013-08-21
| | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@188948 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Factor out a separate Test.Result() object.Daniel Dunbar2013-08-21
| | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@188947 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Simplify --time-tests code.Daniel Dunbar2013-08-21
| | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@188946 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Extract TestFormat base class, for future use.Daniel Dunbar2013-08-21
| | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@188945 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Ensure test output is converted to strings where possible.Daniel Dunbar2013-08-14
| | | | | | - This cleans up the text output of failing tests when run under PY3. git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@188416 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Support parsing scripts with inconsistent or invalid encodings.Daniel Dunbar2013-08-14
| | | | | | | | | | | | - For whatever reason, we have a lot of test files with bogus unicode characters. This patch allows those scripts to still be parsed on Python3 by changing the parsing logic to work on binary files, and only require the actual script commands to be convertible to ascii. - This patch has been tweaked to now ensure that the command strings are not of unicode type on Python 2.6-7. git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@188398 91177308-0d34-0410-b5e6-96231b3b80d8
* Revert r188376, "[lit] Support parsing scripts with inconsistent or invalid ↵Daniel Dunbar2013-08-14
| | | | | | encodings.", this doesn't work yet for bots using the internal shell. git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@188379 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Support parsing scripts with inconsistent or invalid encodings.Daniel Dunbar2013-08-14
| | | | | | | | | - For whatever reason, we have a lot of test files with bogus unicode characters. This patch allows those scripts to still be parsed on Python3 by changing the parsing logic to work on binary files, and only require the actual script commands to be convertible to ascii. git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@188376 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Fix a relative import issue I missed earlier.Daniel Dunbar2013-08-14
| | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@188360 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Avoid StringIO.Daniel Dunbar2013-08-14
| | | | | | | - We barely used it, and it is very hard to use in a 2.5-3 compatible way because of changing expectations for its input types. git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@188359 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Factor ShTest format script command parsing from other processing.Daniel Dunbar2013-08-14
| | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@188357 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Move executeCommand() into lit.util.Daniel Dunbar2013-08-14
| | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@188356 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Move formats into their own subpackage.Daniel Dunbar2013-08-14
| | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@188355 91177308-0d34-0410-b5e6-96231b3b80d8
* Lit: Introduce "%/[STpst] into parseIntegratedTestScript(), to normalize ↵NAKAMURA Takumi2013-08-14
| | | | | | substitutions. git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@188348 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Remove old ExamplesTests directory.Daniel Dunbar2013-08-09
| | | | | | | - The actual tests have better coverage than those, and they weren't useful anymore. git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@188110 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Move ManyTests examples to lit/examples/many-tests.Daniel Dunbar2013-08-09
| | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@188109 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Drop deprecated aliases for lit and old module names.Daniel Dunbar2013-08-09
| | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@188108 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Fix typo.Daniel Dunbar2013-08-09
| | | | | | - Noticed by edward-san (IRC). git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@188096 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Rename lit.{TestFormats,Util} to their aliased names {formats,util}.Daniel Dunbar2013-08-09
| | | | | | | - With compatibility hack in lit.__init__, so this hopefully shouldn't break anything. git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@188040 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Inject the lit specific config object as 'lit_config' when loading ↵Daniel Dunbar2013-08-09
| | | | | | | | | | config files. - Injecting it as 'lit' is gross, since that name should be used to refer to the actual package. For now both are available so it is possibly to cleanup test config files incrementally. git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@188039 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Split TestingConfig.frompath() into separate ctor and load methods.Daniel Dunbar2013-08-09
| | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@188038 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Eliminate mustExist parameter from TestingConfig.frompath().Daniel Dunbar2013-08-09
| | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@188034 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Only create config copies when a local config file is present.Daniel Dunbar2013-08-09
| | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@188033 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Eliminate parent argument from TestingConfig.frompath(), which is ↵Daniel Dunbar2013-08-09
| | | | | | effectively unused. git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@188032 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Change --show-{tests,suites} to exit after printing.Daniel Dunbar2013-08-08
| | | | | | - This is a more sensible behavior than printing and also running tests. git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@188009 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Remove --repeat option, which wasn't that useful.Daniel Dunbar2013-08-08
| | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@188008 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Eliminate some nested imports.Daniel Dunbar2013-08-08
| | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@188007 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Remove on_clone member, which is no longer used.Daniel Dunbar2013-08-08
| | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@188006 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Remove unnecessary list copy.Daniel Dunbar2013-08-07
| | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@187934 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Always list individual UNRESOLVED tests.Daniel Dunbar2013-08-07
| | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@187933 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Explicitly convert dict items() result to a list.Daniel Dunbar2013-08-07
| | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@187932 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Make string encoding issues explicit.Daniel Dunbar2013-08-07
| | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@187931 91177308-0d34-0410-b5e6-96231b3b80d8