From ccf5371f7c8bd35b2b6c2380d5cc6960bc876f63 Mon Sep 17 00:00:00 2001 From: Alex Guteniev Date: Thu, 25 Apr 2024 09:00:52 +0300 Subject: [PATCH 1/6] Mention `--filter` for testing --- README.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/README.md b/README.md index 2fbe3b19efa..3fd34fb2ba5 100644 --- a/README.md +++ b/README.md @@ -265,6 +265,8 @@ will run the single test found under VSO_0000000_any_calling_conventions. * You can invoke `stl-lit` with any arbitrary subdirectory of a test suite. In libcxx this allows you to have finer control over what category of tests you would like to run. The following will run all the libcxx map tests. + `python tests\utils\stl-lit\stl-lit.py ..\..\llvm-project\libcxx\test\std\containers\associative\map` +* You can also use `--filter` option to include tests using a regular expression + + `python tests\utils\stl-lit\stl-lit.py ..\..\llvm-project\libcxx\test ..\..\tests\std ..\..\tests\tr1 --filter=.*lexicographical_compare.*` could be useful if you made some changes to `lexicograhpical_compare` ## Interpreting The Results Of Tests From d0b1e5bdbc6da81c466c23e7139ddfe8cc58679b Mon Sep 17 00:00:00 2001 From: Alex Guteniev Date: Thu, 25 Apr 2024 09:14:47 +0300 Subject: [PATCH 2/6] other example to fit 120 chars --- README.md | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions(-) diff --git a/README.md b/README.md index 3fd34fb2ba5..42f15c34208 100644 --- a/README.md +++ b/README.md @@ -265,8 +265,9 @@ will run the single test found under VSO_0000000_any_calling_conventions. * You can invoke `stl-lit` with any arbitrary subdirectory of a test suite. In libcxx this allows you to have finer control over what category of tests you would like to run. The following will run all the libcxx map tests. + `python tests\utils\stl-lit\stl-lit.py ..\..\llvm-project\libcxx\test\std\containers\associative\map` -* You can also use `--filter` option to include tests using a regular expression - + `python tests\utils\stl-lit\stl-lit.py ..\..\llvm-project\libcxx\test ..\..\tests\std ..\..\tests\tr1 --filter=.*lexicographical_compare.*` could be useful if you made some changes to `lexicograhpical_compare` +* You can also use `--filter` option to include tests using a regular expression. The following command will run +tests containing "atomic_wait" in name in both std and llvm test suites. + + `python tests\utils\stl-lit\stl-lit.py ..\..\llvm-project\libcxx\test ..\..\tests\std --filter=.*atomic_wait.*` ## Interpreting The Results Of Tests From 06582199bff8bc887846ceca2ebe636c64384db0 Mon Sep 17 00:00:00 2001 From: Alex Guteniev Date: Thu, 25 Apr 2024 10:16:10 +0300 Subject: [PATCH 3/6] mention `--filter-out` as well --- README.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/README.md b/README.md index 42f15c34208..23171a4d649 100644 --- a/README.md +++ b/README.md @@ -268,6 +268,8 @@ control over what category of tests you would like to run. The following will ru * You can also use `--filter` option to include tests using a regular expression. The following command will run tests containing "atomic_wait" in name in both std and llvm test suites. + `python tests\utils\stl-lit\stl-lit.py ..\..\llvm-project\libcxx\test ..\..\tests\std --filter=.*atomic_wait.*` + + there's also filter out, `--filter=.*iota.* --filter-out=.*view.*` would run tests containing "iota" in its name +and not containing "view" ## Interpreting The Results Of Tests From c81959fde9fc02105c83cb5ad9aa46f1464f12d5 Mon Sep 17 00:00:00 2001 From: Alex Guteniev Date: Thu, 25 Apr 2024 16:23:50 +0300 Subject: [PATCH 4/6] No `.*` needed --- README.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/README.md b/README.md index 23171a4d649..19224725ee1 100644 --- a/README.md +++ b/README.md @@ -267,8 +267,8 @@ control over what category of tests you would like to run. The following will ru + `python tests\utils\stl-lit\stl-lit.py ..\..\llvm-project\libcxx\test\std\containers\associative\map` * You can also use `--filter` option to include tests using a regular expression. The following command will run tests containing "atomic_wait" in name in both std and llvm test suites. - + `python tests\utils\stl-lit\stl-lit.py ..\..\llvm-project\libcxx\test ..\..\tests\std --filter=.*atomic_wait.*` - + there's also filter out, `--filter=.*iota.* --filter-out=.*view.*` would run tests containing "iota" in its name + + `python tests\utils\stl-lit\stl-lit.py ..\..\llvm-project\libcxx\test ..\..\tests\std --filter=atomic_wait` + + there's also filter out, `--filter=iota --filter-out=view` would run tests containing "iota" in its name and not containing "view" ## Interpreting The Results Of Tests From a8819235d128eb24dcd4ee0e7dbdefaf4a0d5233 Mon Sep 17 00:00:00 2001 From: Casey Carter Date: Thu, 25 Apr 2024 08:25:10 -0700 Subject: [PATCH 5/6] Bit of cleanup --- README.md | 11 +++++++---- 1 file changed, 7 insertions(+), 4 deletions(-) diff --git a/README.md b/README.md index 19224725ee1..0be2e15a5eb 100644 --- a/README.md +++ b/README.md @@ -265,11 +265,14 @@ will run the single test found under VSO_0000000_any_calling_conventions. * You can invoke `stl-lit` with any arbitrary subdirectory of a test suite. In libcxx this allows you to have finer control over what category of tests you would like to run. The following will run all the libcxx map tests. + `python tests\utils\stl-lit\stl-lit.py ..\..\llvm-project\libcxx\test\std\containers\associative\map` -* You can also use `--filter` option to include tests using a regular expression. The following command will run -tests containing "atomic_wait" in name in both std and llvm test suites. + +* You can also use the `--filter` option to include tests whose names match a regular expression. The following + command will run tests with "atomic_wait" in their names in both the std and libcxx test suites. + + `python tests\utils\stl-lit\stl-lit.py ..\..\llvm-project\libcxx\test ..\..\tests\std --filter=atomic_wait` - + there's also filter out, `--filter=iota --filter-out=view` would run tests containing "iota" in its name -and not containing "view" + + There's also a `--filter-out` option to exclude tests matching a regular expression; + `--filter=iota --filter-out=view` would run tests with names matching "iota" but not "view". ## Interpreting The Results Of Tests From aad305b98c80c2d280ef052865318494ae22b194 Mon Sep 17 00:00:00 2001 From: "Stephan T. Lavavej" Date: Thu, 25 Apr 2024 09:19:51 -0700 Subject: [PATCH 6/6] Re-compact the list, and re-bullet `--filter-out`. --- README.md | 5 +---- 1 file changed, 1 insertion(+), 4 deletions(-) diff --git a/README.md b/README.md index 0be2e15a5eb..0ac63dce717 100644 --- a/README.md +++ b/README.md @@ -265,13 +265,10 @@ will run the single test found under VSO_0000000_any_calling_conventions. * You can invoke `stl-lit` with any arbitrary subdirectory of a test suite. In libcxx this allows you to have finer control over what category of tests you would like to run. The following will run all the libcxx map tests. + `python tests\utils\stl-lit\stl-lit.py ..\..\llvm-project\libcxx\test\std\containers\associative\map` - * You can also use the `--filter` option to include tests whose names match a regular expression. The following command will run tests with "atomic_wait" in their names in both the std and libcxx test suites. - + `python tests\utils\stl-lit\stl-lit.py ..\..\llvm-project\libcxx\test ..\..\tests\std --filter=atomic_wait` - - There's also a `--filter-out` option to exclude tests matching a regular expression; +* There's also a `--filter-out` option to exclude tests matching a regular expression; `--filter=iota --filter-out=view` would run tests with names matching "iota" but not "view". ## Interpreting The Results Of Tests