eth-cscs/reframe: ReFrame 3.11.0

Release Notes

Changes since v3.10.0

• Add new command line option to distribute single node jobs on multiple cluster nodes (#2458)
• Add new build system backend for custom builds (#2494)
• Extend the syntax of valid_systems and valid_prog_environs (#2479)
• Introduce environment variables for controlling system auto-detection (#2444)
• Support early access to fixtures (#2484)
• Add configuredir variable to the Autotools build system (#2460)
• Add display name to the failure statistics (#2472)
• Extend the public API of Job (#2463)
• Add support for Python 3.10 (#2443)
• Support for loggable variables, parameters and properties of tests (#2428)
• Remove runtime timings from the default output (#2425)
• Add convenience function to set a test variable only if it's undefined (#2403)

• Fix test filtering by name when multiple exact matches are requested (#2485)
• Treat empty source code context when reporting errors (#2482)
• Fix regression with tests that treat stdin as a tty (#2476)
• Make rerun prompt consistent with the new naming scheme (#2471)
• Fix and enhance LSF support (#2383)
• Properly select configuration when running tests (#2438)
• Enforce override of hooks with the same name (#2436)
• Do not set up Spack shell support (#2424)
• Fix job cancellation when job is pending due to ReqNodeNotAvail (#2417)
• Fix --show-config for null config options (#2414)
• Automatically convert numeric configuration parameters when set from the command line or the environment (#2392)
• Fix find_modules to return unique module names (#2401)
• Print skip test messages for new asynchronous execution policy (#2400)

• Add OSU benchmarks in the test library and adapt CSCS checks accordingly (#2421)
• Time the warmup phase and print minimum required duration in the GPU burn test (#2345)
• Make bench_name loggable in Gromacs library test (#2462)
• Add support for build both GPU dgemm+sgemm executables (#2372)

• Use pytest-rerunfailures to and mark flaky unit tests (#2493)
• Update checkout and setup-python versions for GH actions (#2457)
• Minor deployment improvements (#2447)
• Improve documentation about setting performance references in tests (#2492)
• Modernize test syntax in the test dependencies docs (#2459)
• Update versionadded annotations (#2448)
• Add a small note in the Spack backend tutorial on specifying a spec targets (#2422)
• Use compile as the name of the build pipeline stage (#2418)
• Enhance documentation of environment variables set in the system configuration (#2419)