Skip to content

Releases: teemtee/tmt

Core attribute link, fix prepare freeze

25 Feb 19:33
Compare
Choose a tag to compare
  • Add test for prepare freeze
  • Make file descriptors non-blocking
  • Update the specification and stories to use link
  • Implement the new core attribute 'link'

Default branches, improved filtering, tmt status...

24 Feb 19:51
Compare
Choose a tag to compare

Highlights

  • Default git branch handling for libraries/discover
  • Implement the new tmt status command
  • Apply filters after applying defaults and conversions
  • Implement tmt run --follow option for checking log
  • Allow selecting only tests that have changed in git
  • The first chapter of the ultimate guide to tmt

Changelog

  • Show the current tmt version in the debug log
  • Revert support for the 'el' distro shortcut
  • Strip whitespace before relevancy comment
  • Ensure rsync is installed on the guest if needed
  • Use the default branch in the discover fmf plugin
  • Suport the 'el' shortcut for the distro context
  • Implement the 'tmt --version' option [fix #445]
  • Adjust test create test, fix missing dots
  • Support creating tests in the current directory
  • Rename container images, update install docs
  • Fixup Dockerfiles to build in quay.io.
  • Support building mini and full tmt container image
  • Add a Dockerfile for container with tmt
  • Fix dependency error messages
  • Use a better trigger name for source code changes
  • Add a new 'Check Report' section to examples
  • Add the --force explanation in the documentation
  • Extend the test coverage to check for active runs
  • Add basic test coverage for tmt status
  • Restore context after processing each run
  • Correctly handle an undefined step status
  • Load default plan when no root is present
  • Implement tmt status command
  • Define command-line interface for status command
  • Print library in error message during ref conflict
  • Adjust the default branch handling for libraries
  • Handle default branch in Library
  • Adjust test duration, clean up old test metadata
  • Improve timeout handling (fix an infinite loop)
  • Adjust default timeout in the testcloud provision
  • Remove obsolete unit test coverage for steps
  • Adjust the filtering support, fix docs building
  • Allow filtering using custom L1 metadata
  • Allow filtering with lowercase bool names
  • Handle exceptions when applying filters and conditions
  • Share code for filters & conditions, test coverage
  • Apply filters after applying defaults and conversions
  • Fix IPv4 parsing when booting minute machine
  • Remove all hacks for the old cruncher executor
  • Remove the whole rhts-lint line during test import
  • Remove the old convert test from unit tests
  • Adjust contact handling to work with manual tests
  • Fix contacts without name during tmt test import
  • Finalize the specification of the 'link' attribute
  • Add specification of the new core attribute 'link'
  • Enough of dreaming, let's go to the forest! :)
  • Update the overview of core classes, minor cleanup
  • Add missing required packages for pip install
  • Implement tmt run --follow option for checking log
  • Extra check for required packages when using yum
  • Clean up obsolete names in examples and templates
  • Update the test checking for relevancy conversion
  • Adjust storing test case id for new nitrate cases
  • Append nitrate id when exporting instead of rewrite
  • Skip prereserve check if custom flavor requested
  • Use special compare operators only if minor given
  • Adjust support for selecting modified tests
  • Allow selecting only tests that have changed in git
  • Remove the duplicate build job from packit config
  • Verify the old beakerlib functions using Makefile
  • Enable debug output using the TMT_DEBUG variable

Context adjust, html report, import improvements...

09 Dec 17:36
Compare
Choose a tag to compare
  • Minor adjustment of the beakerlib test template
  • Adjust the new test checking the error output
  • Print errors to stderr
  • Fix check for selecting plans during tmt run
  • Update test coverage, fix finish step example
  • Update spec/stories implementation coverage
  • Skip import of manual cases with script
  • Import header and footer from Nitrate
  • Implement conversion between relevancy and adjust
  • Support short options for selecting tests & plans
  • Document the display and html report in the spec
  • Explain the difference between fmf and tmt
  • Fix the last missing framework in library tests
  • Adjust the docs update and title implementation
  • Implement a new story attribute 'title' (L3)
  • Small documentation cleanup
  • Simplify plan setup, move old plans to examples
  • Store the whole debug log in the top run directory
  • Add test for pip installability
  • Add a new plan to cover minimal installation
  • Move html report plugin into a separate subpackage
  • Use 'output.txt' filename for the main test output
  • Update required fmf version in setup.py
  • Improve the css style for the html report
  • Fix blocking read in Common.run
  • Adjust a bit the improved html report
  • Improve report-html --open
  • Implement adjusting metadata based on the context
  • Adjust the new 'html' report method
  • New report --how html available
  • Adjust environment import from Makefile metadata
  • Import environment from Makefile metadata
  • Update old beakerlib paths during tmt test import
  • Adjust a little bit the user story templates
  • Support libraries stored deep in the repositories
  • Enable the new coverage stories section in docs
  • First stories to cover tests coverage mapping
  • Recommend using login shell in libvirt hints
  • Use nitrate naming for the manual field export
  • Export manual attribute to nitrate
  • Store complete initialized data in metadata.yaml
  • Merge the improved minute error messages [#425]
  • Adjust a bit the minute provision error messages
  • Handle testcloud problem with the images directory
  • Handle tracebacks in minute provision
  • Multiple enhancements for package preparation
  • Gracefully handle invalid library reference

Warnings, symlinks, metadata, login...

22 Oct 18:05
Compare
Choose a tag to compare
  • Convert adds extra-summary as well
  • Simplify test directory copy with enabled symlinks
  • Select latest minute image only from released images
  • Allow specifying exact RHEL version using a short name
  • Preserve symlinks during discover, pull and push
  • Always run Login plugin even if step is done
  • Suggest some useful aliases for common use cases
  • Correct type of Tier attribute in examples
  • Define basic hardware environment specification
  • Import manual data for automated tests
  • Tag tests which can be run under container/virtual
  • Give hints to install provision plugins [fix #405]
  • Handle nicely missing library metadata [fix #397]
  • Update the test data directory name in the spec
  • Extend duration for tests using virtualization
  • Use a better name for the test data path method
  • Provide aggregated test metadata for execution
  • Send warnings to stderr, introduce a fail() method

Internal executor, test framework, default path, test import enhancements...

07 Oct 14:16
Compare
Choose a tag to compare
  • Correctly handle framework for new plans and tests
  • Move runtest.sh adjustments into a single function
  • Add the executable permission to runtest.sh
  • Less strict removing sourcing of rhts-environment
  • Use metadata directory as the default for path
  • Implement the new L1 attribute 'framework'
  • Explicitly enable copr_build for pull requests
  • Handle missing library in existing repository
  • Update the overall tmt description and examples
  • Enable builds from master in the main copr repo
  • Merge packit config for copr builds from master
  • Use packit repository for copr builds from master
  • Gracefully handle invalid test output
  • Build in COPR for master via packit
  • Add hint about caching the dnf package metadata
  • Add two hints about easy login for experimenting
  • Merge debug messages for the minute plugin [#361]
  • Adjust the minute provision debug messages wording
  • Use the internal tmt executor by default
  • Add more debug messages to minute provision
  • Remove the remaining 'tmt test convert' references
  • Prevent shebang mangling for detached executor
  • Merge the minute and install plugin docs [#345]
  • Adjust the minute and install plugin documentation
  • Merge the manual test import documentation [#347]
  • Adjust the manual test documentation wording
  • Merge rhts-environment source line removal [#344]
  • Adjust rhts-environment source line removal
  • Add missing extra-* keys to the test import
  • Add docs for manual case import
  • Disable authentication when fetching libraries
  • Document the install prepare method
  • Document the minute provision method
  • Remove sourcing of rhts-environment in runtest.sh
  • Add minute to supported provision methods of prepare

Test duration, recommend libraries, retry session, manual test import...

08 Sep 08:16
Compare
Choose a tag to compare
  • Adjust manual test case import from nitrate [#319]
  • Move the test convert deps into a separate package
  • Support importing manual test cases from Nitrate
  • Merge the non-zero exit codes for linting errors
  • Fix several test export issues [fix #337]
  • Adjust distro checks, remove the dry parameter
  • Generalized Guest.details() [fix #310]
  • Adjust the test coverage for tmt plan/test lint
  • Update documentation with virtualization tips
  • Make sure the duration timer is always canceled
  • Merge the new retry_session functionality [#328]
  • Exit with non-zero code if linting fails
  • Merge fix for the double fmf extension [#327]
  • Prevent koji from trying to build packages on i686
  • Retry requests in case of network failure
  • Avoid double fmf extension when creating plans and stories
  • Improve the maximum test duration handling
  • Remove vagrant from tmt-all recommended packages
  • Detect beakerlib libraries from recommend as well
  • Simplify packit custom create archive command
  • Make the httpd test example a bit more interesting
  • Append dots to fix tmt run --help message summary
  • Document multiple configs and extending steps

Libraries improvements, Guest cleanup, variables from files...

28 Jul 15:39
Compare
Choose a tag to compare
  • Move libraries handling into a separate module
  • Adjust loading variables from YAML files [#316]
  • Support environment variables from YAML files
  • Give a nice error for expired kerberos [fix #57]
  • Merge Guest relocation and documentation [#307]
  • Describe essential Guest methods in more detail
  • Update test import story and documentation
  • Merge extra-task as summary in test export [#304]
  • Move default plan handling into a single method
  • Move the Guest class from base to steps.provision
  • Save root in run.yaml
  • Document L1 metadata defined in the discover step
  • Improve Makefile editing during test import
  • Use extra-task as summary in test export
  • Mention default methods in the step help message
  • Handle invalid url when library provided as fmf id
  • Allow library git clone to fail

Support beakerlib libraries, testcloud retry, secure discover...

12 Jun 08:37
Compare
Choose a tag to compare
  • Make the discover step a little bit more secure
  • Improve basic and verbose output of tmt plan show
  • Improve default plan handling and more [fix #287]
  • Adjust the compose check retry in testcloud
  • Retry Fedora compose check in testcloud [fix #275]
  • Update development section and library example
  • Support fetching beakerlib libraries in discover
  • Add nitrate to the setup.py extra requires
  • Add a workflow-tomorrow integration test example
  • Add 'duration' into the test results specification

Guest login, interactive execute, recommend...

01 Jun 20:30
Compare
Choose a tag to compare
  • Add virtual plans for supported provision methods
  • Implement description in 'tmt plan show' as well
  • Implement tmt run --remove to remove workdir
  • Extend the login/step test to cover failed command
  • Do not fail upon command fail in interactive mode
  • Implement the internal tmt execute step method
  • Move all prepare/install tests to tier level 3
  • Merge the new manual test specification [#247]
  • Merge the new L1 attribute 'recommend' [#265]
  • Adjust the manual test specification and examples
  • Implement 'recommend' for installing soft requires
  • State explicitly that execution is finished
  • Simplify beakerlib template, add test for init
  • Manual test case specification and examples
  • Implement exit codes, handle no tests [fix #246]
  • Merge the interactive shell login command [#258]
  • Adjust support for shortened 1MT image names
  • New login command to provide a shell on guest
  • Add support for shortened 1MT image names
  • Add support for running tests without defined plan
  • Ignore save() in the execute step unit test
  • Update the default run example with fresh output
  • Show kernel version only in verbose mode

Consistent package naming, dependencies and rhel/centos fixes

23 May 10:15
Compare
Choose a tag to compare
  • Use emulator_path instead of hard-coded qemu path
  • Improve a bit the --force option description
  • Use consistent naming for provision subpackages
  • Add 'mock' to extra requires (needed to make docs)
  • Move podman and testcloud plugins into subpackages
  • Enable epel for packit build & testing farm
  • Move vagrant from requires to recommends (tmt-all)