Track test execution

Definition

Test execution is managed with test runs. A test run is a snapshot of your project that includes all the tests or just a subset of them. A test run creates a kind of branch of the project where current definitions of tests are stored. It means that you can continue working on your scenarios and modify them without impacting the test run and the execution. Of course your can synchronize your test run at any time with the new definitions of scenarios.

For each test of a test run, you can add one or more test results to keep track of your test execution progress.

Hiptest test runs

Create a test run

When creating a new test run, you can choose between 3 options:

  • include all the tests,
  • select the same tests as a previous test run,
  • select a subset of tests (you can filter by folders and scenarios),
  • create an empty test run that will be used to integrate external test results.

Then click Create button at the bottom of the page.

Hiptest create test run

Once your test run is created you can see the list of tests and metrics.

Hiptest test run overview

From this page, you can:

  • navigate between test runs,
  • select a test for execution,
  • synchronize all the tests with the latest definitions of scenarios,
  • add scenarios to the current test run,
  • export the data into an excel file,
  • archive the test run,
  • automate the test run,
  • reset test results,
  • delete the test run.

If the test run contains many execution cycles, you can see the history by clicking on the ‘Executions history’ tab:

Hiptest execution history

Assign a test to a user

You can assign a test to a user in the “Assignees” section. This user should be a project member.

Hiptest test assignees

Execute a test manually

When selecting a test, you can add one or more execution results. An execution result contains a description, a date, the author of the execution and the status. The author is automatically updated. You can add a description and attach files to an execution result (screenshot…).

You can also track execution step by step. The first click marks the step as passed, the second one as failed and last one as undefined.

Hiptest test execution

You can use the “Passed and next” action to mark the test as “Passed” and pass to the next one:

manual execution (passed and next)

Below the execution results, you have access to the execution results history:

Hiptest execution results history

From the test page you can as well:

  • add tags to your test
  • assign the test to one or many project members

Automated execution

To see how to automate your tests and link Hiptest to your continuous integration server see the “Automate your tests” section.

Test run metrics

At any time you can click on the test run name (left column) to view the metrics. You can also export test runs into an excel file and then customize your metrics.

Hiptest test run metrics

You can go back to your test runs list by clicking on the test run menu. From this list, you can export the content of all your test runs into a single excel file (one test run by tab), customize your metrics, and other actions on the existing test runs.

Hiptest test runs list

Add a new scenario to a test run

You can add a new scenario to a test run directly from the scenario page by selecting “Add to test run” from the menu.

Hiptest add scenario to test run

Or you can add many scenarios from the folder page. Just select your scenarios and choose “Add to test run”.

Hiptest test run add scenarios from folder

Archive test runs

Because your test runs list can grow very quickly, you can hide some of your test runs thanks to the “Archive” option.

Hiptest archive test run

 

You can find archived test runs in your test runs list by selecting the dedicated filter.

Hiptest archived test runs

 

An archived test run will not appear in the test results list of a scenario, and you will not be able to add a scenario in it or watch its metrics on the project dashboard. To unarchive a test run, select “Unarchive” from the menu.

Download the ebook

This field is required

This field is required

Please enter a valid email address

Thank you, the ebook has been sent to your mailbox

Hiptest is FREE for open source projects

We actually utilize a number of open source components, which is why Hiptest service is free for any open source project. We are giving back to the community!

Your open source project must meet the following criteria to be approved:

  • Your project is licensed under a license approved by the Open Source Initiative
  • Your project source code is available for download
  • Your project has a publicly accessible website

By continuing to use the site, you agree to the use of cookies. more information

The cookie settings on this website are set to "allow cookies" to give you the best browsing experience possible. If you continue to use this website without changing your cookie settings or you click "Accept" below then you are consenting to this.

Close