CI in 5 minutes flat

In this tutorial, we’ll see how to use the sample project called “Coffee machine – Hiptest publisher samples”.

To follow this tutorial, you’ll need a few pre-requisites:

  • a Hiptest account
  • a GitHub account
  • a Travis CI account
  • a computer setup to execute tests (you will be able to chose your preferred language later on)
  • a text editor (and preferably a code editor)
  • git installed on your machine
  • hiptest-publisher installed on your machine

A quick word on the system under test

For this tutorial, we’ll be testing an automated expresso machine. Sadly, there is no real coffee provided by it, just plain code.

Originally, this project was meant to test the exports done by hiptest-publisher in any language supported. Later on, we decided to open the project to every users so they could also easily try the exports.

When you have a look at the project in Hiptest, you will see it is following the Behavior Driven Developments standards(each feature is represented as a folder, we use the Gherkin syntax and declarative scenarios). This is not a pre-requisite for automation, just a preference of the development team.

Step one – Getting the project

Login to Hiptest and go to the projects list. On the left side, you will see a section named “Generate new project sample”, select “Coffee machine” then click on generate.

A few seconds later, you will see a new project in your list called “Coffee machine – Hiptest publisher sample“.

Open the Github repository “Hiptest publisher samples”. There, you will have link to multiple repositories named “hps-<language>-<framework>”. Pick the language and test framework  you want to try out and click on the link to the repository.
For example, if you want to try Python and UnitTest, click on the “hps-python-unittest” link:

In the repository you selected, click on the “Fork” button located  in the top-right corner:

You should now own a copy of the repository, named “<your Github username>/hps-<language>-<framework>”.

Open a terminal on your machine and clone the newly created repository.

Note: if you just installed Git for this tutorial, there are chances you will not be able to clone using SSH. You can try this command:


git clone https://github.com/<your GitHub username>/hps-<language>-<framework>.git

Step two – Configuring the code to use your Hiptest project

Currently, the code you have forked does not point to the sample project you generated earlier (in fact, nothing in its settings points to a specific Hiptest project), so we will have do fix that so the code on your machine points to the Coffee machine you generated in the first step.

Inside the Hiptest project, go to the “Settings” panel. At the bottom of the page, you will see a section named “Publication settings” containing a secret token, copy this token:

Now open the hiptest-publisher configuration file on your machine. This file should be called “<language name>-<framework name>.conf” (or sometimes simply <framework name>.conf).
Add the line “token = <your secret token>” in this configuration file and save it:

Now, we will use hiptest-publisher to regenerate the actionwords.yaml file. This file is used to match the current status of the action words inside your Hiptest project.
To update it, run the following command:

hiptest-publisher -c <path to the config file> --actionwords-signature

The output should look something like that:

Before committing the changes we just did, let’s check that our tests are still working. First, we will update the test files by running one of those command (you can also check the README.md file, the exact command line should be provided in the “Update tests” section):

hiptest-publisher -c  <path to the config file> --without=actionwords

This will give you this kind of output (once again depending on the framework you chose, the filenames will differ):

Potentially, we will see some minor differences in the generated test files by running “git diff” (for example new tags being added) but no changes in the core idea of the tests themselves.

Step three – Running the tests locally

In the README.md file of your repository, you will find a section called “Run tests” that will provide you with the list of commands needed to be executed in order to run the tests. For example, here’s what need to be done when using Python/UnitTest:

python bootstrap.py
bin/buildout
bin/test --with-xunit

Note that, in most cases, the first commands are just there for setup (fetching libraries etc.) and you do not need to run them every time.
Once you run the commands, you should get an output similar to this:

Now that your tests are working fine, commit all your changes but do not push them yet to Github, as we first have to setup the CI.

Step four – Setting up the CI

Go to Travis-CI and sign-in using your GitHub account. Open your profile and look for the repository you forked earlier (if it is not present, click on the “Sync account” button) and enable it for the CI:

After enabling the repository and clicking on its name, you should access a page telling “No builds for this repository”.

Go back to your Hiptest project and click on the “Test run” section. You already have a test run called CI there, open it and copy its ID:

Now open the file called .travis.yml. This file is the config file for the CI and is currently pointing to another test run than yours.
You should see two commands lines starting with “hiptest-publisher”. In those lines, replace the test run id with the one of your test run and remove the “–token=$SECRET_TOKEN” part.

Running the command “git diff” should output something close to that:

Commit those changes too and push all the commits to Github. Now open again the Travis CI page for your repository and wait for all the tests to run:

A few seconds later, the test run pie-chart in Hiptest should also turn all green as the results for each tests has been updated:

One last thing to do now, update the badge in the README.md file to show the status for your own repository. In Travis CI, click on the “build passing” badge next to your repository name and in the pop-up, select the markdown format:

Copy the given code and replace the existing one in the README.md file. Commit that last change and push it to Github.

Wrap up

As you can see after this tutorial, integrating Hiptest and a CI tool is a pretty fast operation. Of course, in the case of this tutorial, the hardest part (implementing the action words) was done previously but you now see how to quickly integrate your Hiptest project in your CI process.

In a next blog post, we’ll see how to manage the creation of new scenarios in the project, handle refactoring and upgrade the action words so the code match the definitions in Hiptest.

Download the ebook

This field is required

This field is required

Please enter a valid email address

Thank you, the ebook has been sent to your mailbox

Hiptest is FREE for open source projects

We actually utilize a number of open source components, which is why Hiptest service is free for any open source project. We are giving back to the community!

Your open source project must meet the following criteria to be approved:

  • Your project is licensed under a license approved by the Open Source Initiative
  • Your project source code is available for download
  • Your project has a publicly accessible website

By continuing to use the site, you agree to the use of cookies. more information

The cookie settings on this website are set to "allow cookies" to give you the best browsing experience possible. If you continue to use this website without changing your cookie settings or you click "Accept" below then you are consenting to this.

Close