We first introduce the basic spintop-openhtf concepts with which test benches can be created.
In the context of a test bench implementation on spintop-openhtf, the test plan is the object to which the test phases are loaded and which executes them.
The test phases implement the different test cases. They are defined and loaded in the test plan object which executes them one after the other
The test sequences are intermediary levels of test phases between the test plan and the test cases. They can help implement complex test hierarchies.
See Test Hierarchy.
The trigger phase refers to the first phase of the test bench, in which the dynamic configuration of the test is loaded. Such information can be for example:
The operator name
The board or system serial number
The board or system device type
The test type to execute on the board or system
See Trigger Phase.
Test flow management¶
Test flow management refers to the dynamic selection of which test cases are executed depending on the inputs given at the beginning of the test bench in the trigger phase and by the results of the test themselves. Such inputs that determine test flow are for example the Device Under Test type and a FAIL result of a critical test.
See Test Flow Management.
The configuration refers to all predetermined parameters used to control the flow or the execution of the test. The different configuration types are:
The parameters configuring the test station itself, that is parameters changing from station to station and test jig to test jig, such as ip adresses, com port, etc.
The parameters statically configuring the execution of the test plan, such as for example, the maximum number of iterations for a calibration algorithm.
The parameters dynamically configuring the execution of the test plan, such as those gathered in the trigger phase.
Forms are use to interact with the test operator. They permit the implementation of complex dialogs which allow to operator to both execute manual operations on the test jig to allow the test to continue or to input test result data for verification,
See Using Custom Forms.
In the spintop-openhtf context, plugs allow the iteraction of the test logic with the surrounding test equipment. They basically wrap the access to the test equipment automation libraries.
See About Plugs.
Criteria & measures¶
The criteria refer to the thresholds against which measures are compared to declare a test case PASS or FAIL. In the spintop-openhtf context, the measures module implements the criteria and the comparison against the selected values.
The spintop-openhtf framework outputs a standardized test result record for each test.
To install spintop-openhtf, you need Python. We officially support Python 3.6+ for now. If you already have Python installed on your PC, you can skip this step. Officially supported OSes are:
Install Python using the Windows Installer: https://www.python.org/downloads/windows/
Raspbian & Ubuntu
Install through apt-get
IDE: VS Code with Extensions¶
We use and recommend Visual Studio Code for the development of spintop-openhtf testbenches. Using it will allow you to:
Seamlessly debug with breakpoints the code you will be writting
Remotely develop on a Raspberry Pi if you wish to
Use a modern, extendable and free IDE
Project Folder, Virtual Env & Installation (Windows)¶
First, create or select a folder where you want your sources to lie in.
Once you have your base python available, best practices are to create a virtualenv for each testbench you create. We will use
python as the python executable, but if you installed a separate, non-path python 3 for example, you should replace that with your base executable.
Here are the installation steps on Windows:
mkdir myproject cd myproject
# Creates new venv in the folder 'venv' python -m venv venv venv\Scripts\activate
python -m pip install spintop-openhtf[server]