On the All Projects page, you will find the list of projects to which you are assigned.
You can use the search field to find a specific project.
You can use the "Type" filter to filter the projects displayed on this page based on their type (Web, IOT or App).
Each project is represented by a card containing :
Click on a project name to see its details.
(→ Projects Details).
The PM role gives you access to the following additional information and actions:
On the Popin « New Project », you will have to fill in all the required fields in order to create a new project.
GENERAL tab
Fill in the following mandatory fields:
You can change here the Issues description template for all new issues in this project.
Fill in the following required fields:
If you want to create a pre-sales project (or if this project should not appear in the statistics), check the "Pre-Sales project" box.
You can fill in the "Product description" optional field.
Finally click on the CREATE button to create the project (→ Projects Details) or on the CANCEL button to cancel your entry.
On the Project Details page, you can see the project information arranged in several blocks.
Under Overview, a summary of the project (Type and description), the labels set for issues on this project, and finally the number of attachments.
Under Bugtracker Integrations, you can view the different integrations to the client bugtracker (Jira, Redmine, Gitlab or Azure DevOps) which will allow an automatic export of bug tickets to this or these bugtracker(s).
Under Assigned Campaigns, you will find a table listing the project's campaigns with information for each of them such as the number of bug tickets, progress etc. A search field allows you to filter the list of campaigns displayed in this table. You can also change the number of campaigns displayed as well as hide/show columns.You can click on the header of a column to sort its contents in ascending/alphabetical order.
Click on the line of a campaign to display its details
(→ Campaign Details).
Under Test Suites you will find a table listing all the Test Suites associated with guided campaigns in this project. You can click on the header of a column to sort its contents in ascending/alphabetical order. Click on a Test Suite row to view its details (→ Test Suite Details).
The Analyst and PM roles gives you access to the following additional information and actions:
The "ACTIONS" button allows you to access the submenu with the functions:
View details: opens a Pop-In window giving detailed information about the project (Project name, creator name, creation date, opportunity no.)
Edit Project: opens a Pop-In window allowing to edit the project data (Project name and type, company, opportunity number, description, product sections and versions etc...) classified under three tabs GENERAL, ISSUES, COMMERCIAL and PRODUCT
Users: opens a Pop-In window to manage the users associated with this project
Archive: allows you to archive the project so that it no longer appears in the list of projects. A confirmation Pop-In window appears before the project is actually archived. Once archived, you can unarchive it by repeating the same action in the submenu. For more details on archiving, see the tips for PM (→ Tips for PM)
Attachments: opens a Pop-In window to manage files attached to the project (such as SFD, storyboard, screenshots etc...). You can add, delete, download and view an attachment.
Under BUGTRACKER INTEGRATIONS you will find the four bugtracker integration options that are compatible with BugTrapp: JIRA, REDMINE, GITLAB and AZURE DEVOPS.
Click on the button corresponding to the BugTracker you wish to integrate to open the configuration pop-up window.
Under Assigned Campaigns, a delete button for each campaign allows you to delete it (be careful this action is irreversible).
The NEW CAMPAIGN button allows you to create a new campaign associated with this project. Click on the button to bring up the Pop-In window for editing a new campaign.
Fill in the following mandatory fields:
The Delete button (trash can icon) in the Commands column allows you to delete the corresponding campaign. A confirmation Pop-In window appears before the campaign is actually deleted.
Under Test Suites, the IMPORT FROM ANOTHER PROJECT button allows you to create a new Test Suite based on an existing Test Suite from another project. Click on this button to bring up a selection pop-up window. Give your new Test Suite a name, choose the project and then the Test Suite to copy. You can also select only certain Test Cases from the original Test Suite before importing. Finally, click the SAVE button to create the new Test Suite, or CANCEL to cancel the action.
The NEW TEST SUITE button allows you to create a new blank Test Suite. Enter its name and click on the SAVE button to create the new Test Suite, or CANCEL to cancel the action.
The buttons in the Commands column allow you to act on the Test Suites already created:
On the Campaign Details page, you can see the project information arranged in several blocks.
A GET DETAILED REPORT button will be displayed in case the StarDust PM has attached a report file to the campaign.
A GET EXCEL TEST SUITE button will be displayed in case the StarDust PM has attached a Test Suite Excel file to the campaign.
Under Overview there are 4 blocks. The first one indicates information such as the name of the project or the testing methodology used. For a guided campaign, you will also see the number of steps per configuration in the Test Suite used (clicking on this number will take you to the Test Suite (→ Test Suite Details)).
The second block concerns configurations and indicates the number of each type of device. Click on the CONFIGURATION LIST button to access the Configuration List for this campaign (→ CONFIGURATION LIST).
The third block shows the progress of the campaign. Finally, the fourth block concerns the bugs and indicates the number of each type. Furthermore, in this block, a ISSUE LIST button allows you to directly access the bugtracker and display the list of bug tickets for this campaign (→ Issue List - All bugs).
The second part of this page displays different tables and other KPIs according to the selected tabs.
Under the CONFIGURATIONS tab there are 4 sub-tabs corresponding to the device types (ALL, DESKTOPS, TABLETS, MOBILES). The table displays for each device the number of bugs detected on it and its progress in the Test Suite. You can click on the header of a column to sort its contents in ascending/alphabetical order.
Under the TEST RUNS tab are the same 4 previous sub-tabs. The table shows the list of Test Runs that have started. For each one, the number of bugs detected, its progression, the percentage of success (OK steps) and the name of the tester who performed the last action is displayed. You can click on the header of a column to sort its contents in ascending/alphabetical order.
By clicking on the line of a Test Run, you can access its details (→ Test Run).
Under the TEST CASES tab there is a filter for each device started. The table shows the list of Test Cases in the Test Suite. For each of them is displayed details such as % of coverage, progress and success, number of OK, KO, N/A etc... You can click on the header of a column to sort its contents in ascending/alphabetical order.
Under the ISSUE BREAKDOWN tab you will find different pie charts concerning bugs (Type, Criticality, Status etc...).
Under the ISSUE FRAGMENTATION tab is a graph showing the fragmentation of the bugs on the campaign as well as its score (percentage of fragmentation).
Under the TOP 10 tab there are two graphs showing the browser and OS versions with the most bugs on the campaign.
Under the UX RESULTS tab you will find UX results (if this option has been requested in the test service) are available as graphs for UX tests with simple answers (graded from 1 to 5) or as Google Form results for UX tests with complex answers (open-ended questions, etc...).
For an exploratory campaign, the only element that differs is the first block under Overview, which does not mention the number of steps in the test suite because it does not exist for this test methodology.
In addition, the TEST RUNS, TEST CASES and ISSUE FRAGMENTATION tabs are absent for the same reason.
The Test role gives you access to the following additional actions and informations:
Two buttons appear in the upper right corner of the page: START TESTING and ACTIONS.
Clicking on START TESTING will bring up a pop-in window with the required settings before starting the test. Here you choose the configuration on which to run your test. Once selected, click the START button on the Pop-in to go to the Test Run that corresponds to these selections. (→ Test Run).
Click on the ACTIONS button to choose one of the possible actions: "View Instructions" and "Get Excel Report (Beta)".
By choosing "View Instructions", you will be able to see the instructions (left by your PM to help you run your tests on this campaign) in a new Pop-in. Once you have read them, click on the cross to close this pop-in window and return to the Campaign Details page.
By choosing "Get Excel Report (Beta)" you will download an excel file containing all bugs already reported on BugTrapp.
Finally, in the fourth block, additional information is provided regarding the number of Pending issues.
The Test role gives you access to the following additional action:
Set Device Test Duration: opens a Pop-In window allowing you to declare the time spent on the tested configuration. Select your configuration, fill in the hour(s) and min(s) fields and click SAVE to save, or CANCEL to cancel the action.
The Analyst and PM roles gives you access to the following additional actions and information:
In the Actions submenu you can click on the following choices:
View details: opens a Pop-In window giving detailed information about the campaign (Campaign name, creator name, creation date)
Edit Campaign: opens a Pop-In window to edit the campaign data :
Campaign Name, Product Type(WEBSITE, APP, IOT), Campaign Type(Scenario-Based, Exploratory-Based), External Bugtracker, Options(UX Tests, Enable Crowd Testing), Real Payment Testing(Yes, No), Test Suite Design (Internal, External), Bug Reporting Language(English, French, German, Spanish), PLANNING (Start Date, Start time, End Date, End Time), Test Suite.
Edit Instructions: opens a Pop-In window allowing you to edit the instructions to be given to the testers for the proper conduct of the test campaign. Enter these instructions in the text field (integrating a WISIWIG text editor) then click on YES to save these Instructions, or CANCEL to cancel the action.
Get Excel Report : (same as the tester role)
Get Word Report: opens a pop-up window allowing you to choose the language of the Word report generated by BugTrapp. Click on EN or FR to download the report in Word format and in the chosen language. This campaign delivery report is intended for the PMs before being sent to the client.
Attach Report: Opens a system window to browse your computer for the final Word report to send to the client. Once done, the client (and all other roles) will see a download button on the Campaign Details page to retrieve this file. When opening the Actions menu again, the Attach Report line is renamed Remove Report so that you can remove an attached report if needed (only one report maximum per campaign).
Attach Excel Test Suite: Opens a system window to browse your computer for the Test Suite in Excel format to send to the client. Once done, the client (and all other roles) will see a download button on the Campaign Details page to retrieve this file. By opening the Actions menu again, the Attach Excel Test Suite line is renamed Remove Excel Test Suite so that you can remove an attached Test Suite if needed (only one report maximum per campaign).
Start Testing: The START TESTING button is displayed in the Actions submenu instead of being highlighted next to the Actions button as for the Test role. The click action is identical.
In the second part of the page, under the TEST RUNS tab, the Action column displays a Delete Test Run button that allows you to delete a Test Run that has not been started. When clicked, a confirmation pop-up window opens. Type YOLO in the field as shown and click the OK button to delete the Test Run, or Cancel to cancel the action.
For an exploratory campaign as Analyst, the Attach Excel Test Suite and Get Excel Test Suite actions are not available for this test methodology because there is no Test Suite.
To create a Crowd mission linked to the campaign, click on the NEW MISSION button to display the mission type selection popup. Choose the type of mission you want to create: NEW MISSION for a "classic" test mission.
You also have the option to make the mission private. By activating this option, the created mission will not be visible on the Dashboard or in the missions list, and will therefore only be accessible by invitation. Once you have made your choice, click on the CREATE MISSION button.
You can see on this "CREATE A MISSION" page the elements (mandatory and non-mandatory) to fill in to create a mission. These elements are grouped by theme in four tabs: GENERAL, REMUNERATION, RESTRICTIONS and WORKSPACE. Under the section containing these 4 tabs, you can click on SAVE AS DRAFT to save some of the fields already filled in, or on SAVE AND PUBLISH if you have filled in all the fields of the 4 tabs in order to launch the mission.
Fill in the following mandatory fields in this tab:
You can also fill in the Mission Objectives field
Fill in the following mandatory fields in this tab:
You can also choose to accept a suggestion and formulate bugs by filling in the associated compensation.
You can grant compensation for the number of steps completed for a guided mission.
You can accept FP testers by entering an overall bonus compensation in the "Reviewer Bonus" field.
Finally, you can choose to accept CMs on this assignment. If you check this box, you will need to choose the minimum level of CM needed to manage this mission, as well as their overall compensation in the "Campaign Manager Remuneration" field ( invisible field if the CM box is unchecked).
Fill in the following mandatory fields in this tab :
You can also fill in the information in the following fields :
Here you can see the number of testers matching the criteria entered in this tab, updated in real time. You can click on the link to see the list of these testers.
Fill in the following mandatory field in this tab :
You can also receive notifications when new testers apply by checking the box.
On this page you'll see a table listing all the configurations in the selected Configuration List. This table displays the ID, Model, OS, Resolution, Scope and Location columns.
A search field and filters (MODEL, OS, BROWSER) allow you to filter the display of this table.
At the bottom of the table is a selector for the number of elements per page and arrows for scrolling through the table pages.
The Tester role gives you access to the following additional actions and information:
On the Issues page, you can see the list of bug tickets reported by testers.
Below, the main part of the page: the Issue List. You can filter the values displayed in the table (by type, severity etc...). You can also search the list using the search field. You can click on a column header to sort its contents in ascending/alphabetical order.
Bugs with a Status Closed and/or a Review that is not Approved are not visible.
Depending on your window resolution, you may see all or part of the following columns: Summary, Severity, Type, Status, Assignee, Devices, Reporter.
If a bug has been exported to an external bugtracker, a link to it can be clicked under the issue title.
Also under the title are the various labels attached to the Issue.
At the bottom of the table is a selector for the number of elements per page and arrows for scrolling through the table pages.
Click on the line of an issue to display its details (→ ISSUE DETAILS).
You can also take several grouped actions on bug tickets. Check the tickets concerned, then click on the ACTIONS button to open the "Edit Issues" side pane for editing grouped bugs.
In this side panel, you can view/edit the following information for the selected exits:
Once you've made your changes, click on the UPDATE button to apply them to the selected Issues.
To the right of the ACTIONS button is the export menu (3-dot icon), providing access to the EXCEL, ZIP Archive and client bugtracker export buttons (if a configuration to an external bugtracker has been previously set up).
To close the side panel, click on the ">" button in the top right-hand corner.
You can click on the "+ CREATE ISSUE" button to create a new Issue. A pop-in window appears, inviting you to enter the title of your new ticket. If an Issue with a similar title has already been created by a tester on this campaign, this Issue will appear as a suggestion to avoid creating duplicate Issues. Once you've entered the title, click on CREATE to display the page for creating a new Issue. (→ New Issue)
You can perform the following additional actions:
You can perform the following additional actions:
On this page, you can see the various fields (most of which cannot be modified, unless you are the author) filled in for this Issue.
Title - The title of the Issue.
Bug description - Text field generally containing Actual Results (behavior observed on the device(s) under test), Expected Results (expected results or behavior during normal operation) and Steps To Reproduce (list of steps to be taken to reproduce the bug or the same behavior observed) reported by the creator of this Issue.
BASIC INFOS - Located in the right-hand column of the window, contains the Severity and Type fields (non-modifiable) and Status and Assignee fields (modifiable). Each modification is automatically saved when the field is exited.
Labels - Allows you to select the label(s) previously created by the PM or another tester (a search field avoids duplicates if there are many labels), or to add a new label by clicking on the + Create new label button (Enter the name and choose the color associated with this new label. You can also create a family of labels, for example page::homepage, to obtain statistics grouped by family at the end of the campaign). Label selection or creation is automatically saved when the field is exited.
CONFIGURATIONS AND ATTACHMENTS - main tab of the page listing all configurations concerned by this campaign. On your configurations only, you can click on the KO button in the line of your configuration to associate it with this Issue. Finally, you can add an attachment (screenshot, crashlog etc...) by clicking on the picto in the Attachments column of your configuration's row.
ACTIVITY - secondary tab of the page listing all activities on this Issue. You can filter by All, History and Comments. You can also sort the list by recency. Finally, you can leave a comment by filling in the Leave a message field (supporting Markdown, and allowing you to mention a campaign user using the @ symbol).
The Tester role gives you access to the following additional actions and information:
Title - This field can be modified
Bug description - This field can be modified
BASIC INFOS
CONFIGURATIONS AND ATTACHMENTS
REVIEW
The PM role gives you access to the following additional actions and information:
REVIEW - The fields in this tab can be edited:
In this new window, you can see the various fields to be filled in to create this Issue.
Title - The title you've just entered. It can be edited (by clicking on the greyed-out pencil icon)
Bug description - Text field (supporting Markdown and offering shortcut buttons for formatting). Usually contains Actual Results (behavior observed on the device(s) tested), Expected Results (expected results or behavior during normal operation) and Steps To Reproduce (list of steps to be taken to reproduce the bug or the same behavior observed). Click in the field to edit the text, click on the SAVE button to save your information, or CANCEL to cancel editing.
BASIC INFOS - The Severity, Type, Status and Assignee fields in the right-hand column of the window allow you to enter the information needed to manage the Issue. Each modification is automatically saved when the field is exited.
Labels – Allows you to select the label(s) previously created by the PM or another tester (a search field avoids duplicates if there are many labels), or to add a new label by clicking on the + Create new label button (enter the name and choose the color associated with the new label). You can also create a family of labels, for example page::homepage, to obtain statistics grouped by family at the end of the campaign). Label selection or creation is automatically saved when the field is exited.
CONFIGURATIONS AND ATTACHMENTS – main tab of the page listing all configurations concerned by this campaign. On your configurations only, you can click on the KO button in the line of your configuration to associate it with this Issue. Finally, you can add an attachment (screenshot, crashlog etc...) by clicking on the picto in the Attachments column of your configuration's row.
ACTIVITY – secondary tab of the page listing all activities on this Issue. You can filter by All, History and Comments. You can also sort the list by recency. Finally, you can leave a comment by filling in the Leave a message field (supporting Markdown, and allowing you to mention a campaign user using the @ symbol). This user will receive an e-mail notification containing the comment, as well as a new notification in Bugtrapp's notification pane).
The Tester role gives you access to the following additional actions and information:
BASIC INFOS - Status : Additional statuses (Pending and Closed Hidden) are selectable.
CONFIGURATIONS AND ATTACHMENTS - You can add any configuration to this Issue, and add an attachment to each one.
REVIEW – additional tab to track the Review status of this Issue (default is APPROVED). This tab is mainly used for Crowd Missions.
The PM role gives you access to the following additional actions and information:
REVIEW – Les champs de cet onglet sont editables:
You access this page after selecting a Test Run that has already been executed from the Test Run table on the Campaign Details page.
On this page you can see the selected Test Run.
The page is composed as follows:
You access this page after clicking on Start Testing from the Campaign Details page.
Thus the Test role gives you access to the following additional information and actions: