Problem
Occasionally there are regressions that occur that we simply do not detect. This can happen because we don't test all the behaviour with every release, or it can happen because we don't test on every browser.
Solution
We could create a suite of system tests that cover the core functionality of AdminCentral UI.
The goal of the tests is
- detect any regressions that occur
- test on main supported platforms
- cover as much functionality as possible
- to not be too difficult or time-consuming to perform the tests
- to not be too difficult to time-consuming maintain the tests
Implementation
The tests could be automated with Selenium.
The tests could be performed manually. Manual is time-consuming - but has the advantage that it can be done immediately and is very flexible.
I would think we dont need a big process around the testing, simply a page with each script as a list of steps and expected results. The tester would simply create Jira tickets when steps did not have the expected results. It would then be a step in the sprint - to perform the integration tests. Any developer should also use the integration tests to verify that their changes did not break the associated area.
Proposal for test scripts
ShellApps and App navigation
Tests opening and closing Shell apps, opening and closing Apps, temporary app groups, and the ordering of the App Stack.
Action | Expected Result |
---|---|
Login as superuser | Appslauncher displayed. |
Click Pulse | Pulse icon is hilighted. Pulse displayed. |
Click Messages tab | Pulse Messages view displayed. |
Click on green background to left of pulse | Appslauncher icon is hilighted. Appslauncher view is displayed. |
Click Favorites | Favorites icon is hilighted. Favorites view displayed. |
Click Favorites | Appslauncher icon is hilighted. |
Click Tools App group tile | Tools app tiles are displayed. |
Click Dev App group tile | Dev app tiles are displayed. |
Click Showcase app tile | Showcase app opens. |
Click Favorites icon | Favorites shell app is displayed. |
Click Favorites icon | Favorites shell app is removed, revealing Showcase app again. |
Click Appslauncher icon | Appslauncher shell app is displayed. |
Click Configuration app tile | Configuration app is displayed. |
Click Appslauncher icon | Appslauncher Shell app is displayed. |
Click Assets app tile | Assets app is displayed. |
Click Appslauncher icon | Appslauncher Shell app is displayed. |
Click Configuration app tile | Configuration app is displayed. |
Click close button. | Configuration app is closed, revealing the Assets app. |
Click close button. | Assets app is closed, revealing the Showcase app. |
Click close button. | Showcase app is closed, revealing the Appslauncher. |
Click Dev App Group tile. | Dev App group is closed. |
Pages App
Tests creating and deleting a page, adding and removing components to a page, and the chooser dialog for Pages, Assets, Contacts apps.
Action | Expected Result |
---|---|
Login as superuser | Appslauncher displayed. |
Click Pages app tile | Pages App is displayed. |
Click toggle on demo-project item. | Children of demo-project are displayed. |
Click demo-project item. | demo-project row is hilighted. |
Click "Add page" action | Add page dialog is displayed. |
Enter values: Click "Save Changes" | New "test-section" item is added as child of "demo-project" item. |
Click test-section item. | test-section row is hilighted. |
Click "Edit page" | Page editor opens with "test-section" page. |
Click add icon in "New Extras Component" rectangle. | Add component dialog is displayed. |
Select component: "Internal Page Teaser". Click "Choose" button. | Teaser dialog is displayed. |
Click "Select..." button | Pages chooser dialog is displayed. |
Click "demo-project" row. Click "Choose" button. | Teaser dialog is displayed again with Page field set to "/demo-project". |
Click "Save Changes" button. | Page Editor reloads page, now the Home teaser is displayed in the "Extras" area with the word "Home" and an image. |
Contact Chooser | |
Click the "Extras" edit bar. | "Extras" edit bar is colored dark green. It's child "Internal Page Teaser" is coloured light green. |
Click add icon in "New Extras Component" rectangle. | Add component dialog is displayed. |
Select component: "Contact". Click "Choose" button. | Contact dialog is displayed. |
Click "Select ..." button. | Contact chooser dialog is displayed. |
Click "Pablo Picasso" row. Click "Choose" button. | Contact dialog is displayed with information and image of Pablo Picasso. |
Click "Save Changes" button. | Page Editor reloads page, now the Contact is displayed in the "Extras" area with the word "Cubism" and an image of picasso. |
Asset Chooser | |
Click on "Home" of the added Internal Page Teaser. | Internal Page Teaser editbar is colored dark green. |
Click edit icon in the Internal Page Teaser edit bar. | Internal Page Teaser dialog is displayed. |
Click "Teaser Override" tab. | Teaser Override tab is displayed. |
Click "Select Asset..." button. | Asset chooser dialog is displayed. |
Click top left image of board room. | Image is hilighted. |
Click "Choose" button. | Teaser dialog is displayed. Image field contains: "/demo-features/stage/component/940x320_demo01" |
Click "Save Changes" button. | Page Editor reloads page, now the Teaser displays the new image. |
Click on "Home" of the added Internal Page Teaser. | Internal Page Teaser editbar is colored dark green. |
Click delete icon in the Internal Page Teaser edit bar. | Page Editor reloads page, now the Teaser is gone. |
Assets App