Test Area - Monitor |
|---|
Test ID | Test Case | Test Procedure | Result | Notes |
9 | User is taken to incident channel after starting an incident | As a normal user, start an incident. Once the incident is started, verify that the user is taken to the new incident channel. If the same user has multiple sessions open, it would only change to the new incident channel in the session where the incident was started.
| Pass | Did not always get navigated to incident channel when starting from post action menu |
10 | In RN mobile app, user is notified with an ephemeral message with link to the incident channel | Start an incident in RN mobile app. Verify that the user remains in the same channel where the incident was started. Verify that an ephemeral message is shown with the link to the incident channel.
| Pass | |
11 | A newly started incident does not have any checklist item | As a normal user, start a new incident. Open up the Incident RHS. Find the incident started in step1 and click. Verify that the incident does not have any checklist. Verify that the “Checklist” header in RHS has an “edit” button beside it. Verify that there is an “Add new checklist item”.
| Pass | |
12 | Commander can create a checklist for an incident started by them | Start a new incident. Open up the Incident RHS. Find the incident started in step 1 and click on it to open the details. Click the “Add new checklist” button. Verify that an input box asks for the checklist item name. Input a checklist item name and hit enter. Verify that the checklist item is created. Verify that the “Add new checklist item” button is present at the bottom of the checklist. Click on the “done” button by the Checklist header. Verify the Go back to incident list by clicking on “<“ button. Click on the incident again to open the details view. Verify the checklist item added remains in the list. Verify that the “Add new checklist item” button is present at the bottom of the checklist.
| Pass | |
13 | Commander can cannot create a checklist for an incident from a channel different from the incident channel Start a new incident | Find an active incident or start new. Click to view details. Verify the checklist can be edited and new checklist items can be added. Navigate to a different channel from the incident channel. Open up the Incident RHS. Find the incident started in step 1 and click on it to open the details. Click the “Add new checklist” button. Verify that an input box asks for the checklist item name. Input a checklist item name and hit enter Verify that the checklist is now converted to read-only Verify that the “edit” button no longer exists. Verify that the “Add new checklist item” button no longer exists. Verify that the “End Incident” button is faded/inactive. Verify that there is a message to navigate to the incident channel to make changes.
Click on the incident channel link. Verify that the checklist item is created. Verify that the “Add new checklist item” button is present at the bottom of the checklist.
14not read-only.
| Pass | |
14 | Checklist “edit” button does not work when checklist is empty | Start a new incident. Do not add any item to the checklist. Click on “edit”. Verify a message alerts users that empty checklist cannot be edited.
| Pass | |
15 | Checklist item creation can be cancelled with the Esc key | Start a new incident. Open up the Incident RHS. Find the incident started in step 1 and click on it to open the details. Click the “Add new checklist item” button. Verify that an input box asks for the checklist item name. Input a checklist item name. Press escape. Verify that the checklist item is not created.
| Pass | |
1516 | Commander can remove create checklist item from an incident started by themwithin the channel incident view | Start a new incident (the commander should be taken to the incident channel). Open up the Incident RHS. Find the incident started in step 1 and click on it to open the details. Create a new checklist with a few items. Click the “edit” button next to the Checklist header Click the “X” button to remove the checklist itemOn RHS click on the incident to view details. Click “Add new checklist item” button. Enter a checklist item and hit enter. Verify the item appears on the list. Go to the incident list by clicking “<“. Click on the incident again to view details. Verify that the checklist item is removed from the incident.
16added in step 4 is still there.
| Pass | |
17 | Checklist item can be removed from a different channel than the incident channeladded in edit view. | 18 | User can access read-only incident checklist even if user is not an incident channel member | As user A, start an incident (don’t add user B to incident channel). Create a checklist by clicking the “Add new checklist” button. As user B, open the Incident Response RHS. Click on the incident started in step 1. Verify that the checklist appears as setup in step 2.
| 19 | User cannot add checklist item to a new incident started by a different user if user is not added to the incident channel | Start a new incident. Open up the Incident RHS. Create a checklist and add a few items to it. Navigate to a different channel from the incident channel. Find the incident started in step 1 and click on it to open the details. Click the “edit” button next to the Checklist header Click the “X” button to remove the checklist item. Verify that the checklist item is removed from the incident.
| 17 | User can see checklist in RHS for active incidents | For this step, as user A, ensure there are a few incidents already started. For each incident add checklists. As user B, open the Incident Response RHS. Click on the incidents one at a time. Verify that each incident has checklists as setup in step 2.
| As user A, start a new Click on it on RHS to view details. While the list is empty, click the “edit” button beside the Checklist header. Click on the “Add new checklist item” button. Enter an item. Click on “done” button next to Checklist header. Verify item added now has a checkbox next to it. Go back to incident list view by clicking on the “<“ button. Click the incident again to view details. Verify the item entered in step 5 still exists.
| Pass | |
18 | Commander can remove checklist item from an incident started by them | Start a new incident. Open up the Incident RHS. Find the incident started in step 1 and click on it to open the details. Create a new checklist with a few items. Click the “edit” button next to the Checklist header Click the “X” button to remove the checklist item. Verify that the checklist item is removed from the incident. Click on “done”. Verify that the removed items are not in the list.
| Pass | |
19 | User only has read-only access to an incident checklist if user is not an incident channel member | As user A, start an incident (don’t add user B to incident channel).Do not add any items to the checklist Create a checklist by clicking the “Add new checklist” button. As user B, click open the Incident Response RHS. Click on the incident started by user A in step 1 to open the incident details. Verify that the checklist appears as setup in step 2. Verify that there is no “edit”, “Add new checklist item” button for user B. and “End Incident” buttons in details view.
| Pass | |
20 | User cannot add items checklist item to a checklist, with existing items, for an new incident started by a different user if user is not added to the incident channel | As user A, start a new incident (don’t add user B to incident channel). Create a checklist and add a few Do not add any items to the checklist. As user B, click on the incident started by user A in step 1 to open the incident details. Verify that the checklist setup by user A in step 2 is visible.Verify that there is no button to add “Add new checklist itemitem” button for user B.
| Pass | |
21 | User cannot remove checklist item from add items to a checklist, with existing items, for an incident started by a different user if user is not added to the incident channel | As user A, start a new incident (don’t add user B to incident channel). Create a checklist and add a few items to the checklist. As user B, click on the incident started by user A in step 1 to open the incident details. Verify that the checklist items setup by user A in step 2 does not have the “edit” button beside the Checklist header.
| 22 | User can add checklist item to a new is visible. Verify that there is no button to add new checklist item.
| Pass | |
22 | User cannot remove checklist item from an incident started by a different user if user once is not added to the incident channel | User can add items to a checklist, with existing items, for an incident started by a different user once added to the As user A, start a new incident (don’t add user B to incident channel). Do not add any item Create a checklist and add a few items to the incident checklist. Add As user B to the incident channel.As user B, , click on the incident started by user A in step 1 to open the incident details. Verify there is “Add new checklist item” button for user B. Click on the “Add new checklist item”. Verify that an input box asks for the checklist item name. Input a checklist item name and hit enter. Verify that the checklist item is created. Verify that the “Add new checklist item” button is present at the bottom of the checklist.
| 23 | that checklist items setup in step 2 does not have the “edit” button beside the Checklist header.
| Pass | |
23 | Incident checklist is no longer read-only once non-commander is added to incident channel | As user A, start a new incident (don’t add user B to incident channel). Create a checklist and add a few items to it. Add user B to the incident channel. As user B, click on the incident started by user A in step 1 to open the incident view details. Verify that the checklist setup in step 2 is visible. Verify there is “Add new checklist item” button at the end of the checklist for user B. Click on the “Add new checklist item”. Verify that an input box asks for the checklist item name. Input a checklist item name and hit enter. Verify that the checklist item is created. Verify that the “Add new checklist item” button is present at the bottom of the checklist.
User can edit the checklist item for an User B only has read-only access to the checklist. Have user A added user B to the incident channel. As user B, verify that the incident channel appears in the details. Verify that “End Incident” (although deactivated) appears in the details.
| Pass | |
24 | User can add checklist item to a new incident started by a different user once added to the incident channel | As user A, start a new incident. Create a checklist Add an item “Test 123” Do not add any item to the incident checklist. Add user B to the incident channel. As user B, click on the incident started by user A in step 1 to open the incident details. Verify there is an “edit” button beside the Checklist header“Add new checklist item” button for user B. Click on the “edit” button“Add new checklist item”. Click checklist item “Test 123” and edit it to “Test ABC” Click “done” beside the Checklist header. Click the “<“ button beside the incident name to go back to the incident list. Click on the incident again to bring up the details. Verify that the changes made in step 8 persisted.
User can move items around in the checklist Verify that an input box asks for the checklist item name. Input a checklist item name and hit enter. Verify that the checklist item is created. Verify that the “Add new checklist item” button is present at the bottom of the checklist.
| Pass | |
25 | User can add items to a checklist, with existing items, for an incident started by a different user once added to the incident channel | As user A, start a new incident. Create a checklist Add 3 items “Test”, “123” and “ABC” to the checklist in that orderand add a few items to it. Add user B to the incident channel. As user B, click on the incident started by user A in step 1 to open the incident details. Verify there is an “edit” button beside the Checklist headerthat the checklist setup in step 2 is visible. Verify there is “Add new checklist item” button at the end of the checklist for user B. Click on the “edit” button.Click on the hamburger menu icon beside “123” and drag it to the top of the list“Add new checklist item”. Verify that an input box asks for the checklist item name. Input a checklist item name and hit enter. Verify that list now appears in the order of “123”, “Test” and “ABC”. Click on the hamburger menu icon beside “ABC” and drag it to the middle of the list. Verify that the list now appears in the order of “123”, “ABC” and “Test”. Click “done” Verify that the list remains in the same order as mentioned in step 11. Click the “<“ button beside the incident name to go back to the incident list. Click on the incident again to the checklist item is created. Verify that the “Add new checklist item” button is present at the bottom of the checklist.
| Pass | |
26 | User can edit the checklist item for an incident started by a different user once added to the incident channel | As user A, start a new incident. Create a checklist Add an item “Test 123” to the checklist. Add user B to the incident channel. As user B, click on the incident started by user A in step 1 to open the incident details. Verify there is an “edit” button beside the Checklist header. Click on the “edit” button. Click checklist item “Test 123” and edit it to “Test ABC” Click “done” beside the Checklist header. Click the “<“ button beside the incident name to go back to the incident list. Click on the incident again to bring up the details. Verify that the changes made in step 11 8 persisted.
24 | Pass | |
27 | User can remove item added by different user move items around in the checklist once added to the incident channel. | As user A, start a new incident. Create a checklist and add a few items Add 3 items “Test”, “123” and “ABC” to the checklist in that order. Add user B to the incident channel. As user B, click on the incident started by user A in step 1 to open the incident details. Verify that the checklist setup in step 2 is visible.Verify that the checklist items have there is an “edit” button beside the Checklist header. Click on the “edit” button. Click on the “X” button beside the checklist item to remove the itemshamburger menu icon beside “123” and drag it to the top of the list. Verify that the items are removed from the checklist.
| 25 | Checklist item added reflects accurately for user not added to incident channel | Open two separate browser windows. Log in as 2 different users (user A and user B) in the two browsers. In both browsers, open up the Incident Response RHS. As user A, create a new incident. Do not add user B to the incident channel. As user B, find the incident created in step 4 by user B and click to view the details. While user B is also viewing the RHS, have user A create a checklist with a few items. As user B verify that the checklist is updated accurately. Reversing the actions of user A and B, repeat steps 4-7. Repeat the tests for checklist item removal.
| Checklist item edited reflects accurately for user not added to incident channel | Continue from the above test. As user A, edit an item in the checklist. As user B viewing the RHS, verify that the checklist is updated accurately to reflect the edit by user A.
| Checklist item rearranged reflects accurately for user not added to incident channel | Continue from the above test. As user A, rearrange the order of the checklist items. As user B viewing the RHS, verify that the checklist is rearranged accurately to reflect the rearrangement by user A.
| Checklist item removed list now appears in the order of “123”, “Test” and “ABC”. Click on the hamburger menu icon beside “ABC” and drag it to the middle of the list. Verify that the list now appears in the order of “123”, “ABC” and “Test”. Click “done” Verify that the list remains in the same order as mentioned in step 11. Click the “<“ button beside the incident name to go back to the incident list. Click on the incident again to bring up the details. Verify that the changes made in step 11 persisted.
| Pass | |
28 | User can remove item added by different user once added to the incident channel. | As user A, start a new incident. Create a checklist and add a few items to the checklist. Add user B to the incident channel. As user B, click on the incident started by user A in step 1 to open the incident details. Verify that the checklist setup in step 2 is visible. Verify that the checklist items have an “edit” button beside the Checklist header. Click on “edit”. Click on the “X” button beside the checklist item to remove the items. Verify that the items are removed from the checklist.
| Pass | |
29 | Checklist item added reflects accurately for user not added to incident channel | Continue from the above test. As user A, remove an item from the checklist. As user B viewing the RHS, verify that the item is updated accurately to reflect the removed item from the checklist by user A.
| 26 | Checklist changes reflect accurately for a different user added to incident channel | Open two separate browser windows. Log in as 2 different users (user A and user B) in the two browsers. In Open two separate browser windows. Log in as 2 different users (user A and user B) in the two browsers. In both browsers, open up the Incident Response RHS. As user A, create a new incident. Add Do not add user B to the incident channel. As user B, find the incident created in step 4 by user B and click to view the details. While user B is also viewing the RHS, have user A create a checklist with a few items. As user B verify that the checklist is updated accurately. Reversing the actions of user A and B, repeat steps 4-7. Repeat the tests for checklist item removal.
27 | Pass | |
30 | Checklist can be edited by 2 users at the same time Open two separate browser windows. Log in as 2 different users (user A and user B) in the two browsers. In both browsers, open up the Incident Response RHSitem edited reflects accurately for user not added to incident channel | Continue from the above test. As user A, create a new incident.Add user B to the incident channeledit an item in the checklist. As user B viewing the RHS, find the incident created in step 4 by user B and click to view the details. Have both users add and remove checklist items for the incident. Verify that the checklist is updated accurately for each change made in step 7.
|
Test Area - Coordinate |
|---|
Test ID | Test Case | Test Procedure | Result | Notes |
28 | Commander can check off items in incident checklist | Start an incident. Create a checklist with a few items. Verify that the commander can check items off.
| 29 | Commander can uncheck items in incident checklist | Start an incident. Create a checklist with a few items. Check off the items. Verify that the commander can uncheck items.
| 30 | Non-commander who is not added to incident channel cannot check off items in incident checklist | Start an incident as user A. Create verify that the checklist is updated accurately to reflect the edit by user A.
| Pass | |
31 | Checklist item rearranged reflects accurately for user not added to incident channel | Continue from the above test. As user A, rearrange the order of the checklist items. As user B viewing the RHS, verify that the checklist is rearranged accurately to reflect the rearrangement by user A.
| Pass | |
32 | Checklist item removed reflects accurately for user not added to incident channel | Continue from the above test. As user A, remove an item from the checklist. As user B viewing the RHS, verify that the item is updated accurately to reflect the removed item from the checklist by user A.
| Pass | |
33 | Checklist changes reflect accurately for a different user added to incident channel | Open two separate browser windows. Log in as 2 different users (user A and user B) in the two browsers. In both browsers, open up the Incident Response RHS. As user A, create a new incident. Add user B to the incident channel. As user B, find the incident created in step 4 by user B and click to view the details. While user B is also viewing the RHS, have user A create a checklist with a few items. Log in as As user B verify that the checklist is updated accurately. Verify that user B cannot check off items in step 2.
| 31 | Non-commander who is not added to incident channel cannot uncheck items in incident checklist | Start an incident as user A. Create a checklist with a few items. Check off a few items in the list. Log in as user B. Verify that user B cannot uncheck items in step 3.
| 32 | Non-commander user, who is added to the incident channel, can check off items in incident checklist | Start an incident as user A. Create a checklist with a few items. Add user B to the incident channel. Verify that user B can check items off.
| 33 | Non-commander user, who is added to the incident channel, can uncheck items | Start an incident as user A. Create a checklist with a few items. Add user B to the incident channel. Verify that user B can check off items added in step 3. Verify that user B can uncheck items checked off in step 4.
| 34 | Non-commander user, who is added to the incident channel, can uncheck items checked off by the commander | Start an incident as user A. Create a checklist with a few items. Check items on the list. Add user B to the incident channel. Verify that user B can uncheck items that were checked off in step 3.
| 35 | Ending an incident shows a confirmation modal | Start an incident. Open the RHS and find the incident just started. Click to view details. Verify there is an “End Incident” button at the bottom. Click on the button. Verify a confirmation modal pops up asking whether to end the incident. Go to the incident channel. In the post input box type /incident end Verify a confirmation modal pops up asking whether to end the incident.
| 36 | Commander can end incident | Continue from the above test: Click to confirm ending the incident. Verify that the incident is ended.
(Incident end verifications in Test Plan - Incident Response v0.1.0 ) | 37 | Non-commander cannot can end incident from RHS | As user A start an incident. As user B, verify that the incident is visible in RHS. Click the incident to view details. Verify that there is no “End Incident” button. As user A, add user B to the incident channel. As user B, navigate to the incident channel. In the RHS, find the incident and click to view details. Verify there is no “End Incident” button. Click on the “End Incident” button and confirm to end. Verify that the incident is ended.
| Fix from 0.1.0 | 38 | Non-commander cannot can end incident with /incident command. | As user A, start an incident. As user B, verify that the incident is visible in RHS. Navigate to any channel. In the post input box, type `/incident'. Verify that there is no /incidentoption present in the slash commands. As user A, add user B to the incident channel. As user B, navigate to the incident channel. In the post input box, type `/incident'. Verify that there is no /incidentoption present in the slash commands. In incident channel, issue /incident endcommand. When the end-incident-confirmation pops up, confirm to end. Verify that the incident is ended.
| 39 | Incident cannot be ended from outside the incident channel | Create an incident. Ensure the user is navigated to the incident channel. Open RHS and find the incident. Click on it to view the details. Verify the “End Incident” button exists in RHS. Navigate to a different channel than the incident channel. Verify that the “End Incident” changes to an inactive button, notifying the user that the incident can only be ended from within the incident channel.
|
Test Area - Measure |
|---|
Test ID | Test Case | Test Procedure | Result | Notes |
40 | A bot message is posted in incident channel when an item is added to an incident checklist | As a normal user, start an incident. The user is navigated to the incident channel. Open the Incident Response RHS. Find the incident started in step 1 and click to open details. Create a checklist and add an item. In the incident channel, verify that a bot message similar to the following is posted:
@username added checklist item "[checklist item title]"
| 41 | “Item added to incident checklist” post in incident channel shows the username of user who added the item | Continue from the above test: Verify that the bot message from the above test shows the username of the user who added the checklist item.
| 42 | Checklist item shows the timestamp of when the item was added
| Continue from the above test:
In the RHS, verify that the correct timestamp of when the item was added to the checklist is displayed beside the checklist item title.
| https://mattermost.atlassian.net/browse/MM-23476 only talks about timestamp for checking off item | 43 | A bot message is posted in incident channel when an item in checklist is checked | As a normal user, start an incident. The user is navigated to the incident channel. Open the Incident Response RHS. Find the incident started in step 1 and click to open details. Create a checklist and add an item. Check the item in step 5. In the incident channel, verify that a bot message similar to the following is posted:
@username checked off checklist item "[checklist item title]"
| 44 | “Item checked” post in incident channel shows the username of user who checked the item | Continue from the above test: Verify that the bot message from the above test shows the username of the user who checked off the checklist item.
| 45 | Checking an item shows the timestamp to the right of the checklist item of when the item was checked off | Continue from the above test: In the RHS, verify that the correct timestamp of when the item was checked off is displayed beside the checklist item title.
| 46 | Reversing the actions of user A and B, repeat steps 4-7. Repeat the tests for checklist item removal.
| Pass | |
34 | Checklist can be added by 2 users at the same time when they are both incident channel members | Open two separate browser windows. Log in as 2 different users (user A and user B) in the two browsers. In both browsers, open up the Incident Response RHS. As user A, create a new incident. Add user B to the incident channel. As user B, find the incident created in step 4 by user B and click to view the details. Have both users click “edit”. Have both users enter item titles simultaneously before pressing enter. Have both users press enter almost around the same time. Verify that the checklist is updated accurately for each change made in step 7.
| Pass | |
35 | Checklist can be edited by 2 users at the same time when they are both incident channel members | Continue from the above test. As any user add the following items to the checklist in the same order: “123”, “ABC”, “Test”. Have both users go in the edit mode for the checklist. Have both users click “123” to start editing. As user A, edit it to “123 A”. Verify that the change is reflected accurately in real time to user B. As user A, edit the same item to “B XYZ”. Verify that the change is reflected accurately in real time to user A. Save the changes made by user B. As user B, drag the “Test” item below “B XYZ”. As user A, drag ABC to the top of the list. Have both users go back to the incident list by clicking the “<“ button. Have both users go to the incident’s detail view. Verify the the checklist appears in the following order: “ABC“, “B XYZ“, “Test”
| Pass | |