Page Comparison

Document version 0.0

Status: Test development in progress

Document Version	Description	Date
0.0	Initial version	05/14
0.1	Test	06/15

References

...

access

Test Area - Limit incident access to only participants As an incident participant, I can make an incident and its channel private so that non-participants don’t know it exists let alone access its content.
Test ID	Test Case	Test Procedure	Result	Notes
14	Incident created without selecting a playbook is public by default	As user-1, bring up the incident creation modal. Provide a channel name. Do not select anything from the Playbook dropdown. Click “Start Incident” Do not add any other user to the incident channel. As user-2, click the incident icon in channel header. Verify that the incident is visible in the RHS incident list. Launch incident backstage. Verify that the incident is visible in the incident list.		#7: RHS incident list may go away.
15	User can make a public incident	As user-1, create a playbook as follows: Launch the playbook backstage. Click “New Playbook”. Provide name of the playbook - “Public PB 1“ Enter a few checklist items. Click “Save”. Switch to the main channel view. Create an incident by selecting the playbook “Public PB 1”. Do not add any other user to the incident channel. As user-2, verify that the incident is visible in the incident backstage. Click on the incident. Verify that the incident details can’t be viewed.
16	User can make a private incident	As user-1, launch the playbook backstage. Click “New Playbook”. Provide a playbook name “Private-PB-1”. Keep the “Create Public Incident” option disabled. Add some checklist items. Save playbook. Create an incident by selecting the playbook “Private-PB-1”. Login Log in as user-2. Verify that the incident is not visible in the incident RHS. Launch incident backstage. Verify that the incident is not visible in the incident list.		#9: RHS incident list may go away.
17	Converting a public incident channel into private, makes the incident private	As a sysadmin, create a public incident “Pub-1”. Log in as user-1. Join the “Pub-1” incident channel to become a participant. Convert it into a private incident Go to Pub-1 channel From the channel header, click the dropdown From the menu, select “Convert to Private Channel” In the “Convert public to a Private Channel” confirmation box, select “Yes..” Verify access in backstage Launch incident backstage. Verify that the incident is visible in the incident list. Click on the incident. Verify that the incident details are accurately displayed.
18	Non participant cannot access a previously public incident converted to a private incident	Continue the test from above. Log in as user-2. Verify incident is not accessible in backstage. Launch incident backstage. Verify that the incident is not visible in the incident list.
19	Non participant cannot access a new private incident	As user-1, bring up the incident modal. Give it the channel name “Pr-In-1”. From the Playbook dropdown, select “Private-PB-1”. Click “Start Incident”. Do not add anyone else to the incident channel. Login Log in as user-2. Verify that the incident “Pr-In-1” is not visible in the incident RHS. Launch incident backstage. Verify that the incident “Pr-In-1” is not visible in the incident list.
20	Private incidents cannot be searched in backstage by non-participants.	Continue from the above test. In the incident backstage, search for “Pub-1”. Verify that “Pub-1” incident is not present in the search result. Search for “Pr-In-1” in the backstage. Verify that “Pr-In-1” incident is not present in the search result.
21	Public incidents are visible only within the incident’s team	As user-1, create a public incident in Team X. Launch incident backstage. Verify that the incident is visible in the incident list. Switch to Team Y. Launch the incident backstage. Verify that the incident is not visible in the incident list. As user-2, go to Team X. Launch the incident backstage. Verify that the incident is visible in the incident list. Switch to Team Z. Verify that the incident is not visible in the incident list.
22	Private incidents are visible only within the incident’s team	As user-1, create a private incident using playbook with private setting on. Launch incident backstage. Verify that the incident is visible in the incident list. Switch to Team Y. Launch the incident backstage. Verify that the incident is not visible in the incident list. As user-2, go to Team X. Launch the incident backstage. Verify that the incident is not visible in the incident list. Switch to Team Z. Verify that the incident is not visible in the incident list.
23	Public incidents cannot be searched in a different team’s incident backstage	As user-1, create a public incident “Pub C” in Team Y. Launch incident backstage. Verify that the incident is visible in the incident list. Search for “Pub C” in the backstage. Verify that “Pub C” is present in the search result. Switch to Team X. Launch the incident backstage. Verify that the incident is not visible in the incident list. Search for “Pub C” in the backstage. Verify that “Pub C” is not present in the search result.
24	Non participants can view public incident details in RHS	Continue from the above test. As user-1, add checklist items to Pub C. Check at least 1 item on the checklist. As user-2 go to Team Y. From the public channels list in the LHS, find the incident channel for “Pub C” and click. Verify that the Pub C incident details view opens up in the RHS. Verify that user-2 can see the checklist items as created in step 1. Verify that user-2 can see the correct state of checklist items as modified in step 2.
25	Non participants cannot edit incident details in RHS of a public incident unless added as the incident channel’s member	Continue from the above test. As user 2, go to Team Y. View Pub C’s details on the RHS. Verify that the checklist items are greyed out (inactive). Verify user-2 cannot add items to the checklist. Verify user-2 cannot check off checklist items. Verify user-2 cannot uncheck checklist items.		Need to find out more about the mechanism to view the incident details on RHS if the details view is going to be tightly coupled with the channel view.
26	Non participant cannot	view private incident details in RHS			Is this test case correct. Non-participant can’t see private channels.
27	System administrator can see a private incident	As user-1, create a private incident “Pr A”. Add a few checklist items. Log in as sysadmin. Verify that sysadmin can see the private channel “Pr A” on the LHS. Launch incident backstage. Verify that sysadmin can see “Pr A” in the incident list.
28	System administrator can join a private incident	Continue from the above test. As sysadmin, in the main channel view, find and click “Pr A” on the LHS. Verify that sysadmin can successfully join the channel.
29	System administrator can view a private incident details	Continue from the above test. As sysadmin, open up the incident RHS. Verify that sysadmin can see the incident details for “Pr A” on the RHS. Launch incident backstage. Click on “Pr A”. Verify that sysadmin can see the details of “Pr A” correctly in the details view in backstage.
30	System administrator can check and uncheck items in private incidents	Continue from the above test. As sysadmin, open up the incident RHS to view the details of “Pr A”. Check an item from the checklist. Verify that sysadmin can successfully check an item off the list. Uncheck an item from the checklist. Verify that sysadmin can successfully uncheck an item off the list. Launch the incident backstage. Find and click “Pr A” to view the details. Verify that the items checked off and unchecked are reflected properly in the graph.
31	System administrator can add and remove checklist items in a private incident	Continue from the above test. As sysadmin, add checklist item “Admin check“ to “Pr A”. Verify that “Admin check” is successfully added to the checklist. Remove one of the items added earlier by user-1 from the checklist. Verify that the item is successfully removed. Launch the incident backstage. Find and click “Pr A” to view the details. Verify that the items added and removed are reflected properly.
32	System administrator can end a private incident	Continue from the above test. As sysadmin, open the incident details of “Pr A” on the RHS. Click “End Incident”. Verify that the incident is ended successfully. Launch the incident backstage. Verify that the incident end state under “Status” is properly reflected in the list view. Verify that the incident end state is properly reflected in the incident details view.
33	Team administrator can see a private incident	As user-1, create a private incident “Pr B”. Add checklist items “check 1” and “check 2”. Log in as a team admin. Verify that team admin can see the private channel “Pr B” on the LHS. Launch incident backstage. Verify that team admin can see “Pr B” in the incident list.
34	Team administrator can join a private incident	Continue from the above test. As team admin, in the main channel view, find and click “Pr B” on the LHS. Verify that team admin can successfully join the channel.
35	Team administrator can view a private incident details	Continue from the above test. As team admin, open up the incident RHS. Verify that team admin can see the incident details for “Pr B” on the RHS. Launch incident backstage. Click on “Pr B. Verify that team admin can see the details of “Pr B” correctly in the details view in backstage.
36	Team administrator can check and uncheck items in private incidents	Continue from the above test. As team admin, open up the incident RHS to view the details of “Pr B”. Check both items “check 1” and “check 2” from the checklist. Verify that team admin can successfully check the item off the list. Uncheck item “check 2” from the checklist. Verify that team admin can successfully uncheck the item off the list. Launch the incident backstage. Find and click “Pr B” to view the details. Verify that the items checked off and unchecked are reflected properly in the graph.
37	Team administrator can add and remove checklist items in a private incident	Continue from the above test. As team admin, add checklist item “check 3“ to “Pr B”. Verify that “check 3” is successfully added to the checklist. Remove “check 2” from the checklist. Verify that the item is successfully removed. Launch the incident backstage. Find and click “Pr B” to view the details. Verify that the items added and removed are reflected properly.
38	Team administrator can end a private incident	Continue from the above test. As team admin, open the incident details of “Pr B” on the RHS. Click “End Incident”. Verify that the incident is ended successfully. Launch the incident backstage. Verify that the incident end state under “Status” is properly reflected in the list view. Verify that the incident end state is properly reflected in the incident details view.

System administrator playbook a sysadmin the Playbooks backstage (either from main menu or incident RHS header’s playbook button)

Enable the setting for “Create Public Playbook”.

Provide “SA PB the setting for to allow the playbook to create public incidents by default.

Add the following checklist items:

Start test
Edit test
End test

Click “Save Playbook”.

Verify that upon saving, “SA PB 1” exists in the playbook list view in backstage.

Log in as a non-admin user.

Launch playbooks backstage.

Verify that playbooks “SA PB 2” and “TA PB 4” are not visible in the backstage.

Switch to a Verify that playbooks “SA PB 2” and “TA PB 4” are not available in the Playbook dropdown the team admin Playbooks that “SA PB 2” is not visible in the backstage.

Switch to normal channel view.

Bring up the incident creation dialog.

Verify that “SA PB 2” is not available in the Playbook dropdown.

Log in as the sysadmin.

Launch Playbooks backstage.

Verify that “TA PB 4” is not visible in the backstage.

Switch to normal channel view.

Bring up the incident creation dialog.

Verify that “TA PB 4” is not available in the Playbook backstage.

Continue from the above tests.

Log in as user-1.

In Team B, launch the Playbook backstage.

Find the playbook “Pub-PB2”.

Click Edit for the playbook

Test Area - Configure playbooks to create public/private incidents As an incident manager, I can configure playbooks to create either public or private incidents so that it defaults to the correct permission when executed.
Test ID	Test Case	Test Procedure	Result	Notes
39	Playbook can be configured to create a public	incident	Log in as	team admin. Launch	playbook backstage. Click on “New Playbook”.	Enter “PB 1” for	Playbook Name. Enable the	button to “Create Public Incident”	Is step #4 correct?	40	System administrator can create a private playbook	Log in as a sysadmin. Launch the Playbooks backstage (either from main menu or incident RHS header’s playbook button). Click “New Playbook”. Enable the setting for “Create Public Playbook”. Provide “SA PB 2” for the Playbook Name. Disable the setting for “Create Public Incident” to allow the playbook to create private incidents by default. Add the following checklist items: Start test Edit test End test Click “Save Playbook”. Verify that upon saving, “SA PB 2” exists in the playbook list view in backstage.	#4 correct?	41	Team admin can create a public playbook	Log in as a team admin. Launch the Playbooks backstage (either from main menu or incident RHS header’s playbook button). Click “New Playbook”. Enable the setting for “Create Public Playbook”. Provide “TA PB 3” for the Playbook Name. Enable the setting for “Create Public Incident” to allow the playbook to create public incidents by default. Add the following checklist items: Start test Edit test End test Click “Save Playbook”. Verify that upon saving, “TA PB 3” exists in the playbook list view in backstage.	#4 correct?	42	Team admin can create a private playbook	Log in as a team admin. Launch the Playbooks backstage (either from main menu or incident RHS header’s playbook button). Click “New Playbook”. Enable the setting for “Create Public Playbook”. Provide “TA PB 4” for the Playbook Name. Disable the setting for “Create Public Incident” to allow the playbook to create private incidents by default. Add the following checklist items: Start test Edit test End test Click “Save Playbook”. Verify that upon saving, “TA PB 4” exists in the playbook list view in backstage.	#4 correct?	43	A non-admin user cannot create a playbook	Log in as a non-admin user. Launch playbooks backstage. Verify that there is no “New Playbook” button in the playbooks backstage.	Is #3 correct?	44	~~A non-admin user cannot create a private playbook~~	N/A due to the test above this one. Is this correct?	45	Private playbook is initially only visible to playbook creator	. Add checklist items “item 1” , “item 2” and “item 3”. Click “Save Playbook”. Switch to normal channel view. Bring up the incident creation dialog. Create incident “New Public PB1”. From the playbook dropdown, select “PB 1”. Click “Start Incident”. Verify that the incident created has the correct checklist items. Log in as user-2. Launch incident backstage. Verify user-2 can see “New Public PB1” in the incident list.
40	Playbook can be configured to create a private incident	Log in as team admin. Launch playbook backstage. Click on “New Playbook”. Enter “PB 2” for Playbook Name. Ensure the button to “Create Public Incident” is disabled. Add checklist items “item a” , “item b” and “item c”. Click “Save Playbook”. Switch to normal channel view. Bring up the incident creation dialog. Create incident “New Public PB2”. From the playbook dropdown, select “PB 2”. Click “Start Incident”. Verify that the incident created has the correct checklist items. Log in as user-2. Launch incident backstage. Verify user-2 cannot see “New Public PB1” in the incident list.
41	Playbook can be edited to change public incident creation setting to private	Continue from the above tests. Log in as user-1. Launch playbook backstage. Find playbook “PB 1”. Click “Edit”. Disable the button to “Create Public Incident”. Click “Save Playbook”. Switch to normal channel view. Bring up the incident creation dialog. Create incident “Incident PB3”. From the playbook dropdown, select “PB 1”. Click “Start Incident”. Verify that the incident created has the correct checklist items. Log in as user-2. Launch incident backstage. Verify user-2 cannot see “Incident PB3” in the incident list.
42	Playbook can be edited to change private incident creation setting to public	Continue from the above tests. Log in as user-1. Launch playbook backstage. Find playbook “PB 2”. Click “Edit”. Enable the button to “Create Public Incident”. Click “Save Playbook”. Switch to normal channel view. Bring up the incident creation dialog. Create incident “Incident PB4”. From the playbook dropdown, select “PB 2”.	Click “Start Incident”. Verify that the incident created has the correct checklist items. Log in as	user-2. Launch	incident backstage. Verify	Are steps 13-18 correct? Are private playbooks visible to/accessible by system admins? Or do they need to be invited to the playbook to access them as well?	46	Private playbook is only available within the team it was created in	Log in as sysadmin. Switch to different team than the one where “SA PB 1” and “SA PB 2” were created. Launch the Playbook backstage. Verify that the playbooks “SA PB 1” and “SA PB 2” are not visible in the backstage. Switch to normal channel view. Bring up the incident creation dialog. Verify that “SA PB 1” and “SA PB 2” are not available in the Playbook backstage.	47	Public playbook is visible to all the members of a team	Create a new team “Team B”. Don’t add any user to the team. Create a public playbook - “Pub-PB1”. Verify no other user (non-admin team member, guest) can see “Pub-PB1” in backstage since they are not added to Team B”. Add user-1 to Team B. Log in as user-1. Verify that user-1 can see “Pub-PB1” in backstage. Verify that user-1 can see “Pub-PB1” in incident creation dialog’s playbook dropdown. Add user-2 to Team B. Create a new public playbook - “Pub-PB2”. Verify that both user-1 and user-2 can see “Pub-PB2” in backstage. Verify that both user-1 and user-2 can see “Pub-PB2” in incident creation dialog’s playbook dropdown.	48	Public playbook can be edited by member user of the team	user-2 can see “Incident PB4” in the incident list.

Test Area - Prioritize incidents that the user is a participant of As an incident participant, I can easily tell apart the incidents that are relevant to me so that it’s I can get there more quickly.
Test ID	Test Case	Test Procedure	Result	Notes
43	Incidents in backstage will be listed in priority order	Log in as user-1. Add user-2 to incident “New Public PB 1”. Log in as user-2. Create a private incident “U2 Pr 1”. Launch incident backstage. Verify that the incidents are listed in the following order: U2 Pr 1 (user-2 is the creator) New Public PB 1 (user-2 is the member of) Incident PB4 (public incident that user-2 is not a member of) Switch to a normal channel view. Create a new public incident “U2 Pu”. Launch incident backstage. Verify that the incidents are listed in the following order: U2 Pu (the latest incident created by user-2) U2 Pr 1 New Public PB 1 Incident PB 4		Is the order correct in step 6 and 10?

Notes

Test Area - Limit the ability to create playbooks to Team Administrators As a system administrator, I can restrict who can create playbooks so that the incident response process can be better standardized.
Test ID	Test Case	Test Procedure	Result	Notes
44	System administrator can create a public playbook	Log in as a sysadmin. Launch the Playbooks backstage (either from main menu or incident RHS header’s playbook button). Click “New Playbook”. Enable the setting for “Create Public Playbook”. Provide “SA PB 1” for the Playbook Name. Enable the setting for “Create Public Incident” to allow the playbook to create public incidents by default. Add the following checklist items: Start test Edit test End test Click “Save Playbook”. Verify that upon saving, “SA PB 1” exists in the playbook list view in backstage.		Is step #4 correct?
45	System administrator can create a private playbook
Test Area - Tests/bugs outside of user stories
Test ID	Test Case	Test Procedure	Result	Log in as a sysadmin. Launch the Playbooks backstage (either from main menu or incident RHS header’s playbook button). Click “New Playbook”. Enable the setting for “Create Public Incident”Playbook”. Add item “new task”. Click “Save Playbook”. Verify that the edit has been saved properly. Click “Edit” again. Verify that the edits made in step 5 & 6 persisted.	49	Team member can “invite” other team members to manage public playbook	Not sure about steps to invite other members to manage playbook.	50	Team member can create an incident using public playbook	Continue from the above test. Log in as user-2. Bring up the incident creation modal. Create a new incident with playbook “Pub-PB2”. Open the incident details. Verify that the incident created is a public incident. Verify that the incident created has all settings and checklist items as edited in the above test.	51	Public playbook can be deleted by team member	Log in as user-2. Launch Playbook backstage. Find “Pub-PB2”. Click “Delete” for the playbook. Click “Delete Playbook” in the confirmation modal. Verify that the playbook is gone from the backstage list view. Switch to normal channel view. Bring up the incident creation modal. Verify that “Pub-PB2” is not available in the playbook dropdown.	Private playbook cannot be edited by a non-admin team member	Note the playbook name and playbook-id of the private playbook “TA SB 4” Log in as user-1. Issue a PUT request to `http://localhost:8065/plugins/com.mattermost.plugin-incident-response/api/v1/playbooks/[playbook-id]`` with a payload change to add a checklist item. Verify that the request cannot be completed. As team admin, verify that the PUT request made in 3 did not take effect.	Using a direct PUT to test here because the user will not be able to find the private playbook in the UI.	Private playbook cannot be deleted by member user of the team	Continue from the above test. Log in as user-1. Issue a DELETE request to `http://localhost:8065/plugins/com.mattermost.plugin-incident-response/api/v1/playbooks/[playbook-id].` Verify that the request cannot be completed. As team admin, verify that t	Team member cannot “invite” other team members to manage private playbook	Team member cannot create an incident using private playbook
Test Area - Prioritize incidents that the user is a participant of As an incident participant, I can easily tell apart the incidents that are relevant to me so that it’s I can get there more quickly.
Test ID	Test Case	Test Procedure	Result	Notes
Test Area - Limit the ability to create playbooks to Team Administrators As a system administrator, I can restrict who can create playbooks so that the incident response process can be better standardized.
Test ID	Test Case	Test Procedure	Result	Notes
Test Area - Limit playbook access to specific users As a playbook creator, I can specify who else can see and edit the playbook so that sensitive content wouldn’t be unintentionally revealed.
Test ID	Test Case	Test Procedure	Result	Notes
Test Area - UI
Test ID	Test Case	Test Procedure	Result	Notes
Test UI in light theme	Test UI in dark theme	Test UI in Monokai theme	{"sidebarBg":"#2f3136","sidebarText":"#8f9297","sidebarUnreadText":"#dcddde","sidebarTextHoverBg":"#35363c","sidebarTextActiveBorder":"#35363c","sidebarTextActiveColor":"#dcddde","sidebarHeaderBg":"#282b30","sidebarHeaderTextColor":"#818386","onlineIndicator":"#64b285","awayIndicator":"#eea941","dndIndicator":"#b74b47","mentionBg":"#7289da","mentionBj":"#ffffff","mentionColor":"#dcddde","centerChannelBg":"#36393e","centerChannelColor":"#dcddde","newMessageSeparator":"#f75252","linkColor":"#7289da","buttonBg":"#43b581","buttonColor":"#ffffff","errorTextColor":"#fd5960","mentionHighlightBg":"#36393e","mentionHighlightLink":"#7289da","codeTheme":"monokai"}
Provide “SA PB 2” for the Playbook Name. Disable the setting for “Create Public Incident” to allow the playbook to create private incidents by default. Add the following checklist items: Start test Edit test End test Click “Save Playbook”. Verify that upon saving, “SA PB 2” exists in the playbook list view in backstage.		#4 correct?
46	Team admin can create a public playbook	Log in as a team admin. Launch the Playbooks backstage (either from main menu or incident RHS header’s playbook button). Click “New Playbook”. Enable the setting for “Create Public Playbook”. Provide “TA PB 3” for the Playbook Name. Enable the setting for “Create Public Incident” to allow the playbook to create public incidents by default. Add the following checklist items: Start test Edit test End test Click “Save Playbook”. Verify that upon saving, “TA PB 3” exists in the playbook list view in backstage.		#4 correct?
47	Team admin can create a private playbook	Log in as a team admin. Launch the Playbooks backstage (either from main menu or incident RHS header’s playbook button). Click “New Playbook”. Enable the setting for “Create Public Playbook”. Provide “TA PB 4” for the Playbook Name. Disable the setting for “Create Public Incident” to allow the playbook to create private incidents by default. Add the following checklist items: Start test Edit test End test Click “Save Playbook”. Verify that upon saving, “TA PB 4” exists in the playbook list view in backstage.		#4 correct?
48	A non-admin user cannot create a playbook	Log in as a non-admin user. Launch playbooks backstage. Verify that there is no “New Playbook” button in the playbooks backstage.		Is #3 correct?
49	~~A non-admin user cannot create a private playbook~~			N/A due to the test above this one. Is this correct?
50	Private playbook is initially only visible to playbook creator	Log in as a non-admin user. Launch playbooks backstage. Verify that playbooks “SA PB 2” and “TA PB 4” are not visible in the backstage. Switch to a normal channel view. Bring up the incident creation dialog. Verify that playbooks “SA PB 2” and “TA PB 4” are not available in the Playbook dropdown. Log in as the team admin. Launch Playbooks backstage. Verify that “SA PB 2” is not visible in the backstage. Switch to normal channel view. Bring up the incident creation dialog. Verify that “SA PB 2” is not available in the Playbook dropdown. Log in as the sysadmin. Launch Playbooks backstage. Verify that “TA PB 4” is not visible in the backstage. Switch to normal channel view. Bring up the incident creation dialog. Verify that “TA PB 4” is not available in the Playbook backstage.		Are steps 13-18 correct? Are private playbooks visible to/accessible by system admins? Or do they need to be invited to the playbook to access them as well?
51	Private playbook is only available within the team it was created in	Log in as sysadmin. Switch to different team than the one where “SA PB 1” and “SA PB 2” were created. Launch the Playbook backstage. Verify that the playbooks “SA PB 1” and “SA PB 2” are not visible in the backstage. Switch to normal channel view. Bring up the incident creation dialog. Verify that “SA PB 1” and “SA PB 2” are not available in the Playbook backstage.
52	Public playbook is visible to all the members of a team	Create a new team “Team B”. Don’t add any user to the team. Create a public playbook - “Pub-PB1”. Verify no other user (non-admin team member, guest) can see “Pub-PB1” in backstage since they are not added to Team B”. Add user-1 to Team B. Log in as user-1. Verify that user-1 can see “Pub-PB1” in backstage. Verify that user-1 can see “Pub-PB1” in incident creation dialog’s playbook dropdown. Add user-2 to Team B. Create a new public playbook - “Pub-PB2”. Verify that both user-1 and user-2 can see “Pub-PB2” in backstage. Verify that both user-1 and user-2 can see “Pub-PB2” in incident creation dialog’s playbook dropdown.
53	Public playbook can be edited by member user of the team	Continue from the above tests. Log in as user-1. In Team B, launch the Playbook backstage. Find the playbook “Pub-PB2”. Click Edit for the playbook. Enable the setting for “Create Public Incident”. Add item “new task”. Click “Save Playbook”. Verify that the edit has been saved properly. Click “Edit” again. Verify that the edits made in step 5 & 6 persisted.
54	Team member can “invite” other team members to manage public playbook			Not sure about steps to invite other members to manage playbook.
55	Team member can create an incident using public playbook	Continue from the above test. Log in as user-2. Bring up the incident creation modal. Create a new incident with playbook “Pub-PB2”. Open the incident details. Verify that the incident created is a public incident. Verify that the incident created has all settings and checklist items as edited in the above test.
56	Public playbook can be deleted by team member	Log in as user-2. Launch Playbook backstage. Find “Pub-PB2”. Click “Delete” for the playbook. Click “Delete Playbook” in the confirmation modal. Verify that the playbook is gone from the backstage list view. Switch to normal channel view. Bring up the incident creation modal. Verify that “Pub-PB2” is not available in the playbook dropdown.
57	Private playbook cannot be edited by a non-admin team member	Note the playbook name and playbook-id of the private playbook “TA SB 4” Log in as user-1. Issue a PUT request to `http://localhost:8065/plugins/com.mattermost.plugin-incident-response/api/v1/playbooks/[playbook-id]`` with a payload change to add a checklist item. Verify that the request cannot be completed. As team admin, verify that the PUT request made in 3 did not take effect.		Using a direct PUT to test here because the user will not be able to find the private playbook in the UI.
58	Private playbook cannot be deleted by member user of the team	Continue from the above test. Log in as user-1. Issue a DELETE request to `http://localhost:8065/plugins/com.mattermost.plugin-incident-response/api/v1/playbooks/[playbook-id].` Verify that the request cannot be completed. As team admin, verify that the playbook did not get deleted.
59	Non-admin team member cannot “invite” other team members to manage private playbook	Continue from the above test. Log in as team admin. Invite user-1 to manage playbook “TA PB 4”. Log in as user-1. Verify that user-1 can edit the playbook. As user-1 try inviting user-2 to manage the playbook. Verify that user-1 cannot invite user-2 to manage the playbook.
60	~~Non-admin team member cannot create an incident using private playbook if not invited to manage the playbook~~			Covered by #45

Test Area - Limit playbook access to specific users As a playbook creator, I can specify who else can see and edit the playbook so that sensitive content wouldn’t be unintentionally revealed.
Test ID	Test Case	Test Procedure	Result	Notes
61	Team admin can limit playbook access to specific users	Log in as team admin. Create a playbook “TA 1”. Add checklist items “1”, “2” and “3”. Invite user-2 in the playbook. Click “Save Playbook”. Login as user-1. Launch playbook backstage. Verify that user-1 cannot find “TA 1” in the backstage. Switch to normal channel view. Bring up the incident creation dialog. Verify that user-1 cannot find “TA 1” in the playbook dropdown. Login as user-2. Launch playbook backstage. Verify that user-1 can find “TA 1” in the backstage. Switch to normal channel view. Bring up the incident creation dialog. Verify that user-1 can find “TA 1” in the playbook dropdown.
62	Team admin can edit users who have access to playbook	Continue from the above test. As team admin, launch playbook backstage. Find “TA 1”. Click “Edit”. Invite user-1 to manage the playbook “TA 1”. Click “Save Playbook”. Verify that user-1 can now find “TA 1” in the backstage. Switch to normal channel view. Bring up the incident creation dialog. Verify that user-1 can now find “TA 1” in the playbook dropdown.
63	User removed by team admin can no longer access playbook	Continue from the above test. As team admin, launch playbook backstage. Find “TA 1”. Click “Edit”. Remove user-2 from the playbook “TA 1”. Click “Save Playbook”. Verify that user-2 cannot find “TA 1” in the backstage. Switch to normal channel view. Bring up the incident creation dialog. Verify that user-2 cannot find “TA 1” in the playbook dropdown.
64	System admin can limit playbook access to specific users	Log in as team admin. Create a playbook “Sa 1”. Add checklist items “a”, “b” and “c”. Invite user-2 in the playbook. Click “Save Playbook”. Login as user-1. Launch playbook backstage. Verify that user-1 cannot find “Sa 1” in the backstage. Switch to normal channel view. Bring up the incident creation dialog. Verify that user-1 cannot find “Sa 1” in the playbook dropdown. Login as user-2. Launch playbook backstage. Verify that user-1 can find “Sa 1” in the backstage. Switch to normal channel view. Bring up the incident creation dialog. Verify that user-1 can find “Sa 1” in the playbook dropdown.
65	System admin can edit users who have access to playbook	Continue from the above test. As team admin, launch playbook backstage. Find “Sa 1”. Click “Edit”. Invite user-1 to manage the playbook “Sa 1”. Click “Save Playbook”. Verify that user-1 can now find “Sa 1” in the backstage. Switch to normal channel view. Bring up the incident creation dialog. Verify that user-1 can now find “Sa 1” in the playbook dropdown.
66	User removed by system admin can no longer access playbook	Continue from the above test. As team admin, launch playbook backstage. Find “Sa 1”. Click “Edit”. Remove user-2 from the playbook “Sa 1”. Click “Save Playbook”. Verify that user-2 cannot find “Sa 1” in the backstage. Switch to normal channel view. Bring up the incident creation dialog. Verify that user-2 cannot find “Sa 1” in the playbook dropdown.

Test Area - UI
Test ID	Test Case	Test Procedure	Result	Notes
67	Test UI in light theme	Test UI in light theme in Chrome. Test UI in light theme in Firefox. Test UI in light theme in Safari. Test UI in light theme in Desktop app. Spot check in mobile app. Spot check in mobile browser.
68	Test UI in dark theme	Test UI in dark theme in Chrome. Test UI in dark theme in Firefox. Test UI in dark theme in Safari. Test UI in dark theme in Desktop app. Spot check in mobile app. Spot check in mobile browser.
69	Test UI in Monokai theme	Test UI in Monokai theme in Chrome. Test UI in Monokai theme in Firefox. Test UI in Monokai theme in Safari. Test UI in Monokai theme in Desktop app. Spot check in mobile app. Spot check in mobile browser.{"sidebarBg":"#2f3136","sidebarText":"#8f9297","sidebarUnreadText":"#dcddde","sidebarTextHoverBg":"#35363c","sidebarTextActiveBorder":"#35363c","sidebarTextActiveColor":"#dcddde","sidebarHeaderBg":"#282b30","sidebarHeaderTextColor":"#818386","onlineIndicator":"#64b285","awayIndicator":"#eea941","dndIndicator":"#b74b47","mentionBg":"#7289da","mentionBj":"#ffffff","mentionColor":"#dcddde","centerChannelBg":"#36393e","centerChannelColor":"#dcddde","newMessageSeparator":"#f75252","linkColor":"#7289da","buttonBg":"#43b581","buttonColor":"#ffffff","errorTextColor":"#fd5960","mentionHighlightBg":"#36393e","mentionHighlightLink":"#7289da","codeTheme":"monokai"}

Test Area - Tests/bugs outside of user stories
Test ID	Test Case	Test Procedure	Result	Tickets	Notes
70	Channel is archived when ending an incident with slash command	Set ExperimentalViewArchivedChannels to true or, from System Console > Site Configuration > User and Teams, set “Allow users to view archived channels” to true. Start a new incident using any method. Locate the channel in the LHS. End the incident using the `/incident end` command. Click “Confirm” in the confirmation dialog. Verify that the incident ended. Incident no longer appears in the RHS list. Status of the incident changed to “Ended” in the backstage. Verify that the incident channel is archived: In the LHS, verify the incident channel is listed with the archived icon. Running CLI command `./mattermost channel list [team-name]` shows the channel as '(archived)'.			Moved from 0.4
71	Channel is archived when ending an incident from RHS	Start a new incident using any method. Locate the channel in the LHS. End the incident from the RHS. Click “Confirm” in the confirmation dialog. Verify that the incident ended. Incident no longer appears in the RHS list. Status of the incident changed to “Ended” in the backstage. Verify that the incident channel is archived: In the LHS, verify the incident channel is listed with the archived icon. Running CLI command `./mattermost channel list [team-name]` shows the channel as '(archived)'.			Moved from 0.4
72	The incident channel shows up under archived channel once the incident is ended	On the LHS click “more” under Private Channels. Ensure “Show: Archived Channels” is selected in the dropdown. Verify the channels of the incidents ended in the above 2 tests are listed.			Moved from 0.4
73	Incident channels do not appear in LHS when archived channel display is turned off	Set ExperimentalViewArchivedChannels to false or, from System Console > Site Configuration > User and Teams, set “Allow users to view archived channels” to false. Switch to normal channel view. Verify that the channels of the incidents ended in the tests above do not appear on the LHS.			Moved from 0.4
74	Add a message indicating no checklist items in Incidents RHS			https://mattermost.atlassian.net/browse/MM-24502	Moved from 0.4
75	Support incident list pagination	Create a new team so that there are no incidents. Create 24 incidents. Launch the incident backstage. From the channel header, click the incident icon. In the incident RHS, click the playbook icon to launch the backstage. Click the “Incidents” tab on the LHS. Verify that all 24 incidents created in step 2 are displayed in the list on the same page. Verify there is no “Next” and “Previous” buttons at the bottom of the page. Create one more incident so that the total number of incidents are 25. In the incident backstage, verify that all 25 incidents are displayed in the same page. Verify there is no “Next” and “Previous” buttons at the bottom of the page. Create one more incident so that the total number of incidents are now 26. In the incident backstage, scroll to the bottom of the page. Verify there are 25 incidents displayed on the first incident list page. Verify there is no “Previous” button. Verify there is a “Next” button. Click on the “Next” button. Verify that page 2 of the incident lists page loads. Verify that there is only 1 incident in the 2nd page. Verify there is “Previous” button in the 2nd page. Create incidents so that there are now a total of 51 incidents. In the 2nd page of the incident list page in the backstage, verify there is “Previous” button and a “Next” button. Verify both “Previous” and “Next” button are functional.		https://mattermost.atlassian.net/browse/MM-24580	Moved from 0.4
76	Support incident list sorting on End Date	Create a few incidents at varying times. Launch the incident backstage to view the incident list. Verify that incidents are listed with the newest one on top by default. Click “End Date” in the header. Verify that the incident list is rearranged such that the last one that was ended is now at the top of the list, followed by other ‘Ended’ incidents in descending order of the time the incidents were ended, followed by the ‘Ongoing’ incidents (descending order of creation?) Verify that all other incident info are still associated with the incidents correctly. Click “End Date” again. Verify that the incident list is rearranged such that the first incident to end is now at the top of the list, followed by other ‘Ended’ incidents in ascending order of the time the incidents were ended, followed by the ‘Ongoing’ incidents (ascending order of creation?). Verify that all other incident info are still associated with the incidents correctly.		https://mattermost.atlassian.net/browse/MM-24581	Moved from 0.4
77	Support incident list sorting on Start Date	Continue from the test for “Support incident list sorting on End Date” Click “Start Date” in the header. Verify that the incident list is rearranged such that the first incident to get created is now at the top of the list, followed by other incidents (ongoing or ended) in ascending order of the time the incidents were created. Verify that all other incident info are still associated with the incidents correctly.		https://mattermost.atlassian.net/browse/MM-24581	Moved from 0.4

...

IR (v0.5.0) Bugs:

Jira Legacy

server	System JIRA
maximumIssues	20
columns	key,summary,type,assignee,reporter,status,resolution
jqlQuery	issuetype = Bug AND project = MM AND fixVersion = "IR (v0.5.0)"
serverId	fa8b0166-b019-31be-aef3-0e1e83e7ecff

Version	Old Version 5	New Version 6
Changes made by	Prapti Shrestha (Deactivated)	Prapti Shrestha (Deactivated)
Saved on	Jun 16, 2020	Jun 16, 2020

Versions Compared

Key

Document version 0.0

Status: Test development in progress

References

IR (v0.5.0) Bugs: