Page Comparison

Document version 0.1

Status: Test Plan ready for Review.

...

Test Area - Create stages when editing a playbook
Test ID	Test Case	Test Steps	Result	Notes
14	Playbook creator can edit playbook	Log in as user-0. Launch playbook backstage (using any method). Click the “New Playbook” button. Enter “P1” for Playbook Name. Click “Save Playbook”. Switch to a normal channel. Bring up the incident creation modal (using any method). Verify that the playbook dropdown has “P1”. From the playbook backstage, find P1. Click P1 to edit the playbook. Change the playbook name to “PB-Private”. Click “Save Playbook”. Verify that the playbook in the backstage shows up as “PB-Private”. Switch to a normal channel. Bring up the incident creation modal. Verify that the playbook dropdown does not have “P1” but “PB-Private”.
15	Any playbook member can edit playbook to add a new member	Continue from the above test. From the playbook backstage, find PB-Private. Click on the playbook to open the “Edit Playbook” view In the “Members” field, add `@user-1`. Log in as user-1. Bring up the incident creation modal. Verify that user-1 can see “PB-Private” in the playbook dropdown. Launch playbook backstage. Find “PB-Private” and click to open the “Edit Playbook” view. In the “Members” field, add `@user-2`. Click “Save Playbook”. As user-2, verify that “PB-Private” is available in the playbook dropdown of the incident creation modal.
16	Any playbook member can edit playbook to remove an existing member	Continue from the above test. Log in as user-2. Launch playbook backstage. Find “PB-Private” and click to open the “Edit Playbook” view. From the “Members” field, remove `@user-1`. As user-1, verify that “PB-Private” is not available in the playbook dropdown of the incident creation modal.
17	A playbook member cannot edit playbook to remove all the members of the playbook	Continue from the above test. As user-2, launch playbook backstage. Find “PB-Private” and click to open the “Edit Playbook” view. From the “Members” field, remove all users including user-0 and user-2. Verify that the playbook cannot be saved. Add user-1 to the Members field. Save playbook.		The “Save Playbook” button should stay inactive unless there is at least one member
18	Any playbook member can edit playbook to change the private/public incident setting	Continue from the above test. As user-1, launch the playbook backstage. Find “PB-Private” and click to open the edit view. Toggle the “Create Public Incident” to enable the setting. Save playbook. Click the playbook again to view the edit mode. Verify that the “Create Public Incident” setting is enabled.
19	Any playbook member can edit playbook to add a new stage	Continue from the above test. As user-1, launch the playbook backstage. Find “PB-Private” and click to open the edit view. Click `+ Add new stage`. Change the stage name from “New stage” to “Stage 2”. Save playbook. Click the playbook again to view the edit mode. Verify that the playbook contains “Default Stage” and “Stage 2” for stages.
20	A playbook can have multiple stages with the same stage name	As user-1, launch the playbook backstage. Click “New Playbook”. Enter “PB-New” for Playbook Name. Enter “Stage 1” as the 1st stage name. Click “Add new stage”. Enter “Stage 1” as the 2nd stage name. ??		Valid? Ian Tao (Unlicensed) confirm?
21	A playbook member can edit playbook to add a new checklist item to a stage added by themself	Continue from the above test. Launch playbook backstage. Find “PB-Private” from the playbook list. Under “Stage 1”, click “Add new checklist item”. Enter “S1-C1” as the checklist item. Click “Save Playbook”. From the playbook list in the backstage find “PB-Private”. Click to view the edit view. Verify that “Stage 1” has “S1-C1” as the checklist item. Switch to a normal channel view. Start an incident with “PB-Private” to verify the checklist item as been added to “Stage 1”.
22	Any playbook member can edit playbook to add a new checklist item to a stage added by a different member	Continue from the above test. Log in as user-2. Launch playbook backstage. Find “PB-Private” from the playbook list. Click to open edit view. Under “Stage 1”, click “Add new checklist item”. Enter “S1-U2” as the checklist item. Click “Save Playbook”. From the playbook list in the backstage find “PB-Private”. Click to view the edit view. Verify that “Stage 1” has “S1-U2” as the checklist item. Switch to a normal channel view. Start an incident with “PB-Private” to verify the checklist item has been added to “Stage 1”.
23	A playbook member cannot edit playbook such that the playbook name field is empty	Continue from the above test. Launch playbook backstage. Find “PB-Private” from the playbook list. Click to open edit view. Delete the playbook name “PB-Private”. Verify that the “Save Playbook” button becomes deactivate. Click on the “Save Playbook” button. Verify that the playbook cannot be saved, and the user is still in the edit view. Enter a space in the playbook name field. Repeat steps 5-7.
24	Any playbook member can reorder the checklist items within a stage	Continue from the above test. Launch playbook backstage. Find “PB-Private” from the playbook list. Click to open edit view. Under “Stage 1”, click the hamburger icon next to the checklist item “S1-C1” and drag it under “S1-U2”. Verify that “S1-C1” is successfully moved under “S1-U2”. Click the hamburger icon next to “S1-U2” and drag it above “S1-C1”. Verify that “S1-U2” is successfully moved under “S1-C1”. Switch to a normal channel view. Start an incident with “PB-Private” to verify the reordering was successful.
25	Any playbook member can reorder the checklist items within different stages	Continue from the above test. Launch playbook backstage. Find “PB-Private” from the playbook list. Click to open edit view. Under “Stage 1”, click the hamburger icon next to the checklist item “S1-U2” and drag it under the 2nd stage “Stage 2”. Verify that “S1-U2” is successfully moved under “Stage 2”. Switch to a normal channel view. Start an incident with “PB-Private” to verify the reordering was successful.
26	A playbook member cannot reorder the playbook such that the checklist items can be pulled outside a stage	Continue from the above test. Launch playbook backstage. Find “PB-Private” from the playbook list. Click to open edit view. Click the hamburger icon next to the checklist item “S1-C1” and drag it right above “Stage 1”. Verify that the checklist item does not move from its original spot under “Stage 1”. Drag and drop “S1-C1” outside stage area. Verify that the checklist item does not move from its original spot under “Stage 1”. Switch to a normal channel view. Start an incident with “PB-Private” to verify the order of the checklist items is normal.
27	Any playbook member can delete a checklist item	Continue from the above test. Log in as user-1. Launch playbook backstage. Find “PB-Private” from the playbook list. Click to open edit view. Under “Stage 2” find “S1-U2” and hover the mouse over so that the “X” appears next to it. Click the “X” for “S1-U2”. Verify that the checklist item “S1-U2” is deleted. Click “Save Playbook”. Click “PB-Private” to go to edit view. Verify that the checklist item “S1-U2” is not available in any stage. Switch to a normal channel view. Start an incident with “PB-Private” to verify that “S1-U2” is not available in any stage.
28	A playbook member can edit the playbook to delete all the checklist items such that all the stages can have no checklist item at all	Continue from the above test. Launch playbook backstage. Find “PB-Private” from the playbook list. Click to open edit view. Click the “X” next to all checklist items of all stages. Verify that all checklist items are deleted. Click “Save Playbook”. Switch to a normal channel view. Start an incident with “PB-Private” to verify that none of stages have any checklist items.
29	Any playbook member can reorder the stages	Continue from the above test. Launch playbook backstage. Find “PB-Private” from the playbook list. Click to open edit view. Add a new stage “Stage 3”. Click the hamburger icon next to “Stage 1” and drag it below “Stage 3”. Verify that “Stage 1” is successfully moved under “Stage 3”. Click the hamburger icon next to “Stage 3” and drag it above “Stage 2”. Verify that “Stage 3” is successfully moved above “Stage 2”. Switch to a normal channel view. Start an incident with “PB-Private” to verify the stage reordering was successful.
30	A playbook member cannot reorder the playbook such that the stages can be nested	Continue from the above test. Launch playbook backstage. Find “PB-Private” from the playbook list. Click to open edit view. Click the hamburger icon next to “Stage 1” and drag it under “Stage 3” to align it within the checklist items of “Stage 3”. Verify that “Stage 1” is not moved from its original position. Switch to a normal channel view. Start an incident with “PB-Private” to verify the stage reordering was not successful.		Verify that the stages cannot be stacked inside another stage
31	Any playbook member can delete a stage	Continue from the above test. Launch playbook backstage. Find “PB-Private” from the playbook list. Click to open edit view. Click the “X” button next to “Stage 3”. Verify that “Stage 3” is deleted. Save playbook. Switch to a normal channel view. Start an incident with “PB-Private” to verify that the incident created does not have “Stage 3”.
32	A playbook member cannot delete the last remaining stage such that the playbook has no stages at all	Continue from the above test. Launch playbook backstage. Find “PB-Private” from the playbook list. Click to open edit view. Click the “X” button next to “Stage 1”. Click the “X” button next to “Stage 2”. Verify that the “Save Playbook” button becomes inactive. Click on the “Save Playbook”. Verify that the user is still in the edit view of “PB-Private” and the action was not saved.
33	Any playbook member can delete playbook	Continue from the above test. Log in as user-2. Launch playbook backstage. Find “PB-Private” from the playbook list. Under “Actions” for the playbook, click the ellipses. Click “Delete”. Verify that a “Confirm Playbook Deletion” modal appears. Click “Delete Playbook”. Verify that “PB-Private” is not present in the playbook list. Switch to a normal channel view. Open up an incident modal. Verify that “PB-Private” is not available in the playbook dropdown.
34	A playbook member can create playbook with a large number of stages	Log in as user-1. Launch playbook backstage. Click “New Playbook”. Enter “PB-N1” as the playbook name. Click “Add new stage” 20 or more times to create a long list of stages. Click “Save Playbook”. Switch to a normal channel. Start an incident using “PB-N1” as the playbook. Verify that the Stages dropdown in the incident RHS has all the stages added in step 5. Verify the Stage dropdown displays the stages properly with scrollbar.		Verify playbook with a large number of stages in the edit page
35	A playbook member can create playbook with a large number of checklist items within the stages	Continue from the above test. Launch playbook backstage. Find “PB-N1” and click to go to edit view. For the first stage, add at least 20 checklist items. Save playbook. Switch to a normal channel. Start an incident using “PB-N1” as the playbook. In the incident RHS, ensure that the first stage is selected from the dropdown. Verify that all the checklist items added in step 3 are available.		Verify playbook with a large number of checklist items within the stages in the edit page
36	The components in the playbook edit page render normally	Verify the appearance of the components in the playbook edit page.

Test Area - Set active workflow stage
Test ID	Test Case	Test Steps	Result	Notes
37	An active stage is annotated with `Active`label in the RHS	Log in as user-1. Bring up the incident creation modal (using any method). Click the “Create a playbook” button. Enter “PB1” as the playbook name. Enter “S1” as the first stage. Add a new step and call it “S2”. Add another step and call it “S3”. Save playbook. Switch to a normal channel view. Start a new incident “I1” with “PB1”. In the incident RHS, verify that “S1” under “Stages” has an `Active`label next to it.
38	Non-active stages are not annotated with `Active` labels	Continue with the above test. From the incident RHS for “I1”, click the “Stages” dropdown menu. Verify that “S2” and “S3” don’t have `Active`label next to them.
39	Selecting a non-active stage from the RHS dropdown shows a `Make Active` option prompt	Continue with the above test. From “Stages” in the incident RHS for “I1”, select “S2”. Verify a “Make Active” button appears above the dropdown box.
40	Incident commander can set a different stage as `Active` in an ongoing incident	Continue with the above test. Click the “Make Active” button. Verify that there is now an `Active` label next to “S2”. Click the “Stages” dropdown. Verify that there is no longer an `Active` label next to “S1”.
41	Workflow member can set a different stage as `Active` in an ongoing incident	Continue with the above test. Invite user-2 to the “I1” incident channel. Log in as user-2. From the “Stages” in the incident RHS for “I1”, select “S3”. Verify a “Make Active” button appears above the dropdown box. Click the “Make Active” button. Verify that there is now an `Active` label next to “S3”. Verify that there is no longer an `Active` label next to “S1” or “S2”. Log in as user-1. Verify that “S3” has an `Active` label next to it.
42	Workflow member cannot set a different stage as `Active` in an incident that has been ended	Continue with the above test. As user-1, end the incident “I1”. From the “Stages” in the incident RHS for “I1”, select “S2”. Verify that “Make Active” button does not appear above the dropdown box (or even if it appears, it’s greyed out?)		Ian Tao (Unlicensed) confirm?
43	Workflow member can set a different stage as `Active` in an incident that has been restarted	Continue with the above test. From the incident RHS, click “Restart Incident”. Verify that the incident has restarted: The “Restart Incident” button has changed to “End Incident”. Select “S2” from the Stages dropdown in the RHS. Click the “Make Active” button. Verify that “S2” has the `Active` label next to it.
44	Plugin posts a message in the incident channel when changing an active stage	Continue from the above test. Verify that setting “S2” as the active stage created a post that the stage has been set as active in the incident channel. Verify that the post were also created in the former tests while setting different stages as active.
45	Workflow member views the active stage by default in incident RHS	Continue with the above test. Log in as user-2. Open the RHS for “I1”. Verify that when the RHS for “I1” opens, the Stages dropdown shows “S2” by default.
46	When an active stage is changed by a different user, the stage selected in the RHS remains as is but without the `Active` annotation	Continue with the above test. While viewing the “I1” RHS as user-2, have user-1 set “S1” as the active stage. Verify that user-2 continues to see “S2” still in the RHS but now without the `Active` label.
47	In case of only one stage, the stage is set as active by default	As user-1, create a new playbook “P2”. Have only one stage “S1” in “P2”. Save playbook. Switch to a normal channel view. Start a new incident “I2” with “P2”. Verify that when “I2” is successfully started, the RHS shows the “Stages” dropdown shows “S1 active” as the default stage.
48	In case of multiple stages, the first stage is set as active by default	From the playbook backstage, create a new playbook “P3”. Add stages “S1”, “S2”, “S3” and “S4”. Save playbook. Switch to normal channel view. Start an incident “I3” using “P3”. When “I3” is successfully started, verify that the RHS shows “S1” as the active stage in the dropdown.
49	Switching between the stages does not set the stage as active	Continue from the above test. From the “Stages” dropdown, select “S2”. Verify that when “S2” loads in the RHS, there is no `Active` label. From the dropdown, select “S3”. Verify that when “S3” loads in the RHS, there is no `Active` label. From the dropdown, select “S4”. Verify that when “S4” loads in the RHS, there is no `Active` label. From the dropdown, select “S1”. Verify that when “S1” loads in the RHS, there is `Active` label.
50	Selecting an active stage from the RHS dropdown does not show a `Make Active` option prompt	Continue from the above test. Select “S2” from the incident RHS. Verify that `Make Active` option appears above the “Stages” dropdown box. Select “S1” from the incident RHS. Verify that when “S1” is selected, the `Make Active` option appears above the Stages dropdown.
51	Workflow member can check items off of stages that are active	Continue from the above test. Launch playbook backstage. Find “P3” and click to edit. Add checklist items in all the stages of the playbook “P3”. Switch to a normal channel view. Start a new incident “I4” with playbook P3. From the incident RHS, set “S2” as the active stage. Click on the checkboxes of items in “S2” to check off. Verify that the items in “S2” are successfully checked off.
52	Workflow member can uncheck items of stages that are not active	Continue from the above test. Ensure that “S1” is not an active stage for “I4”. From the incident RHS for “I4”, select “S1”. Click on the checkboxes of items in “S1” to check off. Verify that the items in “S1” are successfully checked off.
53	Workflow member can check off items of an ongoing incident			Covered by the above test
54	Workflow member cannot checkoff items of an ended incident	Continue from the above test. From the incident RHS for “I4” click “End Incident”. Ensure that “I4” has been ended successfully. Select “S3” from the incident RHS. Click on the checkboxes of the items in “S3”. Verify that the items cannot get checked off (checkboxes are inactive)?		Valid? Ian Tao (Unlicensed) confirm?
55	Workflow member can checkoff items of a restarted incident	Continue from the above test. From the incident RHS for “I4” click “Restart Incident”. Ensure that “I4” has been restarted successfully. Select “S3” from the incident RHS if not already selected. Click on the checkboxes of the items in “S3”. Verify that the items are checked off successfully.

...

Test Area - Assign step owners
Test ID	Test Case	Test Steps	Result	Notes
65	Checklist item in the RHS has a dropdown for assignee	Continue from the above tests. As user-1 start a new incident “N1” using “P5” from the above tests. In the incident RHS for “N1”, verify that the checklist items for “S1” has a “No Assignee” (assignee) dropdown field under “C1”. Select “S2” from the “Stages” dropdown. Since “S2” has no checklist item, verify there is no assignee dropdown field. Select “S3” from the “Stages” dropdown. Verify that all the three checklist items for “S3” have the assignee dropdown fields under the checklist items.
66	By default, checklist item does not have any assignee	Continue from the above tests. Verify that non of the checklist items for “N1”, “S1”, “S2” and “S3”, do not have any assignee on the checlist items.
67	The assignee dropdown shows the list of workflow members	Continue from the above tests. While “S3” is selected, click on the “No Assignee” dropdown for “Ca”. Verify that dropdown opens up with user-1 in the list. Verify there is a search attached to the dropdown when it opens.
68	The assignee dropdown does not show users that are not workflow members	Continue from the above test. In the dropdown, verify that there is no other user listed other than user-1. In the search box for “No assignee”, type the user name for user-2. Verify that user-2 does not appear in the dropdown.
69	A checklist item can be checked off without an assignee	Continue from the above test. From the stages dropdown, select “S1”. Ensure that the checklist items of “S1” have no assignees. Click on the “C1” and “C2” checkboxes. Verify that the items are checked off.
70	A checklist item can be unchecked without an assignee	Continue from the above test. Continue with “S1” selected. Ensure that the checklist items of “S1” have no assignees. Uncheck the previously checked “C1” and “C2”. Verify that the items are unchecked.
71	Workflow member can select him/herself as the checklist assignee	Continue from the above test. Continue with “S1” selected. For item “C1” click the assignee dropdown. Select user-1 (current user) from the list. Verify that the assignee dropdown field shows user-1 as the assignee.
72	Workflow member can select a different workflow member as the checklist assignee	Continue from the above test. Invite user-2 in the “N1” incident channel. In the “N1” incident RHS, under “C2”, click the assignee dropdown. Verify that user-2 is now available in the list. Select user-2. Verify that user-2 is now assigned checklist item “C2”.
73	Workflow member can change assignee from him/herself to ‘No Assignee’ for a checklist item	Continue from the above test. Switch to user-2. Find the “N1” incident channel navigate to it. From the “N1” incident RHS, select “S1” if not already selected as the stage. Click the assignee dropdown for “C2”. Verify there is a “No Assignee” option available under the search bar. Click on “No Assignee”. Verify that “C2” has no assignee.
74	Workflow member can change another workflow member to ‘No Assignee’ for a checklist item	Continue from the above test. As user-2, assign checklist item “C2” to the him/herself. Switch to user-1. Find incident channel for “N1”. Navigate to it. From the incident RHS, select stage “S1” if not already selected. Ensure user-2 is the assignee for “C2”. Under “C2”, click the assignee dropdown. Click on “No Assignee”. Verify that the item has no assignee.
75	Plugin posts a message in incident channel when an assignee is selected	Continue from the above tests. Verify that when assigning a checklist item to a workflow member generates a plugin message to notify the action in the center channel.
76	Plugin posts a message in incident channel when ‘No Assignee’ is selected	Continue from the above tests. Verify that when selecting “No Assignee” for a checklist item, the plugin generates a message to notify the action in the center channel.
77	Workflow member cannot select multiple assignees	Continue from the above tests. From the incident RHS for “N1”, click the assignee dropdown for “C1”. Click user-1. Click user-2. Verify that clicking a different user highlight only that user in the dropdown. Press and hold the CMD (or Ctrl) button and click on user-2. Verify that clicking user-2 highlight only user-2. Verify that more than 1 user cannot be selected as an assignee for the checklist item.
78	Workflow member cannot select a different assignee in an incident that is ended	Continue from the above tests. End incident “N1”. Once the incident has ended, click on the assignee dropdown for “C1”. Verify that the assignee dropdown does not open up anymore (??). (Even if it opens up, verify that a different user cannot be assigned to the checklist item).		Valid for ended incident?
79	Workflow member can select a different assignee in an incident that is restarted	Continue for the above tests. Restart incident “N1”. Once the incident has restarted, click on the assignee dropdown for “C2”. Verify that the assignee dropdown is active and can be expanded. Select user-2 as the assignee. Verify that user-2 is successfully assigned “C2”.
80	Assignee does not change when a workflow member leaves the workflow channel	Continue form the above tests. Log in as user-2. Find and navigate to the “N1” incident channel. Verify that user-2 is assigned to checklist item “C2” (under stage “S1”). In the center channel post textbox, type “/leave” and hit enter to leave the channel. Verify that user-2 cannot find the “N1” incident channel. Log out. Log in as user-1. Find the “N1” incident channel and navigate to it. Verify that user-2 is still the assignee for “C2” under “S1”.
81	The assignee dropdown list gets updated when a workflow member is kicked from the channel	Continue from the above tests. Invite user-2 to “N1” incident channel again. From the incident RHS, select stage “S3”. Assign item “Ca” to user-2. In the center channel post textbox, type “/kick” and hit enter to remove user-2 from the channel. Under “S3”, click on the assignee list for “Ca”. Verify that user-2 does now appear in the assignee list.
82	Assignee does not change when a workflow member is kicked from the workflow channel	Continue from the above tests. Select stage “S1”. Verify that “C2” still shows user-2 as the assignee. Select stage “S3”. Verify that “Ca” still shows user-2 as the assignee.
83	The assignee dropdown list gets updated when a workflow member leaves the channel	Continue from the above tests. With user-2 still removed from the incident channel, click the assignee dropdown for “Cc” under stage “S3”. Verify that user-2 is not in the assignee list.
84	The assignee dropdown list gets updated when a new member is added to the workflow channel	Continue from the above tests. Invite user-2 back to the “N1” incident channel. In the incident RHS, click the assignee dropdown for “Cc”. Verify that user-2 is now available in the assignee list. Assign “Cc” to user-2
85	An assignee can checkoff a checklist item	Continue from the above tests. Log in as user-2. From the “N1” incident RHS, find “Cc” item under “S3”. Click the checkbox for “Cc”. Verify that the checklist item is successfully checked off.
86	An assignee can uncheck a checklist item	Continue from the above tests. As user-2, uncheck item “Cc”. Verify that the checklist item is successfully unchecked.
87	A non-assignee can checkoff a checklist item	Continue from the above tests. As user-2 uncheck all item assigned to user-2. Log out. Log in as user-1. Find all items assigned to user-2. Click the checkboxes for items assigned to user-2. Verify that the items are successfully checked off.
88	A non-assignee can uncheck a checklist item	Continue from the above tests. As user-1, uncheck all the boxes for items assigned to user-2. Verify that the items are successfully unchecked.
89	Anything in the backstage about assignee?			At the moment you can’t assign an item in the backstage, but that seems useful. Ian Tao (Unlicensed) ?

Test Area (v0.7) - Attach a slash command to each step when editing playbook
Test ID	Test Case	Test Steps	Result	Notes
90	A newly added checklist item in a playbook has a slash command field	Log in as user-1. Launch playbook backstage. Click “New Playbook”. Enter “PB-N1” as the playbook name. Under the preexisting “Default Stage”, click “Add new checklist item”. Enter “I-1” as the checklist item name. Hit enter. Verify that two new fields, one for slash command, and the other for step description appear underneath. Add more checklist items. Verify that every new checklist item added has the slash command and step description fields.
91	A playbook can be edited to add a slash command to any checklist item	Continue from the above test. Type `/away` in the slash command field for one of the checklist items. Click “Save Playbook”. Verify that the playbook is saved successfully. Type other valid slash commands in the fields for other checklist items. Verify that each slash command filed can successfully save the slash commands.
92	A checklist item configured with a slash command shows the slash command for that item in the RHS	Continue from the above tests. Switch to a normal channel. Start a new incident using “PB-N1”. Open the incident RHS. Verify that all checklist items configured with slash commands in the above tests, show the slash command under the checklist item.
93	A checklist item can only be configured with one slash command at most	Create a new playbook “P1a”. Add a checklist item “C1”. In the slash command field for “C1”, enter the following: `/away /online /shrug`. Verify that a warning appears that the checklist item can only be configured with one slash command.		Valid? I think this should be allowed (there’s no technical reason it can’t). Ian Tao (Unlicensed) ?
94	Typing an invalid slash command			There’s nothing preventing the user from typing an invalid slash command.

Test Area (v0.7) - Browse existing slash commands in playbook editing
Test ID	Test Case	Test Steps	Result	Notes
95	Typing a `/` in the slash command field brings up a list of existing slash commands	Log in as user-1. Launch playbooks backstage. Click “New Playbook”. Enter “PBa” as the playbook name. Edit the name of the default stage to “S1”. Click “Add new stage”. Enter “C1” for checklist item name. In the slash command field, enter `/` Verify that a autocomplete list of all available slash commands pop up as soon as entering `/`.
96	Typing a non-/ character in the slash command field?			Should this be allowed?
97	Selecting from the slash command list auto completes the slash command	Continue from the above tests. In the slash command field, enter `/`. From the autocomplete list, click `/dnd`. Verify that the slash command field is autocompleted with `/dnd`.
98	Typing a non-existing slash command shows a “invalid slash command” error			Valid? We do not validate the slash commands at the moment.
99	The slash command field can be left empty	Continue from the above tests. Remove the contents of “C1” so that the slash command field is empty. Click “Save Playbook”. Verify that the playbook is saved successfully.

Test Area (v0.7) - Execute the attached slash command with a button click The tests below might need to get adjusted (or added) to match Revised step execution: https://mattermost.atlassian.net/browse/MM-27012
Test ID	Test Case	Test Steps	Result	Notes
100	A checklist item configured without a slash command does not have a `Run` button next to it	Log in as user-1. Launch playbook backstage. Click “New Playbook”. Enter “Apb” as the playbook name. Change the name of “Default Stage” to “S1”. Click “Add new checklist item”. Enter “C1” as the item name. Don’t add anything for the slash command. Save playbook. Switch to normal channel view. Start a new incident using “Apb”. Once the incident is started, in the incident RHS, examine the checklist item “C1” under “S1”. Verify that “C1” does not have any “Run” button.
101	A checklist item configured with a valid slash command has a `Run` button next to it	Continue from the above test. Launch playbook. Find and click “Apb” to edit. Add slash command `/away` for “C1”. Switch to normal channel view. Start a new incident using “Apb”. Once the incident is started, in the incident RHS, verify that “C1” show `/away` under it which has a `Run` button next to it.
102	A checklist item configured with an invalid slash command does not have a `Run` button next to it	Continue from the above test. Launch playbook backstage. Find and click “Apb” to edit. Add a new checklist item “C2” under “S1”. Add slash command `invalid text` for “C2”. Save playbook. Switch to normal channel view. Start a new incident using “Apb”. Once the incident has started, find “C2” under “S1”. Verify that the slash command for “C2” doesn’t have a `Run` button next to it.		This doesn’t happen currently. It would require us to spend mana on validating the slash command.
103	A checklist item configured with a nonexistent slash command does not have a `Run`button next to it	Continue from the above test. Launch playbook backstage. Find and click “Apb” to edit. Add a new checklist item “C3” under “S1”. Add slash command `/invalidcommand` for “C3”. Save playbook. Switch to normal channel view. Start a new incident “Ia1” using “Apb”. Once the incident has started, find “C3” under “S1”. Verify that the slash command for “C3” doesn’t have a `Run` button next to it.
104	Clicking the `Run` button for a checklist slash command runs the slash command	Continue from the above test. Open up the incident RHS for “Ia1”. Find “C1” under stage “S1”. Click the `Run` button next to “C1”. Verify that clicking the `Run` button executes so that the status of user-1 is now set to “away”.
105	Plugin posts a message in the incident channel when a slash command `Run`is clicked	Continue from the above test. Verify that plugin posts a message in the “Ia1” incident channel to notify that the slash command for “C1” has been run.		A message that the checklist item slash command was run (not the slash command system message) Ian Tao (Unlicensed) should we make a ticket for this feature? We currently don’t do it, but it makes sense.
106	Running a slash command with system message attached to it post the slash command system message in the incident channel	Continue from the above test. Verify that the system message for the `/away` command “System: You are now away (Only visible to you)” is posted in the incident channel.
107	In case of two valid slash commands, the running the command from the checklist item will only run the first command successfully	Continue from the above test. Launch playbook backstage. Find and click “Apb” to edit. Under “S1” add a new checklist item “C5”. Add the following for “C5’s” slash command: `/online /away`. Switch to normal channel view. Start a new incident using “Apb”. Once the incident has been started, find “C5” in the incident RHS. Click the `Run` button next to “C5”. Verify that the status of user-1 is now set to “online” and not “away”.		This is in sync with the core feature behavior Seems correct to me (ChrisP)
108	Running an invalid slash command from RHS checklist shows an ‘invalid slash command’ error	Depends on the steps in #102.		Like core feature?
109	A slash command can be run multiple times from the RHS checklist	Continue from the above tests. Launch playbook backstage. Find and click “Apb” to edit. Under “S1” add a new checklist item “C6”. Add `/shrug` as the slash command for “C6”. Switch to normal channel view. Start a new incident using “Apb”. Once the incident has been started, find “C6” in the incident RHS. Click the `Run` button for “C6”. Verify that the `/shrug` command is executed successfully and a shrug message is posted in the center channel. Repeat steps 8-9 multiple times.
110	A plugin post notifies when a slash command fails to run successfully	Verify that when a slash command fails to execute by clicking the `Run` button, the plugin posts a message in the center channel notifying that the execution has failed.

...

Version	Old Version 12	New Version 13
Changes made by	Prapti Shrestha (Deactivated)	Christopher Poile
Saved on	Aug 18, 2020	Aug 18, 2020

Versions Compared

Key

Document version 0.1

Status: Test Plan ready for Review.