Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Document version 0.0

Status: Test Development in Progress

...

A non-assignee can uncheck a checklist item

Test Area - Set active workflow stage

Test ID

Test Case

Test Steps

Result

Notes

37

An active stage is annotated with Activelabel in the RHS

  1. Log in as user-1.

  2. Bring up the incident creation modal (using any method).

  3. Click the “Create a playbook” button.

  4. Enter “PB1” as the playbook name.

  5. Enter “S1” as the first stage.

  6. Add a new step and call it “S2”.

  7. Add another step and call it “S3”.

  8. Save playbook.

  9. Switch to a normal channel view.

  10. Start a new incident “I1” with “PB1”.

  11. In the incident RHS, verify that “S1” under “Stages” has an Activelabel next to it.

38

Non-active stages are not annotated with Active labels

Continue with the above test.

  1. From the incident RHS for “I1”, click the “Stages” dropdown menu.

  2. Verify that “S2” and “S3” don’t have Activelabel next to them.

39Incident

commander can set a different stage as Active in an ongoing incidentSelecting a non-active stage from the RHS dropdown shows a Make Active option prompt

Continue with the above test.

  1. From “Stages” in the incident RHS for “I1”, select “S2”.

  2. Verify a “Make Active” button appears above the dropdown box.

40

Incident commander can set a different stage as Active in an ongoing incident

Continue with the above test.

  1. Click the “Make Active” button.

  2. Verify that there is now an Active label next to “S2”.

  3. Click the “Stages” dropdown.

  4. Verify that there is no longer an Active label next to “S1”.

4041

Workflow member can set a different stage as Active in an ongoing incident

Continue with the above test.

  1. Invite user-2 to the “I1” incident channel.

  2. Log in as user-2.

  3. From the “Stages” in the incident RHS for “I1”, select “S3”.

  4. Verify a “Make Active” button appears above the dropdown box.

  5. Click the “Make Active” button.

  6. Verify that there is now an Active label next to “S3”.

  7. Verify that there is no longer an Active label next to “S1” or “S2”.

  8. Log in as user-1.

  9. Verify that “S3” has an Active label next to it.

4142

Workflow member cannot set a different stage as Active in an incident that has been ended

Continue with the above test.

  1. As user-1, end the incident “I1”.

  2. From the “Stages” in the incident RHS for “I1”, select “S2”.

  3. Verify that “Make Active” button does not appear above the dropdown box (or even if it appears, it’s greyed out?)

4243

Workflow member can set a different stage as Active in an incident that has been restarted

Continue with the above test.

  1. From the incident RHS, click “Restart Incident”.

  2. Verify that the incident has restarted: The “Restart Incident” button has changed to “End Incident”.

  3. Select “S2” from the Stages dropdown in the RHS.

  4. Click the “Make Active” button.

  5. Verify that “S2” has the Active label next to it.

4344

Plugin posts a message in the incident channel when changing an active stage

Continue from the above test.

  1. Verify that setting “S2” as the active stage created a post that the stage has been set as active in the incident channel.

  2. Verify that the post were also created in the former tests while setting different stages as active.

4445

Workflow member views the active stage by default in incident RHS

Continue with the above test.

  1. Log in as user-2.

  2. Open the RHS for “I1”.

  3. Verify that when the RHS for “I1” opens, the Stages dropdown shows “S2” by default.

4546

When an active stage is changed by a different user, the stage selected in the RHS remains as is but without the Active annotation

Continue with the above test.

  1. While viewing the “I1” RHS as user-2, have user-1 set “S1” as the active stage.

  2. Verify that user-2 continues to see “S2” still in the RHS but now without the Active label.

4647

In case of only one stage, the stage is set as active by default

  1. As user-1, create a new playbook “P2”.

  2. Have only one stage “S1” in “P2”.

  3. Save playbook.

  4. Switch to a normal channel view.

  5. Start a new incident “I2” with “P2”.

  6. Verify that when “I2” is successfully started, the RHS shows the “Stages” dropdown shows “S1 active” as the default stage.

4748

In case of multiple stages, the first stage is set as active by default

  1. From the playbook backstage, create a new playbook “P3”.

  2. Add stages “S1”, “S2”, “S3” and “S4”.

  3. Save playbook.

  4. Switch to normal channel view.

  5. Start an incident “I3” using “P3”.

  6. When “I3” is successfully started, verify that the RHS shows “S1” as the active stage in the dropdown.

4849

Switching between the stages does not set the stage as active

Continue from the above test.

  1. From the “Stages” dropdown, select “S2”.

  2. Verify that when “S2” loads in the RHS, there is no Active label.

  3. From the dropdown, select “S3”.

  4. Verify that when “S3” loads in the RHS, there is no Active label.

  5. From the dropdown, select “S4”.

  6. Verify that when “S4” loads in the RHS, there is no Active label.

  7. From the dropdown, select “S1”.

  8. Verify that when “S1” loads in the RHS, there is Active label.

4950

Selecting a non-an active stage from the RHS dropdown shows does not show a Make Active option prompt

Covered by #39

50

Selecting an active stage from the RHS dropdown does not show a Make Active option promptContinue from the above test.

  1. Select “S2” from the incident RHS.

  2. Verify that Make Active option appears above the “Stages” dropdown box.

  3. Select “S1” from the incident RHS.

  4. Verify that when “S1” is selected, the Make Active option appears above the Stages dropdown.

51

Workflow member can check items off of stages that are active

52

Workflow member can uncheck items of stages that are not active

53

Workflow member can check off items of an ongoing incident

54

Workflow member cannot checkoff items of an ended incident

55

Workflow member can checkoff items of a restarted incident

Test Area - View steps in stages during a workflow

Test ID

Test Case

Test Steps

Result

Notes

56

The Stages dropdown in the RHS has all the stages for that incident

57

Selecting a different the stage in the RHS shows the checklist corresponding to that stage

58

Saving a playbook with only one stage and leaving the stage name empty, will create an incident with stage “Default Stage”

59

Any workflow member can switch between the stages in the RHS in an ongoing incident

60

Any workflow member can switch between the stages in the RHS in an incident that has been ended

61

Any workflow member can switch between the stages in the RHS in an incident that has been restarted

62

Selecting a different stage will not change the default stage view upon page refresh

Refreshing the page or navigating back to the incident channel will always show the Active stage in the RHS and not the stage selected earlier

63

Selecting a different stage will not change the stage view for a different workflow member

Test Area - Assign step owners

Test ID

Test Case

Test Steps

Result

Notes

64

Checklist item in the RHS has a dropdown for assignee

65

The assignee dropdown shows the list of workflow members

66

The assignee dropdown does not show users that are not workflow members

67

By default, checklist item does not have any assignee

68

A checklist item can be checked off without an assignee

69

A checklist item can be unchecked without an assignee

70

Workflow member can select him/herself as the checklist assignee

71

Workflow member can select a different workflow member as the checklist assignee

72

Workflow member can change assignee from him/herself to ‘No Assignee’ for a checklist item

73

Workflow member can change another workflow member to ‘No Assignee’ for a checklist item

74

Plugin posts a message in incident channel when an assignee is selected

75

Plugin posts a message in incident channel when ‘No Assignee’ is selected

76

Workflow member cannot select multiple assignees

77

Workflow member cannot select a different assignee in an incident that is ended

78

Workflow member can select a different assignee in an incident that is restarted

79

Assignee does not change when a workflow member leaves the workflow channel

80

Assignee does not change when a workflow member is kicked from the workflow channel

81

The assignee dropdown list gets updated when a new member is added to the workflow channel

82

The assignee dropdown list gets updated when a workflow member leaves the channel

83

The assignee dropdown list gets updated when a workflow member is kicked from the channel

84

An assignee can checkoff a checklist item

85

An assignee can uncheck a checklist item

86

A non-assignee can checkoff a checklist item

87

Continue from the above test.

  1. Launch playbook backstage.

  2. Find “P3” and click to edit.

  3. Add checklist items in all the stages of the playbook “P3”.

  4. Switch to a normal channel view.

  5. Start a new incident “I4” with playbook P3.

  6. From the incident RHS, set “S2” as the active stage.

  7. Click on the checkboxes of items in “S2” to check off.

  8. Verify that the items in “S2” are successfully checked off.

52

Workflow member can uncheck items of stages that are not active

Continue from the above test.

  1. Ensure that “S1” is not an active stage for “I4”.

  2. From the incident RHS for “I4”, select “S1”.

  3. Click on the checkboxes of items in “S1” to check off.

  4. Verify that the items in “S1” are successfully checked off.

53

Workflow member can check off items of an ongoing incident

Covered by the above test

54

Workflow member cannot checkoff items of an ended incident

Continue from the above test.

  1. From the incident RHS for “I4” click “End Incident”.

  2. Ensure that “I4” has been ended successfully.

  3. Select “S3” from the incident RHS.

  4. Click on the checkboxes of the items in “S3”.

  5. Verify that the items cannot get checked off (checkboxes are inactive)?

Valid?

55

Workflow member can checkoff items of a restarted incident

Continue from the above test.

  1. From the incident RHS for “I4” click “Restart Incident”.

  2. Ensure that “I4” has been restarted successfully.

  3. Select “S3” from the incident RHS if not already selected.

  4. Click on the checkboxes of the items in “S3”.

  5. Verify that the items are checked off successfully.

Test Area - View steps in stages during a workflow

Test ID

Test Case

Test Steps

Result

Notes

56

The Stages dropdown in the RHS has all the stages for that incident

Covered by #34

57

Selecting a different the stage in the RHS shows the checklist corresponding to that stage

  1. As user-1, launch playbook backstage.

  2. Create a new playbook “P5”.

  3. Add stage “S1”.

  4. Under “S1”, add the following checklist items:

    1. “C1” with slash command /away.

    2. “C2” (no slash command).

  5. Add stage “S2” (don’t add any checklist item).

  6. Add stage “S3”.

  7. Under “S3”, add the following checklist items:

    1. “Ca”

    2. “Cb”

    3. “Cc”.

  8. Switch to a normal channel view.

  9. Start an incident “I5” using “P5”.

  10. From the incident RHS for I5, while “S1” is selected, verify that the checklist items it contains are “C1” (with the option to run the /away command), and “C2”.

  11. Now from the “Stages” dropdown, select “S2”.

  12. Verify that “S2” has no checklist items under the dropdown.

  13. Select “S3”.

  14. Verify that “S3” has a checklist with “Ca”, “Cb” and “Cc”.

58

Saving a playbook with only one stage and leaving the stage name empty, will create an incident with stage “Default Stage”

  1. Launch the playbook backstage.

  2. Click “New Playbook”.

  3. Enter “P6” for the playbook name.

  4. Do not change anything else (there should already be a stage “Default Stage”).

  5. Click “Save Playbook”.

  6. Switch to a normal channel view.

  7. Start a new incident “I6” with “P6”.

  8. Open up the RHS for “I6”.

  9. Verify that the selected active stage is called “Default Stage” in the dropdown box.

59

Any workflow member can switch between the stages in the RHS in an ongoing incident

Continue from the above test.

  1. As user-1, launch playbook backstage.

  2. Select “P5” and click to edit.

  3. Under “Members”, add user-2.

  4. Save playbook.

  5. Log in as user-2.

  6. Start a new incident “I7” with “P5”.

  7. From the “I7” incident RHS, select “S3”.

  8. Click the checkboxes to checkoff items.

  9. Verify that the items under “S3” are successfully checked off.

60

Any workflow member can switch between the stages in the RHS in an incident that has been ended

Continue from the above test.

  1. As user-1, end incident “I7”.

  2. Switch to user-2.

  3. From the “I7” incident RHS, click on the “Stages” dropdown.

  4. Select “S1”.

  5. Verify that the checklist for “S1” is loaded.

  6. Select “S2”.

  7. Verify that the checklist for “S2” is loaded.

  8. Select “S3”.

  9. Verify that the checklist for “S3” is loaded.

61

Any workflow member can switch between the stages in the RHS in an incident that has been restarted

Continue from the above test.

  1. As user-2, restart incident “I7”.

  2. Switch to user-1.

  3. From the “I7” incident RHS, click on the “Stages” dropdown.

  4. Select “S1”.

  5. Verify that the checklist for “S1” is loaded.

  6. Select “S2”.

  7. Verify that the checklist for “S2” is loaded.

  8. Select “S3”.

  9. Verify that the checklist for “S3” is loaded.

62

Selecting a different stage will not change the default active stage view upon page refresh

Continue from the above test.

  1. As user-1, set “S3” as the active stage.

  2. Select “S1” from the RHS.

  3. Verify that the checklist for “S1” are loaded in the RHS.

  4. Navigate to a different channel.

  5. Navigate back to the “I7” incident channel.

  6. Verify that “S3” is selected in the “Stages” dropdown box.

  7. Verify that the checklist for “S3” is loaded in the RHS.

  8. Select “S2”.

  9. Refresh the channel.

  10. Verify that “S3” is selected in the “Stages” dropdown box.

  11. Verify that the checklist for “S3” is loaded in the RHS.

Refreshing the page or navigating back to the incident channel will always show the Active stage in the RHS and not the stage selected earlier

63

Selecting a different stage will not change the stage view for a different workflow member

Continue from the above test.

  1. Add user-2 to the incident channel of “I7”.

  2. While user-1 is viewing the incident channel for “I7”, have user-2 switch between the stages in the “I7” RHS.

  3. Verify that user-1 continues to see only the active stage in the incident RHS and that user-2 switching between the stages has no effect on user-1’s RHS view.

Test Area - Assign step owners

Test ID

Test Case

Test Steps

Result

Notes

64

Checklist item in the RHS has a dropdown for assignee

Continue from the above tests.

  1. As user-1 start a new incident “N1” using “P5” from the above tests.

  2. In the incident RHS for “N1”, verify that the checklist items for “S1” has a “No Assignee” (assignee) dropdown field under “C1”.

  3. Select “S2” from the “Stages” dropdown.

  4. Since “S2” has no checklist item, verify there is no assignee dropdown field.

  5. Select “S3” from the “Stages” dropdown.

  6. Verify that all the three checklist items for “S3” have the assignee dropdown fields under the checklist items.

65

By default, checklist item does not have any assignee

Continue from the above tests.

  1. Verify that non of the checklist items for “N1”, “S1”, “S2” and “S3”, do not have any assignee on the checlist items.

66

The assignee dropdown shows the list of workflow members

Continue from the above tests.

  1. While “S3” is selected, click on the “No Assignee” dropdown for “Ca”.

  2. Verify that dropdown opens up with user-1 in the list.

  3. Verify there is a search attached to the dropdown when it opens.

67

The assignee dropdown does not show users that are not workflow members

Continue from the above test.

  1. In the dropdown, verify that there is no other user listed other than user-1.

  2. In the search box for “No assignee”, type the user name for user-2.

  3. Verify that user-2 does not appear in the dropdown.

68

A checklist item can be checked off without an assignee

Continue from the above test.

  1. From the stages dropdown, select “S1”.

  2. Ensure that the checklist items of “S1” have no assignees.

  3. Click on the “C1” and “C2” checkboxes.

  4. Verify that the items are checked off.

69

A checklist item can be unchecked without an assignee

Continue from the above test.

  1. Continue with “S1” selected.

  2. Ensure that the checklist items of “S1” have no assignees.

  3. Uncheck the previously checked “C1” and “C2”.

  4. Verify that the items are unchecked.

70

Workflow member can select him/herself as the checklist assignee

Continue from the above test.

  1. Continue with “S1” selected.

  2. For item “C1” click the assignee dropdown.

  3. Select user-1 (current user) from the list.

  4. Verify that the assignee dropdown field shows user-1 as the assignee.

71

Workflow member can select a different workflow member as the checklist assignee

Continue from the above test.

  1. Invite user-2 in the “N1” incident channel.

  2. In the “N1” incident RHS, under “C2”, click the assignee dropdown.

  3. Verify that user-2 is now available in the list.

  4. Select user-2.

  5. Verify that user-2 is now assigned checklist item “C2”.

72

Workflow member can change assignee from him/herself to ‘No Assignee’ for a checklist item

Continue from the above test.

  1. Switch to user-2.

  2. Find the “N1” incident channel navigate to it.

  3. From the “N1” incident RHS, select “S1” if not already selected as the stage.

  4. Click the assignee dropdown for “C2”.

  5. Verify there is a “No Assignee” option available under the search bar.

  6. Click on “No Assignee”.

  7. Verify that “C2” has no assignee.

73

Workflow member can change another workflow member to ‘No Assignee’ for a checklist item

Continue from the above test.

  1. As user-2, assign checklist item “C2” to the him/herself.

  2. Switch to user-1.

  3. Find incident channel for “N1”.

  4. Navigate to it.

  5. From the incident RHS, select stage “S1” if not already selected.

  6. Ensure user-2 is the assignee for “C2”.

  7. Under “C2”, click the assignee dropdown.

  8. Click on “No Assignee”.

  9. Verify that the item has no assignee.

74

Plugin posts a message in incident channel when an assignee is selected

Continue from the above tests.

  1. Verify that when assigning a checklist item to a workflow member generates a plugin message to notify the action in the center channel.

75

Plugin posts a message in incident channel when ‘No Assignee’ is selected

Continue from the above tests.

  1. Verify that when selecting “No Assignee” for a checklist item, the plugin generates a message to notify the action in the center channel.

76

Workflow member cannot select multiple assignees

Continue from the above tests.

  1. From the incident RHS for “N1”, click the assignee dropdown for “C1”.

  2. Click user-1.

  3. Click user-2.

  4. Verify that clicking a different user highlight only that user in the dropdown.

  5. Press and hold the CMD (or Ctrl) button and click on user-2.

  6. Verify that clicking user-2 highlight only user-2.

  7. Verify that more than 1 user cannot be selected as an assignee for the checklist item.

77

Workflow member cannot select a different assignee in an incident that is ended

Continue from the above tests.

  1. End incident “N1”.

  2. Once the incident has ended, click on the assignee dropdown for “C1”.

  3. Verify that the assignee dropdown does not open up anymore (??).

  4. (Even if it opens up, verify that a different user cannot be assigned to the checklist item).

Valid for ended incident?

78

Workflow member can select a different assignee in an incident that is restarted

Continue for the above tests.

  1. Restart incident “N1”.

  2. Once the incident has restarted, click on the assignee dropdown for “C2”.

  3. Verify that the assignee dropdown is active and can be expanded.

  4. Select user-2 as the assignee.

  5. Verify that user-2 is successfully assigned “C2”.

79

Assignee does not change when a workflow member leaves the workflow channel

Continue form the above tests.

  1. Log in as user-2.

  2. Find and navigate to the “N1” incident channel.

  3. Verify that user-2 is assigned to checklist item “C2” (under stage “S1”).

  4. In the center channel post textbox, type “/leave” and hit enter to leave the channel.

  5. Verify that user-2 cannot find the “N1” incident channel.

  6. Log out.

  7. Log in as user-1.

  8. Find the “N1” incident channel and navigate to it.

  9. Verify that user-2 is still the assignee for “C2” under “S1”.

80

The assignee dropdown list gets updated when a workflow member is kicked from the channel

Continue from the above tests.

  1. Invite user-2 to “N1” incident channel again.

  2. From the incident RHS, select stage “S3”.

  3. Assign item “Ca” to user-2.

  4. In the center channel post textbox, type “/kick” and hit enter to remove user-2 from the channel.

  5. Under “S3”, click on the assignee list for “Ca”.

  6. Verify that user-2 does now appear in the assignee list.

81

Assignee does not change when a workflow member is kicked from the workflow channel

Continue from the above tests.

  1. Select stage “S1”.

  2. Verify that “C2” still shows user-2 as the assignee.

  3. Select stage “S3”.

  4. Verify that “Ca” still shows user-2 as the assignee.

82

The assignee dropdown list gets updated when a workflow member leaves the channel

Continue from the above tests.

  1. With user-2 still removed from the incident channel, click the assignee dropdown for “Cc” under stage “S3”.

  2. Verify that user-2 is not in the assignee list.

83

The assignee dropdown list gets updated when a new member is added to the workflow channel

Continue from the above tests.

  1. Invite user-2 back to the “N1” incident channel.

  2. In the incident RHS, click the assignee dropdown for “Cc”.

  3. Verify that user-2 is now available in the assignee list.

  4. Assign “Cc” to user-2

84

An assignee can checkoff a checklist item

Continue from the above tests.

  1. Log in as user-2.

  2. From the “N1” incident RHS, find “Cc” item under “S3”.

  3. Click the checkbox for “Cc”.

  4. Verify that the checklist item is successfully checked off.

85

An assignee can uncheck a checklist item

Continue from the above tests.

  1. As user-2, uncheck item “Cc”.

  2. Verify that the checklist item is successfully unchecked.

86

A non-assignee can checkoff a checklist item

Continue from the above tests.

  1. As user-2 uncheck all item assigned to user-2.

  2. Log out.

  3. Log in as user-1.

  4. Find all items assigned to user-2.

  5. Click the checkboxes for items assigned to user-2.

  6. Verify that the items are successfully checked off.

87

A non-assignee can uncheck a checklist item

Continue from the above tests.

  1. As user-1, uncheck all the boxes for items assigned to user-2.

  2. Verify that the items are successfully unchecked.

88

Anything in the backstage about assignee?

Test Area (v0.7) - Attach a slash command to each step when editing playbook

Test ID

Test Case

Test Steps

Result

Notes

89

A newly added checklist item in a playbook has a slash command field

90

A playbook can be edited to add a slash command to any checklist item91

A checklist item configured with a slash command shows the slash command for that item in the RHS

92

A checklist item can only be configured with one slash command at most93

Typing an invalid slash command

...