Table of Content

Summary

This document describes the test plan to test the functionality of the Group Mentions feature which is scheduled for Mattermost v5.24 release.

For the practicality of running tests easily, test cases may follow steps from the preceding test case.

When images exist in parallel to assist with the test case, they are placed right below the corresponding test cases.

Scope

This document outlines the tests for Group Mentions Feature - UI and Functionality features including system console, chat facing and mobile app changes.

Glossary

• Groups Page

  • Can be accessed from System Console > User Management > Groups page

• Channels Page

  • Can be accessed from System Console > User Management > Channels page

• System Scheme

  • Can be accessed from System Console > User Management > Permissions page.

• Team Override Schemes

  • Can be accessed from System Console > User Management > Permissions page.

• Guests

  • A user who is marked as Guest

• Members

  • A regular user who does not have system admin, team admin or channel administrator privileges

• LDAP User

  • A member who had logged into Mattermost using the LDAP credentials

Assumptions

The tests in this test plans are written with the assumption that:

1. Testing done on System Console pages is done as a System Administrator, unless otherwise specified by the test case.

2. Testing is primarily done on the webapp and desktop app, with spot checks on RN mobile app or mobile web browser app to ensure the feature is working fine.

Setup

1. The following setup will be necessary in order to begin testing:

• A Mattermost server and webapp with the latest changes from the 5.24 release branch.

• At least one user with system administrator access to the Mattermost instance

• At least one user with member access to the Mattermost instance

• At least few LDAP users with member access to the Mattermost instance

• At least one user with guest access to the Mattermost instance

Log in to Mattermost as a system administrator.

1. Verify that Mattermost Version 5.24 is running.

• Go to the main menu

• Go to “About Mattermost”

• Mattermost version appears on the About modal

Test Cases

Enable Group Mention in System Console

1. Ensure LDAP is configured and LDAP Groups are present

2. Navigate to System Console > Groups page and click on one of the groups

3. Check if an option to Enable Group Mention is provided. Click on it.

4. The Group Mention input should be displayed with a mention name matching the group name.

5. Reload the page & check.
   a. The group mention option should remain enabled and the group mention name should be visible.

6. As a regular member, submit a post containing a group mention which is enabled
   a. It should notify the group members and the group mention should be highlighted

Disable Group Mention in System Console

1. Ensure LDAP is configured and LDAP Groups are present

2. Navigate to System Console > Groups page and click on one of the groups for which group mentions is enabled

3. Disable the group mention and reload the page and check.
   a. The group mention option should remain disabled and the group mention name should not be visible.

4. As a regular member, submit a post containing a group mention which is disabled.
   a. It should not notify any of the group members and the group mention should not be highlighted

Check Group Mentions when Channel is Group Synced

1. Ensure Group Mentions are enabled for multiple Groups.

2. In System console, navigate to a Channel, ensure it is LDAP Group Synced and then add a channel.

3. As a LDAP user, navigate to that Channel, and type @ and check the autocomplete suggestions list.
   a. Only the Groups which has Group Mention enabled and which are added to the LDAP Group Synced channel should be displayed.
   b. Other Group mentions which are enabled and which are not added to the LDAP Group Synced channel should not be displayed.

4. Submit a post containing the group mention which is enabled and allowed
   a. It should notify the group members and the group mention should be highlighted

5. Submit a post containing the group mention which is enabled but now allowed in the LDAP Group Synced channel.
   a. It should not notify the group members and the group mention should not be highlighted

Check Group Mentions when team is group synced

1. Ensure Group Mentions are enabled for multiple Groups.

2. In System console, navigate to a Channel, ensure it is LDAP Group Synced and then add a team.

3. As a LDAP user, navigate to any channel in that team, and type @ and check the autocomplete suggestions list.
   a. Only the Groups which has Group Mention enabled and which are added to the LDAP Group Synced Team should be displayed.
   b. Other Group mentions which are enabled and which are not added to the LDAP Group Synced Team should not be displayed.

4. Submit a post containing the group mention which is enabled and allowed
   a. It should notify the group members and the group mention should be highlighted

5. Submit a post containing the group mention which is enabled but now allowed in the LDAP Group Synced channel.
   a. It should not notify the group members and the group mention should not be highlighted

Check Group Mentions when neither channel nor team is group synced

1. Ensure Group Mentions are enabled for multiple Groups.

2. As a regular member, navigate to any channel, and type @ and check the autocomplete suggestions list.
   a. All the Groups which has Group Mention enabled should be displayed.
   b. Other Group mentions which are not enabled should not be displayed.

3. Submit a post containing the group mention which is enabled and allowed
   a. It should notify the group members and the group mention should be highlighted

Check Group Mentions when group mention is disabled

1. Enable Group Mention for a Group say Group1.

2. As a regular member, navigate to any channel, and type @ and check the autocomplete suggestions list.
   a. Group1 should be displayed in the autocomplete list.

3. As a sysadmin, disable the group mention for Group1.

4. Check if regular member types @ in a post, Group1 should not be displayed in the autocomplete suggestions list.
   a. This should work without requiring the regular member to reload the page.

5. Submit a post containing the group mention which is disabled
   a. It should not notify the group members and should not display any system messages and the group mention should not be highlighted

Check Group Mentions when group was unlinked

1. Enable Group Mention for a Group say Group1.

2. As a sysadmin, unlink the group without disabling the group mention.

3. Check if regular member types @ in a post, Group1 should not be displayed in the autocomplete suggestions list.
   a. This should work without requiring the regular member to reload the page.

4. Submit a post containing the group mention which is disabled
   a. It should not notify the group members and should not display any system messages and the group mention should not be highlighted

Check Group Mentions when Group Mentions permission is disabled in System Scheme

1. Enable Group Mention for a Group say Group1.

2. As a sysadmin, remove the Group Mentions permission for All Members in System Scheme.

3. Check if regular member types @ in a post, Group1 should not be displayed in the autocomplete suggestions list.
   a. This should work without requiring the regular member to reload the page.

4. As a regular member, submit a post containing a group mention which is enabled
   a. It should not notify the group members and should not display any system messages and the group mention should not be highlighted

Check Group Mentions when Group Mentions permission is disabled in Team Scheme

1. Enable Group Mention for a Group say Group1.

2. As a sysadmin, remove the Group Mentions permission for All Members in a Team Override Scheme.

3. Check if regular member types @ in a post in any channel of that team, Group1 should not be displayed in the autocomplete suggestions list.
   a. This should work without requiring the regular member to reload the page.

4. As a regular member, submit a post containing a group mention which is enabled
   a. It should not notify the group members and should not display any system messages and the group mention should not be highlighted

5. Repeat steps 3 and 4 on a channel of different team
   a. Group Mention should be displayed in the autocomplete suggestions list
   b. It should notify the group members and the group mention should be highlighted

Check Group Mentions when user is a channel admin

1. Enable Group Mention for a Group say Group1.

2. As a sysadmin, remove the Group Mentions permission for Channel Admins in System Scheme.

3. Check if a channel admin types @ in a post, Group1 should not be displayed in the autocomplete suggestions list.
   a. This should work without requiring the user to reload the page.

4. As a channel admin, submit a post containing a group mention which is enabled
   a. It should not notify the group members and should not display any system messages and the group mention should not be highlighted

5. Now as a sysadmin, enable the Group Mentions permission for Channel Admins but disable it for All Members in System Scheme.
   a. Check if a channel admin types @ in a post, Group1 should be displayed in the autocomplete suggestions list.
   b. When channel admin submits a post containing the group mention, it should notify the group members and the group mention should be highlighted

Check Group Mentions when user is a Team admin

1. Enable Group Mention for a Group say Group1.

2. As a sysadmin, remove the Group Mentions permission for Team Admins in Team Override Scheme.

3. Check if a team admin types @ in a post, Group1 should not be displayed in the autocomplete suggestions list.
   a. This should work without requiring the user to reload the page.

4. As a team admin, submit a post containing a group mention which is enabled
   a. It should not notify the group members and should not display any system messages and the group mention should not be highlighted

5. Now as a sysadmin, enable the Group Mentions permission for Channel Admins but disable it for All Members in System Scheme.
   a. Check if a team admin types @ in a post, Group1 should be displayed in the autocomplete suggestions list.
   b. When channel team submits a post containing the group mention, it should notify the group members and the group mention should be highlighted

Check Group Mentions when user is a Guest User

1. Enable Group Mention for a Group say Group1.

2. As a sysadmin, check that by default the Group Mentions permission is removed for Guests in System Scheme.

3. Check if a guest user types @ in a post, Group1 should not be displayed in the autocomplete suggestions list.
   a. This should work without requiring the user to reload the page.

4. As a guest user, submit a post containing a group mention which is enabled
   a. It should not notify the group members and should not display any system messages and the group mention should not be highlighted

5. Now as a sysadmin, enable the Group Mentions permission for Guest Users but disable it for All Members in System Scheme.
   a. Check if a guest user types @ in a post, Group1 should be displayed in the autocomplete suggestions list.
   b. When guest user submits a post containing the group mention, it should notify the group members and the group mention should be highlighted

Check Group Mentions in any of the Markdown syntaxes

1. Ensure Group Mentions are enabled for multiple Groups.

2. As a regular member, navigate to any channel, and submit a post containing the group mention within the following markdown syntaxes:
   a. Using group mention in block of code, for example: @groupname or @groupname
   b. Using group mention in text styling like bold @groupname, italics @groupname, strikethrough @groupname

3. It should not notify any of the group members and the group mention should not be highlighted

Check Group Mentions when multiple group mentions are specified

1. Ensure Group Mentions are enabled for multiple Groups.

2. As a regular member, navigate to any channel, and submit a post containing multiple group mentions

3. All the group members of all the groups mentioned should get notified and all the group mentions should be highlighted

Check Group Mentions when group members are in the team & channel

1. Enable Group Mention for a group say Group1.

2. Ensure all members of that group and a regular member are present in a team Team1 and channel Channel1.

3. As a regular member, navigate to Channel1 and submit a post containing the group mention Group1.

4. All the group members in that team and channel should get notified.

5. The user should not get any system message indicating that some members of the group were not available in the team or channel.

Check Group Mentions when group members are in the team but not in the channel

1. Enable Group Mention for a group say Group1.

2. Ensure some members of that group are present in a team Team1 but not in the channel Channel1.

3. As a regular member, navigate to Channel1 and submit a post containing the group mention Group1.

4. The user should get a system message indicating that the list of members of the group were not notified by this mention because they are not in the channel. An option should be given to add them to channel.
   a. Note: Only members who are present in the team should be displayed in this list. All other members who are not present in the team should not be displayed in this list.

Check Group Mentions when group members are not in the team and the channel

1. Enable Group Mention for a group say Group1.

2. As a regular member, create a new team and ensure no members of Group1 are present in the team.

3. Now submit a post containing the group mention Group1.

4. The user should get a system message indicating that "@Group1 has no members on this team". None of the members of group1 should be notified. The group mention should not be highlighted.

Check Group Mentions when group members are not in the channel as a Guest User

1. Enable Group Mention for a group say Group1.

2. Ensure some members of that group are present in a team Team1 but not in the channel Channel1.

3. Ensure a Guest User is added to the channel Channel1 and does not has access to any other channels in that team.

4. As a guest user, navigate to Channel1 and submit a post containing the group mention Group1.

5. The guest user should get a system message indicating that the list of members of the group were not notified by this mention because they are not in the channel.
   a. Option should not be given to add the members to the channel since the user does not has permissions to do the same.
   b. The list of missing members in the system message should not be clickable

Check Group Mentions when group members are not in the channel when Manage Members is disabled

1. Enable Group Mention for a group say Group1.

2. Ensure some members of that group are present in a team Team1 but not in the channel Channel1.

3. Remove the Manage Members option for Members for Channel1 in Channel Moderation Settings.

4. As a regular user, navigate to Channel1 and submit a post containing the group mention Group1.

5. The regular user should get a system message indicating that the list of members of the group were not notified by this mention because they are not in the channel.
   a. Option should not be given to add the members to the channel since the user does not has permissions to do the same.
   b. The list of missing members in the system message should be clickable

Check Group Mentions when used in Direct Message

1. Enable Group Mention for a group say Group1.

2. As a regular member, open a Direct message with an another user

3. Submit a post containing a group mention which is enabled
   a. It should not notify any of the group members
   b. The group mention should not be highlighted
   c. The user should not receive any system message

Check Group Mentions when used in Group Message

1. Enable Group Mention for a group say Group1.

2. As a regular member, open a Group message with few users

3. Submit a post containing a group mention which is enabled
   a. It should not notify any of the group members
   b. The group mention should not be highlighted
   c. The user should not receive any system message

Check Group Mentions Confirmation Dialog

1. Enable Group Mention for a group say Group1 and ensure more than 5 members are in the group.

2. Ensure that the setting "Show @channel and @all and group mention confirmation dialog:" is turned on in System Console > Notifications.

3. Ensure all members of Group1 are present in Channel1.

4. As a regular member, submit a post containing the group mention.

5. A confirmation dialog should be displayed something like this:
   By using @group1 you are about to send notifications to 6 people. Are you sure you want to do this?

6. Click confirm button and then a notification should be sent to all the users of group Group1.

Check Confirmation Dialog when multiple group mentions are specified

1. Enable Group Mention for multiple groups say Group1, Group2 and Group3 and ensure more than 5 members are in the group.

2. Ensure that the setting "Show @channel and @all and group mention confirmation dialog:" is turned on in System Console > Notifications.

3. Ensure all members of Group1, Group2, Group3 are present in Channel1.

4. As a regular member, submit a post containing multiple group mentions like @group1, @group2, @group3.

5. A confirmation dialog should be displayed something like this:
   By using @group1, @group2 and @group3 you are about to send notifications to at least 6 people. Are you sure you want to do this?

6. Click confirm button and then a notification should be sent to all the users of group Group1, Group2, Group3.

Check Confirmation Dialog when user who does not has permissions uses Group Mentions

1. Enable Group Mention for a group say Group1 and ensure more than 5 members are in the group.

2. Ensure that the setting "Show @channel and @all and group mention confirmation dialog:" is turned on in System Console > Notifications.

3. Ensure all members of Group1 are present in Channel1.

4. Ensure that Group Mentions permission is removed for All Members in System Console > Permission Schemes

5. As a regular member, submit a post containing the group mention.

6. No confirmation dialog should be displayed. The group mention should not be highlighted.

Check Confirmation Dialog when Group Mentions is used in a Group Message

1. Enable Group Mention for a group say Group1 and ensure more than 5 members are in the group.

2. Ensure that the setting "Show @channel and @all and group mention confirmation dialog:" is turned on in System Console > Notifications.

3. Ensure all members of Group1 are present in a Group Message.

4. As a regular member, submit a post containing the group mention.

5. A confirmation dialog should be displayed something like this:
   By using @group1 you are about to send notifications to 6 people. Are you sure you want to do this?

6. Click confirm button and then a notification should be sent to all the users of group Group1.

Check Group Mentions Confirmation Dialog when setting is disabled

1. Enable Group Mention for a group say Group1 and ensure more than 5 members are in the group.

2. Disable the setting "Show @channel and @all and group mention confirmation dialog:" in System Console > Notifications.

3. Ensure all members of Group1 are present in Channel1.

4. As a regular member, submit a post containing the group mention.

5. No confirmation dialog should be displayed. The group mention should not be highlighted.

Check Confirmation Dialog when few members are added in the channel

1. Enable Group Mention for a group say Group1 and ensure more than 5 members are in the group.

2. Ensure that the setting "Show @channel and @all and group mention confirmation dialog:" is turned on in System Console > Notifications.

3. Ensure only one member of Group1 are present in Channel1.

4. As a regular member, access the channel Channel1.

5. As a regular member or as sysadmin, add few members of Group1 to the channel so that more than 5 members of Group1 are in the channel

6. Now as a regular member, submit a post containing the group mention.

7. A confirmation dialog should be displayed something like this:
   By using @group1 you are about to send notifications to 6 people. Are you sure you want to do this?

8. Click confirm button and then a notification should be sent to all the users of group Group1.

Check Confirmation Dialog when few members are removed from the channel

1. Enable Group Mention for a group say Group1 and ensure more than 5 members are in the group.

2. Ensure that the setting "Show @channel and @all and group mention confirmation dialog:" is turned on in System Console > Notifications.

3. Ensure more than 5 members of Group1 are present in Channel1.

4. As a regular member, access the channel Channel1.

5. As a regular member or as sysadmin, remove few members of Group1 to the channel so that less than 5 members of Group1 are in the channel

6. Now as a regular member, submit a post containing the group mention.

7. No confirmation dialog should be displayed. The group mention should not be highlighted.

Check Confirmation Dialog when new members have joined the channel

1. Enable Group Mention for a group say Group1 and ensure more than 5 members are in the group.

2. Ensure that the setting "Show @channel and @all and group mention confirmation dialog:" is turned on in System Console > Notifications.

3. Ensure 4 members of Group1 are present in Channel1.

4. As a regular member, access the channel Channel1.

5. Login as a new user belonging to the group Group1 and try to access the channel Channel1 on a different session.

6. Now as a regular member, submit a post containing the group mention.

7. A confirmation dialog should be displayed something like this:
   By using @group1 you are about to send notifications to 6 people. Are you sure you want to do this?