Instrument metrics for iOS for the IA project

[kittykat]

We want to know if the IA changes are successful. For this we need to learn more about how users currently use element and whether the IA changes are improving or not making worse their workflows.

Details of what needs to be instrumented are in this internal spreadsheet.

Search

Global search

User Paths: MobileSearchRooms

• Bounce rate from funnel: open search > visit room > open search (within time constraint)
  could be solved with userPath MobileSearch* -> Room -> MobileSearch*
• Time and frequency to go from open search to tap result
  userPath: MobileSearch* -> Room = success, MobileSearch* -> Home = failure
• Frequency of open search and go back without tapping result
  userPath: MobileSearch* -> Home = failure

Needs steps in Funnel (screen->event->screen)

• Funnel for no progress from search results - guesstimate based on users that fell off search and how long did they stick around

User paths from Home, MobilePeople, MobileRooms, etc:

• From which tabs do users open global search
  userPath: MobileSearch*

Room header menu

User paths from RoomDetails (Home means "Leave", "Room" means go back without further action):

• When users tap on the room header, where do they go next?
  userPath: Room -> RoomDetail

Left panel

User paths from MobileSidebar:

• Which menu items are users using in the left panel and how often?
  userPath: MobileSideBar -> MobileSpaceMenu, Settings,and other related screens
• Do users switch spaces?
  Interaction event SpacePanelSwitchSpace
• How often do users tap on the selected space?
  Interaction event SpacePanelSelectedSpace

TBD: find the right way:

• How many users have Home set to "show all rooms"
  Not able to provide reliable properties as cohorts are user and not device related.

Settings

• How often are people accessing their settings and what are they doing? (track screens for the moment)
  As discussed: userPath from Settings

Spaces

• Add a user property for how many spaces the user is in - to split users into cohorts
  user property numSpace still to be discussed which event we will use
• Path to joining to space (were they invited, room directory, link, etc)
  event JoinedRoom
• Number of times explore space is accessed and how (there is a screen for this - note that navigation from space to subscace is a second event)
  event ViewRoom with isSpace = true
• Funnel from left panel to explore space
  userPath MobileSideBar -> MobileSpaceExploreRoom
• Do users use the home space or which metaspace tabs (this is tabs on iOS: from Home -> MobilePeople) ?
  userPath Home, MobileFavourites, MobilePeople, MobileRooms

Rooms

• Source of room open (did they click a link, did they search for the room, did they open it from one of the tabs? note that spaces look like rooms?)
  event ViewRoom
• Path to joining to room (were they invited, room directory, link, etc)
  event JoinedRoom
• Point of entry to create room dialog
  screen events StartChat and CreateRoom

[gileluard]

@kittykat

About app settings, things are slightly different. We don't Have the following screens:

• Preferences
• Help & About
• advanced
• Legals

But we have the following sections in the main settings screen:

Some of the items lead to other screens as:

• Language
• Theme
• Copyright
• Terms & Conditions
• Privacy Policy
• Third-Party polices

Do you want to track the screens above?

[gileluard]

@kittykat

We have room preview bottom sheet but also space preview bottom sheet (which are mostly the same). We have the following possibilities:

• track only room preview bottom sheets
• tack room and space preview bottom sheets as room previews
• tack room bottom sheets as room previews and space preview bottom sheets as space previews

[gileluard]

@kittykat

About trigger for joinedRoom event. one of the trigger is RoomPreview and this trigger is triggered by the other ones usually. Some use cases:

• User taps a notification (trigger Notification) -> the app displays the RoomPreview -> user joins room
• User taps a room in ExploreRooms (trigger SpaceHierarchy) -> the app displays the RoomPreview -> user joins room

What about suggested rooms in home and rooms screens? We can use the SpaceHierarchy trigger but you may want to have a specific trigger.

[kittykat]

Do you want to track the screens above?

No, lets not track them.

If we can treat room and space previews separately, that would be best.

Yes, lets have separate trigger for Home and Room screens - ideally one each as we want to know how often those screens are used to inform the designs Nique is doing right now.

[gileluard]

Waiting for #5834 to be reviewed before closing this ticket.