Using the Learner Engagement Analytics Dashboard (LEAD)

This document walks through how to access the Learner Engagement Analytics Dashboard (LEAD) as well as the various components that make up the LEAD and its data.

LEAD is a course-level learning analytics dashboard that displays Canvas, Kaltura and Unizin Engage data to course instructors using Tableau, our institutional data visualization tool.

LEAD is part of UW-Madison's broader efforts around learning analytics. More information about learning analytics at UW-Madison is available from the Vice Provost for Teaching and Learning and DoIT Academic Technology. For practical information about using course-level learning analytics, please visit the Academic Technology guide "What are the pedagogical uses of learning analytics?"


Support

For any issues, questions or concerns with the Dashboard or how to use it, please email dashboardsupport@lists.wisc.edu

Access

To access LEAD, navigate to https://tinyurl.com/LEAD-Fall2019-Pilot. Log in by entering your NetID followed by @wisc.edu and clicking Sign In. (Note that this will look like an email address, but it may be different than your primary UW-Madison email address.)

Note:Access to LEAD is currently available for instructors who have agreed to pilot this dashboard. If you have not been officially enrolled in the pilot, you will not have access to your course data at this time.


Once inside LEAD you will have access to a home page and three visualization pages:

Before clicking on the actual visualization pages, please review the Official Data Definitions for the Learner Engagement Analytics Dashboard at the end of this document.  Those definitions explain what LEAD is and describe and define what data you can see in the visualizations.

Data

Currently LEAD uses data from the Canvas Learning Management System, Kaltura Video Hosting Platform and the Unizin Engage eReader Platform. This data includes:

  • Roster information
  • Grade information
  • Click-stream (log) data

The data is displayed in different forms in the three visualizations and can be filtered.

IMPORTANT NOTE ABOUT THE DATA: Due to data structure there is some discrepancy in how page view data is currently counted in LEAD.


  • Canvas Discussions and Quizzes count every click a student makes as a page view.
  • For Announcements, Assignments, Collaborations, Grades, Modules and Pages: LEAD is now able to capture and track when students are accessing all of these Canvas components from links throughout the course, or from the left navigation bar. This is an improvement and a change from how LEAD was initially launched.
  • Additionally Kaltura views count anytime a student clicks on a Kaltura video embedded in Canvas through the Canvas-Kaltura integration
  • Unizin Engage views count anytime a student loads or reloads a Unizin Engage page. Unizin Engage data does not include any data generated by publisher Digital Learning Tools such as Cengage Mindtap or MacMillan Launchpad
  • Please see the Official Data Definitions for the Learner Engagement Dashboard at the end of this document for more information on the data in the LEAD

Filters

There are five filters that you can apply to your LEAD visualizations:

  • Select Date: The date slider allows you to look at data within a specified date range. Make sure to open the calendar and select today's date in order to view the most recent data.
    90898_LEAD_1.png
  • Select Course Name: This allows you to filter the data by course, if you have more than one course in the dashboard.
  • Select Canvas Activity Type. This allows you to filter by Canvas Activity Type. The five Canvas Activity Types are Announcements, Assignments, Discussions, Gradebook Grades, and Quizzes. See the Official Data Definitions at the bottom of this page for definitions of the Canvas Activity Types.
  • Select Canvas Activity Type Name: This allows you to filter by specific named items or pages within Canvas.
  • Select Student Name: This allows you to filter the data by student(s).

The five filters apply to all three visualizations simultaneously. When you set the filters on one visualization, they will persist as you navigate to other LEAD visualizations. More information about working with filters in Tableau can be found in the How to Use a Tableau Visualization guide.

Remember that after you change a filter, you must hit the Apply button before the change will take effect.

90898_LEAD_2.png

Home Page

The Home Page contains a brief description of LEAD as well as links to all the other pages and functional descriptions of the icons in the visualizations. Please note that you can also navigate to any page in LEAD by selecting the tabs at the top of the page.

90898_LEAD_3.png

Page Views by Date and Hour

This visualization shows you a heat map of when your students are accessing your course in Canvas. On the left you can filter the data by date, student(s), Canvas page/item, and Canvas page type. So, if you would like to know when your students generally take a quiz in Canvas, you can set the date range for the whole semester, select All students and select Quizzes. You can also narrow your filters to a specific quiz (by date or by Canvas Activity Type Name), and a specific student (or set of students).

90898_LEAD_4.png

The darker red an hour block is, the more times that Canvas activity has been accessed at that time of day for the date range you selected. Whatever the highest number of accesses in a given hour is will be the darkest red and the visualization will adjust the shading on the other cells accordingly. You can also hover over any cell and see the exact number of pages accessed for that specific block of time.

Grades by Page Views

This scatterplot visualization is a comparison of students' grades and the total number of pages they have viewed in your Canvas course. The higher up on the y-axis a student is, the higher their grade is in your course (according to the Canvas Gradebook). The further to the right along the x-axis, the more pages a student has viewed in Canvas.

90898_LEAD_5.png

The visualization also draws a trend line for your whole course comparing grades to page views. While there is usually a general, course-wide relationship between grades and page views, individual students may be outliers to this trend. As with any comparison, the relationship between grades and page views should not be viewed as determinative for any individual student.

In the future, uses for this visualization may include:

  • Identifying student "outliers" and using this information as part of a broader discussion to determine whether they may need an intervention or more support
  • Gathering more information about Canvas usage behaviors for students who seem to be struggling in your course

Page Views by Activity Type

This visualization allows you to see how many times your students are accessing the various activity types in Canvas. You can use filters to drill-down and see how much a specific piece of content on your Canvas site is being accessed, and who is accessing it. This visualization can also give you a sense for when students are accessing specific pieces of content in Canvas.

90898_LEAD_6.png

Official Data Definitions for the Learner Engagement Analytics Dashboard

Page Views (Kaltura)

An instance of any Kaltura Video Platform web page being loaded or reloaded and played in a web browser linked within a Canvas course, as long as the page is recorded on a Canvas server; meaning, it is a Canvas native application. If there is a link embedded into a Canvas course which leads the user to a non-Kaltura (external) location or application (for example, Kaltura videos linked to third-party external content authoring software), any activity that happens outside of Canvas is not recorded or accounted for in Kaltura Page Views. A Kaltura page view can be thought of as Kaltura click stream data.

 

Kaltura Percentage of Video Viewed

A percentile metric capturing the percentage of a Kaltura video viewed loaded via a web browser linked to in a Canvas course, as long as the page is recorded on a Canvas server; meaning, it is a Canvas native application. If there is a link embedded into a Canvas course which leads the user to a non-Kaltura (external) location or application (for example, Kaltura videos linked to third-party external content authoring software), any activity that happens outside of Canvas is not recorded or accounted for in Kaltura Percentage of Video Viewed.

  

Page View (Engage eText)

An instance of an Engage eText web page being loaded or reloaded and viewed in a web browser linked within a Canvas course, as long as the page is recorded on a Canvas server; meaning, it is a Canvas native application. If there is a link embedded into a Canvas course which leads the user to a non-Engage eText (external) location or application (for example, Engage eText pages linked to via Pressbooks or other external content authoring software), any activity that happens outside of Canvas is not recorded or accounted for in Page Views. An Engage eText page view can be thought of as Engage eText click stream data. Data captured in Page Views (Engage eText) is displayed as page number and as a document name that an instructor or course administrator names. 

 

Pages (Canvas)

A feature within the Canvas learning management system that stores content and educational resources that are part of a course or group but don’t necessarily belong in an assignment. Pages can include text, video, and links to files and other course or group content. Pages can also be linked to other pages. They can also be used as a collaboration tool for course or group wikis where only specific users can have access.

 

Modules (Canvas)

A feature within the Canvas learning management system that is used to organize course content by weeks, units, or a different organizational structure. Modules essentially create a one-directional linear flow of what students should do in a course. Each module can point to files, discussions, assignments, quizzes, and other learning materials.


Page Views (Canvas)

An instance of any web page being loaded or reloaded in a web browser within a Canvas course, as long as the page is recorded on a Canvas server; meaning, it is a Canvas native application. If there is a link embedded into a Canvas course which leads the user to a non-Canvas (external) location or application, any activity that happens outside of Canvas is not recorded or accounted for in Canvas Page Views. A page view can be thought of as Canvas click stream data.

 

Announcements (Canvas)

A way for Canvas course instructors to communicate with students about course activities and post course-related topics on a page within Canvas. Announcements are designed to allow instructors to broadcast information out to all members of a course or to all members of sections within a course.

 

Assignments (Canvas)

A task or piece of work that a student is given to do within Canvas by a Canvas course instructor, showing students what will be expected of them and how many possible points their work is worth. Assignments can be assigned to everyone in the course or differentiated by user.

 

Collaborations (Canvas)

Canvas technology that allows multiple users to work together on the same document at the same time. Collaborative documents are saved in real-time, and changes made by any of its users will be immediately visible to everyone.

 

Discussions (Canvas)

Interactive, asynchronous online communication between two or more people recorded in Canvas. Users can participate in a conversation with an entire class or group.

 

Gradebook Grades (Canvas)

A feature within the Canvas learning management system that stores grades awarded within the system or manually entered by the instructor. Student grades may be displayed as traditional letter grades, points, or percentage awarded for activities.

 

Quizzes (Canvas)

A scored (number or letter grade) way for Canvas course instructors to assess students' knowledge within Canvas. Quizzes may be timed or untimed.


See Also:




Keywords:LEAD learner engagement analytics dashboard learning data tableau visualizations visualisations   Doc ID:90898
Owner:Angela T.Group:Academic Technology Pilots
Created:2019-04-08 11:17 CSTUpdated:2019-11-15 13:28 CST
Sites:Academic Technology Pilots, Learn@UW-Madison
Feedback:  0   0