During the summer of 2019, the Khan Academy team rebuilt one of the most critical currencies of our system - time spent learning - to make it more consistent, performant, and accurate. This new definition of learning time is being used for all new district, teacher, and student reports. As a result, some reports that used the the old measure of learning time are no longer up-to-date. The goal of this article is to share which reports are no longer available, and how you can use our new reports to support your classes.
Note: Student data on these new reports will only be available going back to the middle/end of august. We are actively working on backfilling this data, and will update this post when data going back to the beginning of September 2017.
Individual Student Report with Activity Log
When you click on an individual student’s name, you will land on the Individual Student report, which includes exercise minutes, total learning minutes, and an Activity Log. This log can be sorted by timeframe, material, and type of activity. Our new and universal measurement of time does not include time spent navigating on non-learning parts of the website, so you'll have an even more accurate idea of time spent engaged in learning.
Students can also see this page by going to their Profile and clicking Progress.
The Activity Overview page shows the students in a particular class, the total minutes they’ve spent learning, how many skills they have leveled up in, and how many skills they’ve worked on but not made progress (skills w/o progress).
In the Activity Log, for exercises, the change in mastery level is the change that is a result of this exercise. For quizzes and unit tests, we show the multiple skills that changed levels due to work completed on this specific test or quiz.
Sometimes, quizzes, unit tests and course challenges on Khan Academy include skills that build on other pre-requisite skills. When students see and complete these skills, it also impacts their mastery level of the pre-requisite skills. This is why you sometimes may see a student who has leveled up or down on more skills than questions they completed on a quiz, unit test, or course challenge.
Where to find old report information
The Activity tab showed time spent, including on specific content items, broken out by student. This information can be found in the Activity Overview page or the Individual Student Report Activity Log. It also showed Mastery Skills gained/lost per content item, which will be available in the Activity Log. Data in this report were able to be filtered by time, and this functionality will remain available in the Activity Overview and Activity Log reports.
The Activity tab also included a bar graph showing time by student, and time, broken out by in-school and out-of-school hours. We currently do not have a replacement for the bar graph shown in the Activity Tab, a replacement measure for dividing time between in-school and out-of-school hours, and do not have plans to re-introduce these two features. That said, we would like to think of new ways to help you present data to your students, and to get a deeper understanding of their usage. If you would like to give feedback on how you used this old functionality, you can do so here.
Reports on Student Time and Progress on Missions
Our Missions progress reports (seen above) used a definition of time that was inconsistent across the product, and so we are eliminating these measurements and will use a common time measurement in all locations. The same information on time spent broken out by student, by time range, is available on the Activity Overview page. Time spent on specific activities will be available on the Student Activity Log.
Old Report Progress by Student View
On the previous Progress by Student View, teachers were able to view energy points over specific time frames and the total time a student was active over a given time period. Information on time will be available in the Activity Log, but energy point information will not.
This Report also included a visual of Focus, showing all videos and all exercises taken over time. It allowed teachers to hover text showing questions answered correctly for any exercise, over time, as well as problems taken without a hint for any exercise. We have not yet designed a replacement for this report, but are eager to hear feedback on what information and visuals may be most helpful for you while using our new mastery system.
Finally, this report showed a problem-by-problem breakdown when clicking on a skill. As with the focus tab, we have not yet designed a replacement for this report, but the information is available in the Individual Assignments Report. We are eager to hear feedback on what information and visuals may be most helpful for teachers using our new mastery system.
Previous reports that will and will not be available
Because the majority of the information found in these previous reports are available in the Activity Overview and Individual Student Reports, the student progress reports for videos, activities, and focus will no longer be available.
The following reports will still be available:
The Course Mastery report with bar graphs describing class and student progress:
The Assignment Scores Report:
The Individual Assignment Reports:
The Old Missions Progress by skill and by student reports will still be available (without the video, focus, or activity tabs), seen above.
We look forward to your feedback as we continue to improve providing teachers with the data that they need to best serve students!