This Summer, the Khan Academy team rebuilt how we measure learning time to make it more consistent, performant, and accurate. This was a large, multi-team effort, and the new definition of learning time is now being used for all new district, teacher, and student reports. While this means that learning time will be more accurate than ever, it did mean that reports that used our previous learning time measurements were out of date and are no longer available.
We want to make sure that you’re up-to-date on which reports are and are not available, and how you can use the available reports to support your students (or, if you’re a learner, to track your learning).
For Teachers: Individual Student Report
When you click on an individual student’s name, you will land on the Individual Student report. This report includes exercise minutes, total learning minutes, and an Activity Log. This log can be sorted by time, material, and type of activity. Our new measurement of time does not include time spent navigating on non-learning parts of the website, so you'll have an even more accurate idea of time spent engaged in learning.
Note: Student data on these new reports will only be available going back to the middle/end of august. We are actively working on backfilling this data, and will update this post when data going back to the beginning of September 2017.
For Teachers: Class Overview
The Class Overview page shows the students in a particular class, the total minutes they’ve spent learning, how many skills they have leveled up in, and how many skills they’ve worked on but not made progress (“skills w/o progress”).
For Students: Progress Page
You can also see the page with your Activity Log by going to your Profile or left-hand navigation and clicking Progress.
Mastery movement in these reports
In the Activity Log, the change in mastery level is the change that was made by working on the specific exercise listed. For quizzes and unit tests, we show the multiple skills that changed levels due to work completed on this specific test or quiz.
Sometimes, quizzes, unit tests and course challenges on Khan Academy include skills that build on other pre-requisite skills (for example, you need to be able to add single-digit numbers before you add multi-digit numbers!). When these more difficult skills are completed, it also impacts mastery level of pre-requisite skills. This is why you sometimes may see more skills being leveled up or down on than questions that were completed on a quiz, unit test, or course challenge.
For Teachers: Where to find old report information
The old Activity tab showed time spent, including on specific content items, broken out by student. This information can now be found in the Class Overview page or the Individual Student Report Activity Log. It also showed Mastery Skills gained/lost per content item, which will be available in the Activity Log. Data in this report was able to be filtered by time, and will remain available in the Class Overview and Activity Log reports.
The Activity tab also included a bar graph showing time by student, and time, broken out by in-school and out-of-school hours. We currently do not have a replacement for the bar graph shown in the Activity Tab, or a replacement measure for dividing time between in school and out of school hours, and do not currently have plans to re-introduce these two features. That said, we are always looking for ways to make reports as useful as possible and if you would like to give feedback on how you used this previous functionality, we’d love to hear from you here.
Reports on Student Time and Progress on Missions
Our Missions progress reports (seen above) used a definition of time that was inconsistent across the site, and so we are eliminating these measurements and are using a common time measurement in all locations. This information on time spent broken out by student, by time range, is available on the Class Overview page. Time spent on specific activities will be available on the Student Activity Log.
Old Report Progress by Student View
On the previous Progress by Student View, teachers were able to view energy points over specific time frames and the total time a student was active over a given time period. Information on time will be available in the Activity Log, but energy point information will not.
This report also included a visual of Focus, showing all videos and all exercises taken over time. It allowed teachers to see questions answered correctly for any exercise, over time, as well as problems taken without a hint for any exercise. We have not yet designed a replacement for this report, but are eager to hear feedback on what information and visuals may be most helpful for teachers using our new mastery system.
Finally, this report showed a problem-by-problem breakdown when clicking on a skill. As with the focus tab, we have not yet designed a replacement for this report, but the information is available in the Individual Assignments Report. We are eager to hear feedback on what information and visuals may be most helpful for teachers using our new mastery system.
Previous reports that will and will not be available
Because the majority of the information found in these previous reports are available in the Class Overview and Individual Student Reports, the student progress reports for videos, activities, and focus will no longer be available.
The following reports will still be available:
The Course Mastery report with bar graphs describing class and student progress:
The Assignment Scores Report:
The Individual Assignment Reports:
The Old Missions Progress by skill and by student reports will still be available (without the video, focus, or activity tabs), seen above.
We look forward to your feedback as we continue to improve our platform providing teachers with the data that they need to best serve students!
Please sign in to leave a comment.