Skip to main content

What’s new on Problem Roulette?

The Problem Roulette team is always working to improve the overall experience on our platform for both students and instructors. Here’s what we’ve been updating, adding, or improving:

abstract shapes

Surface count of unresolved student feedback for instructors

Instructors can easily see how much student content feedback needs their attention.

Group Study bug fixes

With these fixes, starting a Group Study session is clearer and easier. Look for more updates on Group Study coming soon!

Accessibility improvements

The team worked through a thorough accessibility roadmap to identify and fix issues affecting the accessibility of the site.

Continued performance improvements

Several upgrades combine to make Problem Roulette faster, including more efficient storage of streak and volume data, smoother loading of the student-facing pages and the admin console, and optimized back end operations for next question selection.

Next question selection and unit tests

The process to determine which question a student receives underwent rigorous testing to ensure accurate question delivery based on student performance.

New Location for Number of Students Online

The number of students using Problem Roulette has moved to Group Study Mode to better inform student's use of Group Study.

Continued Performance Improvements

The speed of Problem Roulette continues to improve, including adjustments to the Admin Console.

Updates to Name That Topic Mode

Bug fixes and interface improvements for this specialized study mode.

Adjusted Study Volume in Exam Mode

Adjustments provide a better representation of study volume in Exam Mode.

Performace Improvment and Bug Fixes

Performance improvements for course library and student dashboard and bug fixes.

Bug Fixes

Performance improvements and bug fixes.

Study Session Performance Improvements

Several backend upgrades combine to make the study session experience smoother and faster.

Accessibility Fixes

Problem Roulette is a more accessible tool with site-wide adjustments to buttons, links, and more.

Updates to the Study Session Summary

Students will notice improvements to the way study volume is represented. For questions with multiple correct answers, they will find it easier to clearly see the answers they chose and compare their choices to the correct answers.

Display active streak in Study Mode

Subtle animation and a closeable side panel bring streaks into the study session experience. In Study Mode, students can open a new side panel to reveal their session streaks. Students with an active streak will be notified with a subtle animation and will see their active streak in the side panel.

Ability to study by exam date

When instructors add topics to exam dates in the Admin Console, students will be able to select an exam when they set up a study session, and the resulting session will include all topics associated with that exam.

Improved question formatting in the Admin Console

Problem Roulette better handles questions with tables and other special formatting considerations in the Questions page of the Admin Console.

Two new courses!

The team is thrilled to welcome Earth 222: Introductory Oceanography and PUBHLTH 500: Investigating Public Health Issues (Epidemiology) to Problem Roulette this term! Want your course to be the next new course on Problem Roulette? Contact problemroulette-support@umich.edu to get started.

Better support for questions with math symbols

Questions with math symbols have a new and improved look in study sessions and in the question preview for instructors.

Improvements to exam topics

Problem Roulette will filter out topics with no questions when listing the topics associated with an Exam Date for students.

Introducing streaks and study volume!

Students are encouraged to take these research-backed study actions through visualizations on their dashboard and study session summaries, including the ability to earn badges for certain streak sizes and for milestones in the number of questions they have attempted in the course. Learn more about streaks and study volume.

New header navigation for instructors and students

It’s easier to find your way around Problem Roulette with new headers for both students and instructors. Students’ most important pages are one click away, and instructors can find everything they need for editing and viewing content in a single menu.

New study session icons

Problem Roulette’s personality shines in a new set of icons for the Last 3 Study Sessions on the Student Dashboard, clarifying the type and duration of each study session.

Improved study reminders

Study Reminders has a new look and expanded options. Students can choose reminders for a low, medium, and high grade boost based on the team’s latest research on study volume.

Redesigns: Study Session Summary and Saved Questions

Students will notice upgrades to two key pages after their study sessions, including an updated look to match the rest of the site, the ability to search saved questions, the ability to study all saved questions in a course, and clearer designations of which questions were correct, incorrect, skipped, or had multiple correct answers within a study session.

Review past study sessions

The list of recent study sessions on the student dashboard now includes a button to review the Study Session Summary for each session.

Introducing the Course Library

From the Course Library, students can see all of the available courses on Problem Roulette and which courses they’ve studied before, and they can add and remove courses from their dashboard.

Updated exam dates

New on the Student Dashboard, Problem Roulette uses exam dates to show students how many days remain until their exam, what topics are on their exam, study tips, and a prompt to start a study session.

Expanded term support

Problem Roulette can now support courses that aren’t tied to the traditional term structure, unlocking a variety of new use cases for the tool, including the incorporation of Problem Roulette into Massive Open Online Courses or MOOCs.

Restricted access for users outside of U-M

When external users access Problem Roulette, they will not be able to see U-M courses in their Course Library.

User Permissions redesign

Instructors will benefit from a clearer, more intuitive, and easy-to-use new design for the Permissions tab of the Admin Console.

Study Tips updates

Updates to the Study Tips page help students use Problem Roulette to practice the best study strategies known to research.

New Course!

The team was delighted to welcome BIOLOGY 305 to Problem Roulette in Summer 2023. Want your course to be the next new course on Problem Roulette? Contact problemroulette-support@umich.edu to get started.

Send us your feedback!

With so many major updates in this release, we want to hear from you. What’s working for you, what do you wish were different, what would you like to see that isn’t there yet? Tell us what you think.

Introducing the new Student Dashboard

The new Student Dashboard incorporates the latest research on study patterns to nudge students toward beneficial learning behaviors and better results on their exams. Upgrades include new visualizations of streaks and study volume, improved study reminders, a redesigned study session summary, added functionality for Exam Dates, and more.

Django 4.2 Upgrade

Problem Roulette has been updated to the latest version of the Django web framework.

New Course!

PUBHLTH 512: Principles Of Epidemiology For Public Health launched in Problem Roulette in the Winter 2023 term. Want your course to be the next new course on Problem Roulette? Contact problemroulette-support@umich.edu to get started.

LTI 1.3 Upgrade

Problem Roulette’s LTI integration has been updated to include support for LTI 1.3.

Edit exam date (admin)

Team Members can add, edit, and delete topic groups and topics for exam dates from the Admin Console.

New Course!

GF_Periodontics joined Problem Roulette in Winter 2023 as a new use case for the tool — instead of a single course, Periodontics students can use Problem Roulette to review content across their entire program of study to refresh knowledge or prepare for culminating exams. Want your course to be the next new course on Problem Roulette? Contact problemroulette-support@umich.edu to get started.

Question Taxonomy Field

A new field in the Create Question and Edit Question forms provides a fixed set of tags to characterize questions as Factual, Conceptual, Procedural, or Metacognitive. This feature lays the groundwork for future research and student readiness metrics.

Ability to archive questions

Team Members who choose to delete content will no longer be taking a permanent action. Instead, deleted content will remain archived and retrievable.

New Course!

The Problem Roulette team was delighted to welcome BIOSTAT 501 during the Fall 2022 term. BIOSTAT 501 is the first online course to study with Problem Roulette and the first to add the tool to Coursera with our LTI integration. Want your course to be the next new course on Problem Roulette? Contact problemroulette-support@umich.edu to get started.

New and improved Course Settings and User Permissions pages

The Course Settings and User Permissions pages of the Admin Console are nicer to look at and easier to use than ever. Users have been relabeled Team Members for clarity.

Question Sets - Confirmation before emailing enrolled students

The addition of this confirmation step gives Team Members peace of mind when emailing a Question Set to the enrolled students in your course.

Introducing Exam Dates

Important Dates have been repurposed to Exam Dates in the Admin Console. Team Members can link topics to exam dates each term, and Problem Roulette will eventually use Exam Dates to develop smarter, more accurate topic proficiency estimates.

Section Awareness

An update to Problem Roulette’s auto-enrollment feature laid the foundation to make Problem Roulette aware of term-specific enrollment information, such as which section of a course a student is enrolled in.

Terms of Service and Privacy Policy

We’ve added our Terms of Service and Privacy Policy to the footer of Problem Roulette.

Clearer view of questions while creating Question Set

An expanded question selection interface lets Team Members build custom Question Sets for their students with ease.

Question display: radio vs. checkbox

An updated design for answer choices in Problem Roulette helps students know when questions have one right answer or more than one right answer.

Bulk edit of questions 2.0

We’ve added new capabilities to the bulk edit feature! When you select multiple questions in the Admin Console, you can publish, unpublish, delete, or assign topics to all of them at once. You can also select multiple questions and update the question text for each one from the same page.

Accessibility improvements and brand upgrades

Problem Roulette is a more accessible tool with a larger font size that is easier to read and a color palette that passes the color contrast ratio test. This fresh color palette and a modern font bring new energy to your study sessions, while maintaining Problem Roulette’s classic aesthetic.

Performance improvements

Performance upgrades for the PDF Exam Export and the Site Analytics page brought these newer features up to speed.

QTI Refinements

Improvements to the QTI import feature include setting the topic created on import to inactive, automatically pulling question titles from the LMS, and allowing for more flexibility in the name of the uploaded file.

Return to the same location when editing questions

When you save your edits to a question, Problem Roulette automatically returns you to the page of the question list that you were working from.

Bulk edit of questions

Editing questions just got a lot easier! Now you can select multiple questions in the Admin Console and publish, unpublish or delete all of them at once.

Download all questions option for superusers

Superusers now have the ability to download a .csv file of all the questions in a course, a useful option for large-scale content initiatives. This feature is not available to instructors at this time.

Persistent content for multipart questions

The multipart question feature is now fully-functional! Both Study Mode and Exam Mode will respect the order of multipart questions, even if the student chooses a smaller number of questions for their study session.

Exam export 2.0

We’ve made some quality improvements to the printable PDF download for practice exams.

Topic Management Enhancements: Removal of Topics

Before deleting a topic, users will be prompted to reassign its questions to an active topic and can migrate questions in bulk.

New course!

The Problem Roulette team is thrilled to welcome a new computer science course for Winter 2022. EECS 203: Discrete Mathematics used our new QTI import feature to offer a starter set of over 200 questions. Want your course to be the next new course on Problem Roulette? Contact problemroulette-support@umich.edu to get started.

Native Support for QTI 1.2

Instructors have a new option for importing questions to Problem Roulette themselves. In addition to .csv files, instructors can now import QTI .zip files in the Admin Console. This empowers instructors to easily import content downloaded from Canvas (and anywhere that will download .zip files in QTI version 1.2). For more information, check out our Instructor Toolkit.

New Option for Displaying Histogram of Student Answers

Instructors have more flexibility around if and when students can see a histogram of how many students chose each answer option for a question. In addition to the existing option to “Display answer histogram after students answer a question,” instructors can now set a specific number of failed attempts after which to show the histogram. This option is available in the Settings tab of the Admin Console.

Show Topic Accuracy During Topic Selection

When selecting which topics to include in a study session in Study Mode, students will now see the average overall course accuracy for each topic, as well as the number of questions in each topic.

Algorithmic Question Selection: Bias against previously-seen questions

Problem Roulette now considers which questions a student has seen before when serving up random questions in Study Mode. Students will first see questions they’ve never seen before in any session for the course, followed by questions they’ve seen before but not in the current study session.

Saved Questions Quiz

Students have more control over their studying with the ability to take a quiz from their Saved Questions. As students save questions in a study session, the quiz becomes automatically available in Exam Mode under “My Practice Exams.” Students can also start the quiz anytime from My Dashboard > Saved Problems > Study Saved Problems.

PDF Download/Printable Export of an Exam Template

Students and instructors have a new option to download and/or print a practice exam. For students, the download option is available in the top right corner when taking a practice exam. Instructors can start the exam from the Exam Templates tab of the Admin Console and select Download from the top right corner.

New Database Migration

Your study experience is faster than ever! Problem Roulette is running twice as fast thanks to a migration to a new database in the cloud.

Improvements to Group Study Mode

Group Study Mode better facilitates ongoing study groups by allowing students to resume in-progress group study sessions. Students enrolled in multiple courses on Problem Roulette can also join a study session in another course without losing their current group session.

New Exam Mode Experience

Students can now enjoy a dynamic new upgrade to Problem Roulette’s Exam Mode, including the ability to enter notes to themselves during a session as well as save questions to their dashboards for later review.

Student Dashboard Redesign

Problem Roulette’s student dashboard has a brand new design, including UI improvements and usability improvements such as the ability to filter, sort, and search saved problems.

Notification Packages

Now available on the student dashboard, students can opt to have Problem Roulette email them regular study reminders to help reduce cramming and make studying a habit. Students can select one of five levels of engagement based on their preferences for the frequency of the reminders and the number of problems to study each time. From these reminder emails (or their dashboards), students can click into an auto-generated study session and work through the number of problems they specified.

Topic Management Enhancements for Instructors

Instructors have a new ability to show or hide inactive topics when editing questions. Courses now automatically default to hiding inactive topics, but instructors can change this in their Admin Console under Settings > General Options.

Important Dates

With this exciting new feature, exam dates and other important course milestones can inform the active/inactive status of topics and topic groups. Instructors can now add important dates to their course and link them to certain topics or groups, reducing student confusion around what to study and removing the need for instructors to manually activate topics as a course progresses.

Improved Canvas Integration

Students who access Problem Roulette via their Canvas course are now conveniently directed to their specific course page to start studying.

Inline code formatting

Problem Roulette now preserves font size and formatting when importing new problems.

Improved Import of Canvas Content

This latest improvement to our content pipeline allows bulk imports of multiple-choice quizzes stored in Canvas. Our current import record is 24 quizzes at once!

New course!

The Problem Roulette team is thrilled to welcome a new course from the School of Kinesiology. AES 220: Applied Human Physiology launched on Problem Roulette during the Winter 2021 term using our improved Canvas content import. Want your course to be the next new course on Problem Roulette? Contact problemroulette-support@umich.edu to get started.

Promo Video

Learn about the features and benefits of Problem Roulette in less than 3 minutes in this new promotional video created by our Software Portfolio Manager

Group Study Lobby

Finding study partners in Problem Roulette is easier than ever. Students can now set their status to available or unavailable for Group Study invitations. When students create a Group Study session, they can see which other students are online and accepting invitations. Invited students are notified in-app if online and by email if offline.

Study Session Summary Pages

When students finish a study session, they’ll be greeted with a new and improved summary of their studying, including their overall accuracy percentage, number of correct answers, duration of session, and a list of all of the problems they completed in the session. Students can filter the list by correct/incorrect answers and by topic, reveal the correct answer for problems they got wrong, and save problems to their dashboard to review later.

Support for Importing Equations

Problem Roulette now supports importing equation-heavy content through the use of Text2QTI, a tool that converts plain text files into Canvas-supported quiz files. If you are an instructor interested in using Problem Roulette with equations, please contact: problemroulette-support@umich.edu.

Course Icon Redesign

Students and instructors can now enjoy a fresh set of course icons designed and built for Problem Roulette by a student fellow.

Study Tips

Problem Roulette encourages students to use 4 of the best study strategies known to research. To help students make the most of those strategies, our Behavioral Science Team compiled a set of study tips, including tips for online classes and remote learning. Students and instructors can view those tips on our new Study Tips page.

Canvas Integration

Students and instructors can now enjoy Problem Roulette without needing to leave Canvas or other LTI integrated services. If you are an instructor interested in integrating your course please contact: problemroulette-support@umich.edu

Adaptive Question Difficulty

This update introduces a new “adaptive question difficulty” option for courses on the platform. If an instructor chooses to enable this feature, Problem Roulette will adapt as a student progresses through a study session and provide them with subtle nudges toward easier or more difficult content to keep them engaged.

System Generated Practice Collections

Students will now see “collections you might like” on the homepage. These collections of relevant questions are automatically generated using aggregated data.

Content Pipeline

Importing exams into Problem Roulette has never been easier. Our new content pipeline reduces instructor workload to only tasks requiring subject matter expertise and leaves the rest to us. In addition, Problem Roulette can now easily support exams stored in Canvas, Google Drive, Word, and more.

Per-Semester Topics and Topic Groups

Instructors now have the option to enable and disable topics and groups of topics on a per semester basis. E.g. if you teach certain topics only in Spring or Fall, instructors can set a semester and Problem Roulette will automatically hide or show that to your students.

Instructor Toolkit

We created an Instructor Toolkit full of feature descriptions, how-tos, and best practices to help instructors get the most out of Problem Roulette in their courses.

Custom Icon Set

We were lucky to have a student fellow design and build a custom icon set to guide users through the Problem Roulette experience.

Instructor Analytics by Term

Instructors can now review historical course analytics by term; you can see this on the course analytics page. Sorry, but this is visible for instructors only. That being said, students can always view their own analytics on their dashboard.

New Courses / Coming Soon

A couple new courses have started to make their way onto Problem Roulette; it looks like both PSYCH 401 and BIO 171 will be coming soon. Want to see one of your courses on Problem Roulette? Request a new course.

Study Session Creation Improvements

We have a new process that helps guide students when creating a new study session. Our goal with this change was to make it more simple and to highlight more study modes and features.

Question Editing Overhaul

We’ve made it easier for instructors to review and edit questions within the Admin Console. Sorry; that pge is only for instructors or Problem Roulette admin.

Content Manager Joins PR Team

Our new Content Manager reviews flagged content, makes content updates, and encourages instructors to address student feedback to maintain updated content.

Homepage Stats

Students can now see how many other people are studying at any one time at the top of the homepage. In addition, some other new stats have been added at the bottom of the homepage.

Performance Upgrades

The homepage should now load a lot more quickly when lots of users are on Problem Roulette. We’ve also been able to reduce the time required to load a new question from as many as 10 seconds in some cases to just 2 seconds.

Question Feedback

We've updated the way students can give feedback on questions and the way instructors review feedback.

Have an idea about how we could improve the Problem Roulette experience?

Contact Us