Skip to main content

What’s new on Problem Roulette?

The Problem Roulette team is always working to improve the overall experience on our platform for both students and instructors. Here’s what we’ve been updating, adding, or improving:

abstract shapes

New Course!

PUBHLTH 512: Principles Of Epidemiology For Public Health launched in Problem Roulette in the Winter 2023 term. Want your course to be the next new course on Problem Roulette? Contact problemroulette-support@umich.edu to get started.

LTI 1.3 Upgrade

Problem Roulette’s LTI integration has been updated to include support for LTI 1.3.

Edit exam date (admin)

Team Members can add, edit, and delete topic groups and topics for exam dates from the Admin Console.

New Course!

GF_Periodontics joined Problem Roulette in Winter 2023 as a new use case for the tool — instead of a single course, Periodontics students can use Problem Roulette to review content across their entire program of study to refresh knowledge or prepare for culminating exams. Want your course to be the next new course on Problem Roulette? Contact problemroulette-support@umich.edu to get started.

Question Taxonomy Field

A new field in the Create Question and Edit Question forms provides a fixed set of tags to characterize questions as Factual, Conceptual, Procedural, or Metacognitive. This feature lays the groundwork for future research and student readiness metrics.

Ability to archive questions

Team Members who choose to delete content will no longer be taking a permanent action. Instead, deleted content will remain archived and retrievable.

New Course!

The Problem Roulette team was delighted to welcome BIOSTAT 501 during the Fall 2022 term. BIOSTAT 501 is the first online course to study with Problem Roulette and the first to add the tool to Coursera with our LTI integration. Want your course to be the next new course on Problem Roulette? Contact problemroulette-support@umich.edu to get started.

New and improved Course Settings and User Permissions pages

The Course Settings and User Permissions pages of the Admin Console are nicer to look at and easier to use than ever. Users have been relabeled Team Members for clarity.

Question Sets - Confirmation before emailing enrolled students

The addition of this confirmation step gives Team Members peace of mind when emailing a Question Set to the enrolled students in your course.

Introducing Exam Dates

Important Dates have been repurposed to Exam Dates in the Admin Console. Team Members can link topics to exam dates each term, and Problem Roulette will eventually use Exam Dates to develop smarter, more accurate topic proficiency estimates.

Section Awareness

An update to Problem Roulette’s auto-enrollment feature laid the foundation to make Problem Roulette aware of term-specific enrollment information, such as which section of a course a student is enrolled in.

Terms of Service and Privacy Policy

We’ve added our Terms of Service and Privacy Policy to the footer of Problem Roulette.

Clearer view of questions while creating Question Set

An expanded question selection interface lets Team Members build custom Question Sets for their students with ease.

Question display: radio vs. checkbox

An updated design for answer choices in Problem Roulette helps students know when questions have one right answer or more than one right answer.

Bulk edit of questions 2.0

We’ve added new capabilities to the bulk edit feature! When you select multiple questions in the Admin Console, you can publish, unpublish, delete, or assign topics to all of them at once. You can also select multiple questions and update the question text for each one from the same page.

Accessibility improvements and brand upgrades

Problem Roulette is a more accessible tool with a larger font size that is easier to read and a color palette that passes the color contrast ratio test. This fresh color palette and a modern font bring new energy to your study sessions, while maintaining Problem Roulette’s classic aesthetic.

Performance improvements

Performance upgrades for the PDF Exam Export and the Site Analytics page brought these newer features up to speed.

QTI Refinements

Improvements to the QTI import feature include setting the topic created on import to inactive, automatically pulling question titles from the LMS, and allowing for more flexibility in the name of the uploaded file.

Return to the same location when editing questions

When you save your edits to a question, Problem Roulette automatically returns you to the page of the question list that you were working from.

Bulk edit of questions

Editing questions just got a lot easier! Now you can select multiple questions in the Admin Console and publish, unpublish or delete all of them at once.

Download all questions option for superusers

Superusers now have the ability to download a .csv file of all the questions in a course, a useful option for large-scale content initiatives. This feature is not available to instructors at this time.

Persistent content for multipart questions

The multipart question feature is now fully-functional! Both Study Mode and Exam Mode will respect the order of multipart questions, even if the student chooses a smaller number of questions for their study session.

Exam export 2.0

We’ve made some quality improvements to the printable PDF download for practice exams.

Topic Management Enhancements: Removal of Topics

Before deleting a topic, users will be prompted to reassign its questions to an active topic and can migrate questions in bulk.

New course!

The Problem Roulette team is thrilled to welcome a new computer science course for Winter 2022. EECS 203: Discrete Mathematics used our new QTI import feature to offer a starter set of over 200 questions. Want your course to be the next new course on Problem Roulette? Contact problemroulette-support@umich.edu to get started.

Native Support for QTI 1.2

Instructors have a new option for importing questions to Problem Roulette themselves. In addition to .csv files, instructors can now import QTI .zip files in the Admin Console. This empowers instructors to easily import content downloaded from Canvas (and anywhere that will download .zip files in QTI version 1.2). For more information, check out our Instructor Toolkit.

New Option for Displaying Histogram of Student Answers

Instructors have more flexibility around if and when students can see a histogram of how many students chose each answer option for a question. In addition to the existing option to “Display answer histogram after students answer a question,” instructors can now set a specific number of failed attempts after which to show the histogram. This option is available in the Settings tab of the Admin Console.

Show Topic Accuracy During Topic Selection

When selecting which topics to include in a study session in Study Mode, students will now see the average overall course accuracy for each topic, as well as the number of questions in each topic.

Algorithmic Question Selection: Bias against previously-seen questions

Problem Roulette now considers which questions a student has seen before when serving up random questions in Study Mode. Students will first see questions they’ve never seen before in any session for the course, followed by questions they’ve seen before but not in the current study session.

Saved Questions Quiz

Students have more control over their studying with the ability to take a quiz from their Saved Questions. As students save questions in a study session, the quiz becomes automatically available in Exam Mode under “My Practice Exams.” Students can also start the quiz anytime from My Dashboard > Saved Problems > Study Saved Problems.

PDF Download/Printable Export of an Exam Template

Students and instructors have a new option to download and/or print a practice exam. For students, the download option is available in the top right corner when taking a practice exam. Instructors can start the exam from the Exam Templates tab of the Admin Console and select Download from the top right corner.

New Database Migration

Your study experience is faster than ever! Problem Roulette is running twice as fast thanks to a migration to a new database in the cloud.

Improvements to Group Study Mode

Group Study Mode better facilitates ongoing study groups by allowing students to resume in-progress group study sessions. Students enrolled in multiple courses on Problem Roulette can also join a study session in another course without losing their current group session.

New Exam Mode Experience

Students can now enjoy a dynamic new upgrade to Problem Roulette’s Exam Mode, including the ability to enter notes to themselves during a session as well as save questions to their dashboards for later review.

Student Dashboard Redesign

Problem Roulette’s student dashboard has a brand new design, including UI improvements and usability improvements such as the ability to filter, sort, and search saved problems.

Notification Packages

Now available on the student dashboard, students can opt to have Problem Roulette email them regular study reminders to help reduce cramming and make studying a habit. Students can select one of five levels of engagement based on their preferences for the frequency of the reminders and the number of problems to study each time. From these reminder emails (or their dashboards), students can click into an auto-generated study session and work through the number of problems they specified.

Topic Management Enhancements for Instructors

Instructors have a new ability to show or hide inactive topics when editing questions. Courses now automatically default to hiding inactive topics, but instructors can change this in their Admin Console under Settings > General Options.

Important Dates

With this exciting new feature, exam dates and other important course milestones can inform the active/inactive status of topics and topic groups. Instructors can now add important dates to their course and link them to certain topics or groups, reducing student confusion around what to study and removing the need for instructors to manually activate topics as a course progresses.

Improved Canvas Integration

Students who access Problem Roulette via their Canvas course are now conveniently directed to their specific course page to start studying.

Inline code formatting

Problem Roulette now preserves font size and formatting when importing new problems.

Improved Import of Canvas Content

This latest improvement to our content pipeline allows bulk imports of multiple-choice quizzes stored in Canvas. Our current import record is 24 quizzes at once!

New course!

The Problem Roulette team is thrilled to welcome a new course from the School of Kinesiology. AES 220: Applied Human Physiology launched on Problem Roulette during the Winter 2021 term using our improved Canvas content import. Want your course to be the next new course on Problem Roulette? Contact problemroulette-support@umich.edu to get started.

Promo Video

Learn about the features and benefits of Problem Roulette in less than 3 minutes in this new promotional video created by our Software Portfolio Manager

Group Study Lobby

Finding study partners in Problem Roulette is easier than ever. Students can now set their status to available or unavailable for Group Study invitations. When students create a Group Study session, they can see which other students are online and accepting invitations. Invited students are notified in-app if online and by email if offline.

Study Session Summary Pages

When students finish a study session, they’ll be greeted with a new and improved summary of their studying, including their overall accuracy percentage, number of correct answers, duration of session, and a list of all of the problems they completed in the session. Students can filter the list by correct/incorrect answers and by topic, reveal the correct answer for problems they got wrong, and save problems to their dashboard to review later.

Support for Importing Equations

Problem Roulette now supports importing equation-heavy content through the use of Text2QTI, a tool that converts plain text files into Canvas-supported quiz files. If you are an instructor interested in using Problem Roulette with equations, please contact: problemroulette-support@umich.edu.

Course Icon Redesign

Students and instructors can now enjoy a fresh set of course icons designed and built for Problem Roulette by a student fellow.

Study Tips

Problem Roulette encourages students to use 4 of the best study strategies known to research. To help students make the most of those strategies, our Behavioral Science Team compiled a set of study tips, including tips for online classes and remote learning. Students and instructors can view those tips on our new Study Tips page.

Canvas Integration

Students and instructors can now enjoy Problem Roulette without needing to leave Canvas or other LTI integrated services. If you are an instructor interested in integrating your course please contact: problemroulette-support@umich.edu

Adaptive Question Difficulty

This update introduces a new “adaptive question difficulty” option for courses on the platform. If an instructor chooses to enable this feature, Problem Roulette will adapt as a student progresses through a study session and provide them with subtle nudges toward easier or more difficult content to keep them engaged.

System Generated Practice Collections

Students will now see “collections you might like” on the homepage. These collections of relevant questions are automatically generated using aggregated data.

Content Pipeline

Importing exams into Problem Roulette has never been easier. Our new content pipeline reduces instructor workload to only tasks requiring subject matter expertise and leaves the rest to us. In addition, Problem Roulette can now easily support exams stored in Canvas, Google Drive, Word, and more.

Per-Semester Topics and Topic Groups

Instructors now have the option to enable and disable topics and groups of topics on a per semester basis. E.g. if you teach certain topics only in Spring or Fall, instructors can set a semester and Problem Roulette will automatically hide or show that to your students.

Instructor Toolkit

We created an Instructor Toolkit full of feature descriptions, how-tos, and best practices to help instructors get the most out of Problem Roulette in their courses.

Custom Icon Set

We were lucky to have a student fellow design and build a custom icon set to guide users through the Problem Roulette experience.

Instructor Analytics by Term

Instructors can now review historical course analytics by term; you can see this on the course analytics page. Sorry, but this is visible for instructors only. That being said, students can always view their own analytics on their dashboard.

New Courses / Coming Soon

A couple new courses have started to make their way onto Problem Roulette; it looks like both PSYCH 401 and BIO 171 will be coming soon. Want to see one of your courses on Problem Roulette? Request a new course.

Study Session Creation Improvements

We have a new process that helps guide students when creating a new study session. Our goal with this change was to make it more simple and to highlight more study modes and features.

Question Editing Overhaul

We’ve made it easier for instructors to review and edit questions within the Admin Console. Sorry; that pge is only for instructors or Problem Roulette admin.

Content Manager Joins PR Team

Our new Content Manager reviews flagged content, makes content updates, and encourages instructors to address student feedback to maintain updated content.

Homepage Stats

Students can now see how many other people are studying at any one time at the top of the homepage. In addition, some other new stats have been added at the bottom of the homepage.

Performance Upgrades

The homepage should now load a lot more quickly when lots of users are on Problem Roulette. We’ve also been able to reduce the time required to load a new question from as many as 10 seconds in some cases to just 2 seconds.

Question Feedback

We've updated the way students can give feedback on questions and the way instructors review feedback.

Have an idea about how we could improve the Problem Roulette experience?

Contact Us