Four additional faculty have earned Quality Matters (QM) certification of their online or hybrid courses during the Spring and Summer 2023 semesters following peer reviews as part of the Quality Matters Impact (QMI) program. This brings to 18 the total number of certified courses at UMBC. More than half of the QM certified courses in the University System of Maryland are from UMBC.

Faculty participants received feedback from certified QM subject matter experts and peer reviewers as part of a formal course review. They also earned a digital credential for completing the Applying the Quality Matters Rubric (APPQMR) online workshop in preparation to take a course through the peer review process.

The most recently certified courses are: 

To encourage, identify, and share effective practices in the use of data to inform teaching and learning, the Provost's Office has once again awarded learning analytics mini grants to six faculty and two staff for the 2023-24 academic year (the three new grants and three renewals are described below):

Katie Birger (Public Health): "Analyzing Factors Affecting Student Success in Public Health Courses." This new proposal aims to standardize PBHL 300: Research Methods in Health, to address observed inconsistencies that potentially impact students' success in the subsequent PBHL 420 course (Epidemiology). Birger plans to investigate these discrepancies by analyzing data from Blackboard sections of both courses, to identify variables such as instructor differences, textbook usage, attendance, homework submission, and access to Panopto recordings that might affect student success rates. The findings will help standardize effective learning activities and enhance the learning assessment plan. To do so, Birger aims to implement and test evidence-based curriculum changes in PBHL 300 and then monitor student performance in PBHL 420. The overall goal is to improve student knowledge and skills in public health, better preparing them for the workforce or graduate education and enhancing the continuous improvement of the Public Health curriculum.

Joby Taylorand Emily Passera (Shriver Center): "Knowing the student, knowing the staff: How a reciprocal relationship alongside data-informed insights improves student outcomes in community engaged learning."This new proposal will delve into the Shriver Center's student data to help improve practitioners' understanding of what interventions and environments best scaffold success. Additionally, the researchers will investigate the potential benefits of incentivization through micro-credentialing. Through these approaches, Taylor and Passera hope to support both student growth and improve their pathways to academic success.

Rebecca Williams(CS/EE): "Improving Student Visual Literacy & Critical Thinking in CMSC 436/636 (Data Visualization)."This new proposal focusing on course redesign as an intervention to address student misconceptions about visualizations, such as the misunderstanding that simple, easy-to-read, charts are always effective and the belief that data visualizations are entirely objective. Williams' proposed interventions include having students search for, annotate, and critique visualization examples, to supplement those she provides (and models) herself. As such, students are more likely to develop these skills and the process is likely to lead to the long-term retention of these same skills.

Sarah Bass and Tara Carpenter(Chemistry): "Nudging CHEM 101 Students with myUMBC Personal Posts."This is a renewal proposal building off of Carpenter's prior efforts to advance student metacognition and responsibility for learning as well as conducting focus groups about student motivation in moving from general to organic chemistry. Specifically, Bass and Carpenter will use myUMBC's "personal post" functionality to nudge students in their initial exposure to and use of course resources for practice and exam preparation in CHEM 101 "Principles of Chemistry I," which they are co-teaching this semester. DoIT staff have also worked with Math and Psychology faculty to use myUMBC personal posts in this way to scale course-based nudging of students. As such, Bass and Carpenter will customize messaging focused on nudging students about their engagement and preparation for key course milestones and assessments.

Karen Chen(Information Systems): "Learning Analytics by Students for Students." In this renewal proposal building on her 9/30/22 LA community of practice presentation of the same name, Chen intends to further explore student agency and literacy in the development and use of learning analytics. She's particularly interested in leveraging de-identified UMBC data to inform student analytics projects in two data science courses, IS 428 "Data Mining Techniques and Applications" and IS 733 "Data Mining" in Fall 2023. These include the use of "Spaced Practice" in General Chemistry courses as well as student use of and anonymous feedback about the myUMBC Check My Activity (CMA) feedback tool for students.

Cody Goolsby-Cole(Physics): "How Does Student Performance on Ungraded Practice Questions Correlate to Performance on Exams?"In this renewal proposal, Goolsby-Cole seeks to increase student use of a growing CNMS practice of using online questions banks to prepare for high-stakes exams. Specifically, he has used ungraded practice questions, in terms of points contributing to a final grade, but including correct and incorrect answers displayed to students. Students in his PHYS 122 "Introductory Physics II," who use the practice questions clearly perform better on unit, midterm and final exams, but he'd like to see more students do so. He plans to continue development of his practice questions, but also do more proactive nudging with myUMBC personal posts (similar to Carpenter and Bass in Chemistry described above) to see if and how more students might use and benefit from the practice question bank.

"On behalf of Interim Provost Dauwalder, we're pleased to continue offering these learning analytics mini grants to help faculty use institutional data that might inform their course designs and instruction to the benefit of our students," says Robert Carpenter, associate provost and deputy CIO. "We are excited by these interesting projects and look forward to what the faculty may find."

These one-year learning analytics awards are renewable pending receipt of a final report, paper submitted for publication or conference presentation. In addition to use of UMBC's Report Exchange (REX) data warehouse, and a Tableau "viewer" license, faculty recipients can consult with staff from Analytics and Business Intelligence, Instructional Technology and Institutional Research and Decision support (IRADS). 

For more information about this year's workshops, speakers and another learning analytics mini-grant call for proposals to be announced in Spring 24, please visit doit.umbc.edu/analytics/community.

By John Fritz

• Image "Alt" tag: "2023-24 UMBC Learning Analytics Mini Grant Recipients Katie Birger, Emily Passera, Joby Taylor, Rebecca Williams, Sarah Bass, Tara Carpenter, Cody Goolsby-Cole, and Karen Chen"

The Division of Information Technology (DoIT) is conducting a comprehensive examination of our institutionally-supported lecture capture platform, Panopto. This project involves analyzing current usage patterns and user satisfaction to provide insights into existing strengths and potential areas for improvement. To gather feedback, we are asking all faculty and staff with any experience using Panopto or any other video recording application to please take 5 minutes to complete the following anonymous survey.

Thank you very much for your time and participation! Your insights will  help assist DoIT better understand lecture capture needs at UMBC and improve our support moving forward. 

Connect with Instructional Technology

As always, if you have any questions about teaching, learning, and technology at UMBC, please consider the following options:

• Check our extensive FAQ collection | What's new in Ultra? | Known Issues 
• Open a ticket via RT
• Follow the Instructional Technology & DoIT myUMBC groups
• Request a consult with instructional technology staff
• PIVOT | Academic Continuity | Keep On Teaching | Student Technology Resources

DoIT's Coordinator of Learning Analytics, Tom Penniston, recently presented his paper (UMBC login req'd), Toward a New Paradigm: Learning Analytics 2.0, at the 25th International Conference on Human-Computer Interaction, HCI International 2023, in Copenhagen, Denmark. The conference focused on adapting design to meet the needs of our evolving world, from the rise of deep fakes and battling the spread of extremist propaganda, to the legal and social implications of large language model AI, to supporting the needs of the neuro- and ability- diverse populations we serve. 

Penniston's paper analyzed ongoing UMBC efforts to leverage predictive machine learning models to inform empathetic behavioral nudges to support student success. He argues that through intentional, rigorous course design we can align intervention strategies with direct measures of learning at scale and thereby best support our students' individualized needs, while simultaneously improving institutional measures of success, such as reduced DFW and 6-year graduation rates.

Attending the conference was a great professional opportunity for Penniston, who was able to represent his department and the university, learn more from experts within the community, and network with peers. "It's really amazing and humbling to be surrounded at work by folks who encourage and support me to pursue these kinds of opportunities!" said Penniston.