Quality Assurance for blended and online courses

                        California State University San Marcos                        Quality Online Learning and Teaching Best Practices        2021-2022

Proposal Summary:  Through the years CSUSM has provided training and support to faculty of significant pedagogical strategies to create engaging and quality online courses for our student community. CSUSM has a continual systematic approach centered on professional development (PD) and peer QLT evaluations, and QM training through the Faculty Center, in collaboration with Academic Technology Services (ATS). The Faculty Center continues offering training and other support and resources for faculty who are teaching their courses online: Faculty Center 


Campus QA Goals

Campus Goal for Quality Assurance

This past year, AY 2021-2022, CSUSM increased programming by offering a series of talks and virtual meetings to aid our faculty teaching online. In addition, the Faculty Center has a considerable Teaching and Learning Online Workshop series and assessment website to provide constant support:

  • Our plan is to continue evaluating courses from the 4 Colleges and disciplines not previously represented in our reviews. We are going to focus on lower-level GE courses and new programs;
  • Continue selecting faculty to complete CSU Chancellors Office Certification in spring 2023;
  • Apply the QLT instrument in our CSUSM review process to at least 10 new courses (fall 2021/spring 2022). We keep focusing on lower-level GE courses and new programs. We encourage our faculty to take course “Applying the QLT rubric” through the chancellor’s office during the review process. Faculty will have to make the changes in their courses to meet the 24 Core objectives and 85% mark by spring 2021. Faculty will be incentivized with $500.00 after meeting the QLT Core-24;
  • Offer incentives to faculty who have had courses reviewed to address the peer-reviewed recommendation and complete the Core-24. Our plan is to have the Faculty Fellow and ATS team reach any faculty who did not achieve 85% of the Core 24 and offer them support to complete the Core-24. We will also do outreach to faculty and staff to increase consciousness and understanding of QA services;
  • Over the academic year, the Faculty Fellow for Online Teaching and the Faculty Center will provide workshops to prepare all faculty to teach online using Canvas and the new QLT rubric in Fall 2022. 




Quality Assurance Lead(s)

  • Cynthia Meléndrez, Faculty Fellow for Quality Online Learning and Teaching


     

  • Allison Carr, Faculty Center Director


  • Barbara Taylor, IITS Academic Technology Services Director


  • Terri Georgopoulos, Instructional Development Services



  • Lea Roberg-Chao, Instructor of Kinesiology, QLT Team Leader


Supporting Campus Partners

Faculty Center, Provost, Current CSUSM faculty and stuff, University Library, Extended Learning, Instructional Designers (IDS), and Instructional and Information Technology Services (IITS).


Campus Commitment Toward Sustainability of QA Efforts

  • Instructional and Information Technology Services (IITS) partners with the campus to support CSUSM’s enterprise computing infrastructure and services.
  • California State University San Marcos takes pride in being a diverse and inclusive campus and ensure that students with disabilities have access to the same learning experience as those without.
  • The Quality Learning and Teaching (QLT) program was developed to support faculty to effectively design and deliver online, blended, and flipped courses. The peer-reviewers are fellow CSUSM faculty who have participated in training to apply the QLT rubric to your course, along with a CSUSM instructional designer.                                                          


Summary of Previous QA Accomplishments  2021-2022 year we accomplished the following

  • We exceeded our goal and we reviewed 19 courses were QLT peer reviewed from fall 2021 to spring 2022, the courses represented from 4 different disciplines across CSUSM. Faculty were incentivized with $250.00 in (PD) funds to submit a course for thorough review and additional $250.00 in (PD) funds to meet the Core 24 objectives and the 85% mark. 8 courses are in the process to complete the Core 24 and 85% mark; we expect to be completed during spring-summer 2022. These courses represented all of the colleges: CHABSS, COBA, CEHHS, and CSTEM. We reviewed the following courses, some of which were lower-division GE courses: MATH 212, CHEM 311, KINE 336, HD 301, ANTH 240, BUS 300, FIN 302, FIN 340, PSYC 100, PSYC 336, MDIA 365, PHIL 340, SPAN 201, AMD 308, and CHAD 339.
  • 2 courses are reviewing though the chancellor’s office in spring 2022: Math 212 and PSYC 344.
  • The FC continued programming through Fall 2021 and Spring 2022 - Summer 2022 on current and emerging topics, including informal discussion hours for faculty to receive just-in-time feedback on challenges they were facing in the online classrooms. These conversations included: 
    • Academic Integrity in our Virtual Learning Environment 
    • Checking in with Faculty: Taking Care of Yourself 
    • Reflecting on Teaching Online Using the Community of Inquiry Framework Attendance at each of the workshop ranged from 05-15 and were recorded for future use. 
    • Canvas Summer Teaching Institute.


Faculty Corner

Faculty Facilitators & Learners

"Thank you, It was very helpful and I look forward to working with Terri. She is the best."

"It was a pleasure meeting with you and discussing the results of your QLT Review."

"It was a real pleasure to meet with you, too! I’m excited to work on my course over the summer, and I will definitely be in touch with Terri—she has already been so helpful with other questions/issues I’ve had with my courses in the past."

"I will continue to seek out additional ideas for building a learning community online. Thanks for a very informative course!"

"I really enjoyed this FLC, and it couldn’t have happened in a “better” moment. Great job, thank you!"

"Though I believe I meet some of the key objectives on this learning mode, I still have much more to improve upon."

  




Congratulations Certified CSU-QLT Courses


Faculty
Course
Date
Emily MerryweatherPositive Psychology (PSYC 344)

04/21/2022
Karen Kinnison
Mathematics for K-8 Teachers (MATH 212)

05/05/2022


Quality Assurance Results

Training Completions

We provide the following trainings in our campus: Online Teaching Faculty Learning Community , Canvas Summer Institute, and applying the  QLT instrument.


Online Teaching Faculty Learning Communities

2020-2021

Bulaporn Natipagonn-ShahSchool of Nursing


Angelica RuizSociology

Kevin KilpatrickSociology

Elisa GeissPsychological Science

Marion GeigerModern Language Studies

Anne DabbPhilosophy
2019-2020Anabel Del ValleModern Language Studies

Bettina SernaSociology

Isabella JanovickMarketing

Kathy FullerHuman Development

Michelle Ramos-PelliciaModern Language Studies

Oscar AmayaWomen, Gender, and Sexuality Studies

Patrice Amon School of Arts

Tito ZamalloaMarketing

Zahra SamirModern Language Studies
2018-2019Marya Toledo-YildizModern Language Studies

Verónica ArenasModern Language Studies

David BwambokChemistry

Nicoleta BatemanLinguistics 

Christopher HardnackSociology 
2017-2018María Gómez-MartinModern Language Studies

Gloria PindiCommunications

Robin MarionSchool of Education

Sheri BiroNursing

Lisa BandongPublic Health

Kelsey Young Social Work

William ByunBussines Administration

QLT/QA Training 2017 - 2021

Emily MerryweatherPsychology 
Sarah JayyousiSocial Work
Aleksandria GrabowPsychology
Juliet Falce-RobinsonLinguistics 
Elvis NgwayuhCommunication
Rachel NortzSpeech - Language Pathology
Kathy Fuller Human Development 
Christopher HardnackSociology
Marya Toledo-YildizModern Language Studies
Verónica ArenasModern Language Studies
Oliva VargasModern Language Studies
Sheri BiroNursing
Tara MarkoNursing
Chandrasen SoansBiology

QA Training Completions

QM 2012-2020
QLT 2012-2020
QLT 2021
Total
23
52
8
90


Course Peer Review and Course Certifications

As part of the Faculty Learning Community, faculty participants receive benefit of peer feedback during course development, and as part of campus-based QLT internal review after course is taught.

Campus Reviewers

  • Lea Roberg-Chao (Lead)
  • Kathy Fuller
  • Christopher Hardnack
  • Sheri Biro
  • Cynthia Chavez-Metoyer
  • Verónica Añover (Lead)
  • Tara Marko
  • Cynthia Meléndrez (Lead)
  • Gary Veale
  • Pam Kohlbry (Lead)
  • Marya Toledo-Yildiz
  • Verónica Arenas
  • Emily Merryweather
  • Rachel Nortz
  • Aleksandria Grabow

Campus IDS

  • Barbara Taylor (Director of IITS)
  • Susan Eldridge
  • Terri Georgopoulos

Courses Reviewed

Year

Course

Course Name

Faculty

Spring 2022

PSYC 100

Intro to Psychology 

Matthew O’Brien


PHIL 340

Ethics and Environment 

Anne Dabb

 

SOC 360

Research Methods

Kevin Kilpatrick

 

SPAN 201

Intermediate Spanish I

Veronica Añover

 

AMD 308

Audio Art and Sound Design

Jeffrey Ray

 

SOC 419

Inequalities and Health

Flor Saldaña

 

CHAD 339

Exceptional Children and Adolescents

Allison Jobin

 

EDRL 681

Teaching Literacy for the 21stCentury

Christiane Wood

Fall 2021

MATH 212

Mathematics for K-8 Teachers 

Karen Kinnison

 

PH 513

Social and Behavioral Determinants 

Lisa Bandong

 

CHEM 311

Chemicals and the Environment

Selakilli Thiyagarajah

 

KINE 336

Nutrition for Health and Exercise

Tracy Daly

 

HD 301

Theories of Human Development

Rafael Hernandez

 

ANTH 240

Intro to Biological Anthropology 

Sarah Walker

 

SOC 443

Sociology of Law

Sheri-Lynn Kurisu

 

BUS 300

Business Professional Development

Tito Zamalloa

 

FIN 302

Finance 302

William Byun

Spring 2021

GES 103

Life and Environment Science Around Us

Sara Abboud


EDAD 622A

Research Methods in Education

Theresa Meyerott

Fall 2020

CHEM 201

Chemistry 1

Lenuta Gonzales


PHIL 110

Philosophy I

Hugh Afshari

Summer 2020

SOC 360

Quantititive Research Methods

Kristin Bates


PSYC 344

Positive Psychology

Emily Merryweather


BIO 339

Conservation Biology

Bill Kristan


EDUC 624B

Professional Field Studies

Josie Jackson


AIS 240

American Indians and Environmental Issues

Dina Gilio-Whitaker


SPAN 201

Intermediate Spanish I

Silvia Rolle-Rissetto


SSCI 325

Animals in Society

Mary Roche

Spring 2020

GBST 300

Perspectives in Globalizations

Simati Meshack


SOC 442

Analysis of the Justice System and Criminal Law

Karen Glover


SOC 320

Sociological Theory 

Bob Roberts


HD 102

Preparatory Skills for Human Development 

Kathy Fuller

Fall 2019

LTWR 100

Introduction to Literature

Martha Stoddard Holmes


SPAN 102

Beginning Spanish II

Michelle Ramos-Pellicia


SPAN 101

Beginning Spanish I

Marya Toledo-Yildiz

Spring 2019

EDUC 602

Schooling in a Multicultural Society

Caroyn O'Gorman-Fazzolari


ECON 445

Gender and Development

Ranjeeta Basu


SOC 303

Families and Intimate Relationships

Adam Shapiro


SOC 320

Sociological Theory

Chris Hardnack

Fall 2018

SPAN 201

Intermediate Spanish I

María Gómez-Martín


MLAN 370

Literature of Spanish and Portuguese Speaking

Juliet Falce-Robinson


EDUC 620

Curriculum Innovations and Applications

Mark Reardon


SLP 251

Language Development and Assessment for Practitioners

Rachel Nortz


HD 300

Administration in Human Services Settings

Teru Tokokawa

Spring 2018

SPAN 102

Beginning Spanish II

Darci Strother


EDUC 606

Foundations of Literacy and Literacy

Erika Daniels


HIST 131

U.S. History 1877-Present

Kimber Quinney


EDUC 619

Teacher Inquiry to Improve Student Learning

Moses Ochanji


EDUC 622

Research Methods in Education

Rong-Ji Chen


PHYS 357

The Science of Speech and Hearing

Stephen Tsui

Fall 2017

NUR 440

Community Health Nursing

Susan Andera


NUR 447

Public Health Nursing Practicum

Susan Andera


EDST 422

Special Education

Matthew Evans

 

Student Quality Assurance Impact Research 

We continue designing  better ways to disseminate and implement  “best practices in online and hybrid teaching” culture through our faculty.

Development of Campus QA Resources

Teaching & Tech Tips Videos

Academic Technology Services


Teaching & Learning Online Workshops Series

The Faculty Center at CSUSM has served as a platform to offer the following resources to improve online teaching:


Accessibility/UDL Efforts

  • Cougar Courses ALLY
  • Partnership with DSS
  • UDL and Accessibility workshops through IIDS

Next Steps for QA Efforts 

Goal 1: Recruit faculty to participate in the CSUSM QLT review and CSU CO Certification

  1. Provide incentives and training to faculty who did not complete the cycle of review. Some faculty started the QLT Review process but stopped short of achieving the 85% Core 24. Timeline: Spring 2022: Identify and contact faculty; Fall 2023: Finalize those reviews.
  2. Develop an outreach plan for the CSU CO Certification. Identify and contact faculty who have successfully completed CSUSM QLT Certification and encourage them to complete the system-wide certification, in order to have more of our courses in CSU Fully Online Program.

Goal 2: Build capacity to grow the QLT Program by increasing the number of reviewers.

  1. Develop an outreach plan including incentives to encourage QLT certified faculty to become reviewers. We initiated this goal in 21/22, and had a small faculty response. Without increasing reviewers, we cannot increase the number of courses reviewed. By tapping into faculty whose courses have already been reviewed, we can offer these faculty the opportunity to give back to their colleagues as reviewers, as well as continue to develop in their own online teaching. 

Goal 3: Continue to provide professional development opportunities to improve online teaching. 

  1. Provide ongoing support for faculty as they transition to new online teaching modalities throughout fall 2022.
  2. Assess the needs of faculty as we continue to add courses to online offerings.