Quality Assurance for blended and online courses

2018-19 — Fresno State— Quality Assurance Change Management 

Proposal Summary:  At Fresno State we have adapted our focus to meet the needs of our faculty where they are currently. Our Center for Faculty Excellence has been tracking multiple data points including student enrollment, faculty training, online courses offered and the DWF rates. It is evident that we need more faculty to participate in the CO lead Q1 and Q2 efforts. To do so, we are currently accomplishing this by leveraging resources through the Office of the Provost, administrators, and existing campus centers while collaborating with Faculty QLT Advisory Committee. In 2019/20 we will have at least 100 faculty complete QLT I and QLT II training and have an additional 20 faculty participate in our Online and Blended Teaching Certificate programs.

Campus QA Goals

Campus Goal for Quality Assurance

  • Our goal was to have a minimum of 65 faculty complete the Q1 and Q2 training offered. 
  • Attend college and departmental faculty meetings to share the implementation for Academic Policy Manual (APM) 206 Policies and Procedures on Technology Mediated Courses and Programs.
  • Meet with all department chairs (n=52) to discuss APM 206
  • Identify and recruit QOLT Advisory Committee members who demonstrate a willingness to share new instructional teaching and learning methods with faculty in their school or college.
  • Continue to identify and expand the number of faculty to be part of our campus QLT Review Team.
  • Continue and expand our existing partnership with the Office of Institutional Effectiveness to collect and review data that tells our stories about online learning and professional development at Fresno State.

Quality Assurance Team

  • Dr. Maria-Aparecida LopesMaria-Aparecida Lopes, QA Faculty Fellow
  • Jolynne Blake, Instructional Designer
  • Mary Bennett, Instructional Designer
  • Sue Yang, Instructional Designer
  • Walt Hebern, Instructional Designer
  • Cory Cowan, Institutional Effectiveness Analyst 
  • Dr. Bryan Berrett, Director
    Quality Assurance Coordinator

Change Management Team

Our online education strategy is shaped by our Change Management team. In order to be successful we need effective sponsorship, good change management, and consistent project management/implementation. The team includes:

  • Dr. Dennis Nef, Vice Provost - Executive Sponsor
  • Dr. Rudy Sanchez, Associate Vice President for Strategic Initiatives - Change Management Lead
  • Dr. Bryan Berrett, QA Campus Coordinator - Project Management Lead
  • Mary Bennett, QA Trainer and Instructional Designer
  • Dr. Maria-Aparecida LopesMaria-Aparecida Lopes, QA Faculty Fellow
  • Dr. Melissa Jordine, Director of Academic Assessment
  • Dr. Xuanning Fu, Dean of Undergraduate Studies and AVP for Office of Institutional Effectiveness

Campus Commitment Toward Sustainability of QA Efforts

  • Academic Policy Manual (APM) 206 Policies and Procedures on Technology Mediated Courses and Programs.
  • Large scale change management and formal QLT review committee as an academic senate sub committee has been presented to the Academic Senate Executive Committee.
  • Our scheduling office created attributes to identify the difference between our blended and totally online courses.

Summary of Previous QA  Accomplishments

  • Our campus Academic Policy Manual 206, the Policies and Procedures on Technology-Mediated Courses and Programs, has been approved by our academic senate and President. The policy includes the campus review and approval process required to offer online or blended courses as well as educating all of the constitutes on the requirements. The policy requires administrators and faculty to ensure that all faculty teaching 20% of a course online must complete 15 hours of online training and have their courses reviewed using the QLT instrument.  This will result in a significant increase the number of courses that require a QLT review at Fresno State. In order to ensure that we have the capacity necessary, we formed our QLT Advisory and Planning Committee.
  • Ongoing face to face communications at College Assemblies, department meetings, with faculty, and individually with department chairs.
  • Consistent email and website communication about the APM 206 requirements that all faculty teaching online or hybrid must have successfully completed an online training.

Dissemination of QA Efforts— Conferences 

List the conference(s) attended, who attended, and the link to the presentation — National, Regional, State or Local

Quality Assurance Results

Training Completions

  • 246 faculty completed Quality Assurance courses offered by the Chancellor’s Office since June, 2018.
  • Fresno State now has a total of 479 APM 206 Certified Faculty

Course Peer Review and Course Certifications

  • A total of eight fully online courses were submitted to the Chancellor’s Office for formal course review.
  • There were 24 internal campus course reviews.
  • At least 25 faculty came in to The Lounge in the Center for Faculty Excellence to work collaboratively with colleagues on QLT assignments or to get 1:1 assistance from an Instructional Designer.
  • Two online courses received QLT Certification and the remaining six are still in the review process.

Quality Assurance Impact on Faculty

  • “This has been the most intense training experience in my 30 years of teaching, here and previously in Oklahoma.”

    “I most enjoyed the back-and-forth dialogues I had with my course instructor. In these dialogues I felt heard and respected. I felt like an individual rather than an anonymous student marching through the course content. I felt that my critiques and questions were taken seriously.”

    ”Universal Design! So excited about it...can't stop thinking about it”

    “I will implement several of the tools that we practiced using, such as YouTube, Soundcloud, and Fligrid. And I will make sure to ALWAYS use captioned audio and video materials!Â

    “I will utilize the UDL best practices in my class. I want to provide students rubrics in the beginning so they know what is expected of them. Lastly, I think accessibility is very important to ensure all students in my class have equal opportunities.”

    “I think I will have more activities to engage the students and encourage collaboration. I am also seeing the positives of short videos from the instructor and having students create their own personal slides with their photo and some background info as an ice breaker.”

Development of Campus QA Resources

Accessibility/UDL Efforts

In 2018-19 our campus piloted Canvas and we had over 700 early adoptors who offered over 3200 courses.

Next Steps for QA Efforts 

  • We will continue to partner with our Office of Institutional Effectiveness to complete a environmental scan of online and blended learning on campus including DWF and achievement gap data to align with GI2025.
  • With that data, our change management team, executive sponsor, and director of assessment will construct a project management timeline and plan that we will be implementing in spring of 2020.
  • These campus goals align with existing Quality Assurance and AL$ programs as well as activities on campus including Universal Design for Learning (UDL) and our implementation of the remediation software Ally.
  • In 2019-20, we estimate that that we will have approximately 100 additional faculty complete training.
  • We will be creating a new website and will showcase at least one formally reviewed and approved QLT certified course from each of our eight colleges.
  • Our current Lessons from the Lounge lunchtime training sessions will be increased to include strategies, tools, and resources specific to online teaching and learning. This will not only include tools but also specific ways in which faculty can meet the QLT objectives.