company or group who is doing online program evaluation?
this information is extracted from the Blend-Online discussion list
Do you know any company or group who is doing online program evaluation? Our school is seeking a consulting group to come to review our online programs and identify areas relate to online learning that we need to improve.
Carrie Halpin, Ph.D. Professor/Instructional Designer & Technologist eLearning & Instructional Technology (eLIT) Virginia Western Community College 3095 Colonial Ave. SW, Roanoke, VA 24015 Office: Brown Library 102 Phone: 540-857-6636 Fax: 540-857-6138 Email: email@example.com
will do both of those things using a fee-for-service model versus a revenue-sharing model like Academic Partnerships or 2U. I have no personal experience with any OPM, but iDesign is the only one I know of that offers that ala carte type service.
more on evaluations regarding online teaching in this IMS blog
How did your institution decide which courses should be converted or designed to be blended and or online? Did you have a particular process, form, or department who made those decisions?
Dana Gullo, M.S.I.T. Senior Instructional Designer York College of Pennsylvania 441 Country Club Road Office: PAC 181C York, PA 17403
Hi Dana: Here at Albright College we have 2 processes. For the traditional program, faculty must get the course approved by the dept chair before it can be offered online. I just need an email from the chair before I will sign a course development agreement with them. Payment is another story. Normally there is a development stipend but if the faculty member wants to keep sole ownership of the course, no stipend is paid. If the administration feels the course would not get good enrollment, they can also decide to not give a stipend. Courses in the traditional program can only be offered online during J term or summer, not fall or spring. For now.
For the non-traditional program, the Director of the program gives approval for courses to be offered online and they can only be gen eds which are offered online here. But if they are designed for the non-traditional, they will need permission to be offered online on the traditional side.
Sounds confusing but we are only in our 3rd year of online courses. There are many more processes and procedures we have developed. If you want to chat, email me off list.
Michele Mislevy Director of Digital Learning & Innovation Information Technology Services
Albright College 610-921-7542
At Binghamton University, academic departments decide if a course should be offered in a blended or online format. There is no process or form that I am aware of, unless individual departments have one. We do not have a separate online or distance learning office that oversees all online courses like some other universities. LMS support is provided by ITS; pedagogical support is provided by the Center for Learning and Teaching.
Most of our online courses are offered in the winter and summer terms. I believe there is only one certificate program in the social work department that is fully online, everything else is just individual courses. This is changing now, as our nursing school is deciding to create some online programs.
Instructional Designer Center for Learning and Teaching
Binghamton University LN 1324A (607) 777-5099
more on online learning in this IMS blog
he EDUCAUSE Blended and Online Learning Constituent Group Listserv
Quick poll – do you require your faculty to be trained how to teach online before they are allowed to teach an online course at your institution?
Kristen Brown, Assistant Director, UofL Online
YES. Our faculty are required to complete two classes. One on using the LMS and the other is a 5-week moderated course called Teaching Online. Both courses are offered online.
Linda C. Morosko, MA Director, eStarkState Division of Student Success
Chad Maxson, EdD │ Dean of Online Learning, Olivet Nazarene University │ Center for Teaching and Learning One University Avenue │ Bourbonnais, IL 60914
Gina Okun Assistant Dean, Online Berkeley College 64 East Midland Avenue, Suite 2 Paramus, NJ 07652
The online academic program director (i.e. MBA, M.Ed.) and I meet with each new instructor to go materials that cover providing instructor presence and best practices in general. I also ask that they sign something that lists 14 online teaching practices we expect as an institution. They also have to complete some LMS training so that they can post announcements, participate in discussions, and manage their gradebook.
We are currently designing a more formal 6 hour online training that is required.
Course design is separate and that’s a 16 week process with our designers.
Tex Brieger Director of Distance Education (814) 871-7134
Absolutely. Also, we give them a stipend to attend the training and develop and online course.
Linda S. Futch, Ed.D. Department Head, Course Design and Development Center for Distributed Learning University of Central Florida
I think the bigger need is for ongoing training for recertification to teach online as technology and online pedagogical models evolve over time.
Kelvin Kelvin Bentley <timelord33@GMAIL.COM>
At Suffolk yes, we do. Over time that went from essentially “how to make the LMS work” to a Faculty Academy where faculty spend an entire semester working as a cohort to examine online pedagogy and best practices. The latter works much better for sound course development.
Doug Kahn College Assistant Dean for IT Operations Suffolk County Community College 533 College Road Selden, NY 11784
I can’t speak of other accrediting bodies, but SACS-COC is fairly clear in its documentation that faculty should be adequately trained before teaching online. Prior to my arrival at U of R in 2015, I worked for 20 years at E. Carolina U. which has a large assortment of online programs and courses. I assisted in the process of designing several online training modules that were to serve as “basic training” (with assessments) for online instructors…directly due to needing to meet accreditation guidelines. As part of documentation for reaffirmation/reaccreditation, had to provide documentation showing that faculty had successfully completed the training. I believe it is required to complete every three years.
Michael Dixon, Assistant Director Center for Teaching, Learning & Technology University of Richmond
I wish we did, but we do not. We run up against contract issues with. Certainly, this could be changed with institutional will but would require a shift in how our agreements with the faculty union.
TRAVIS FREEMAN, MFA EDUCATIONAL DEVELOPER FACULTY AND CURRICULUM DEVELOPMENT CENTRE (FCDC) Office Location: 113 McCaul St, Room 501 T 416 977 6000 x3358 E firstname.lastname@example.org
more on online teaching in this IMS blog
online learning attitudes
Students match their preference for hybrid learning with a belief that it is the most effective learning environment for them.
Despite the fact that faculty prefer teaching in a hybrid environment, they remain skeptical of online learning. Nearly half do not agree online 45% learning is effective.
Students asked what technologies they wish their instructors used more, and we asked faculty what technologies they think could make them more effective instructors. Both agree that content and resource-focused technologies should be incorporated more and social media and tablets should be incorporated less.
more on the use (or not) of ed technology in the classroom in this IMS blog
Embedded Librarianship in Online Courses
Instructor: Mimi O’Malley Dates: October 2nd to 27th, 2017
- Discuss ways to incorporate library services through the learning management system level.
- Examine bibliographic instruction in the virtual classroom through team teaching, guest lecturing.
- Identify librarian roles during the design and development of online courses.
- Assessing embedded librarianship efforts.
Mimi O’Malley is the learning technology translation strategist at Spalding University. She helps faculty prepare course content for hybrid and fully online courses in addition to incorporating open education resources into courses. She previously wrote and facilitated professional development courses and workshops at the Learning House, Inc. Mimi has presented workshops on online learning topics including assessment, plagiarism, copyright, and curriculum trends at the Learning House, Inc. CONNECT Users Conference, SLOAN-C ALN, Pencils and Pixels and New Horizons Teaching & Learning Conference. Interview with Mimi O’Malley
more on embedded librarian in this IMS blog
Tobin, T. J., Mandernach, B. J., & Taylor, A. H. (2015). Evaluating Online Teaching: Implementing Best Practices (1 edition). San Francisco, CA: Jossey-Bass.
- 5 measurable faculty competencies for on line teaching:
- attend to unique challenges of distance learning
- Be familiar with unique learning needs
- Achieve mastery of course content, structure , and organization
- Respond to student inquiries
- Provide detailed feedback
- Communicate effectively
- Promote a safe learning environment
- Monitor student progress
- Communicate course goals
- Provide evidence of teaching presence.
Best practices include:
- Making interactions challenging yet supportive for students
- Asking learners to be active participants in the learning process
- Acknowledging variety on the ways that students learn best
- Providing timely and constructive feedback
- Instructor knowledge
- Method of instruction
- Instructor-student rapport
- Teaching behaviors
- Enthusiastic teaching
- Concern for teaching
8. The American Association for higher Education 9 principle4s of Good practice for assessing student learning from 1996 hold equally in the F2F and online environments:
the assessment of student learning beings with educational values
assessment is most effective when it reflects an understanding of learning as multidimensional, integrated and revealed in performance over time
assessment works best when the programs it seeks to improve have clear, explicitly stated purposes.
Assessment requires attention to outcomes but also and equally to the experiences that lead to those outcomes.
Assessment works best when it is ongoing, not episodic
Assessment fosters wider improvement when representatives from across the educational community are involved
Assessment makes a difference when it begins with issues of use and illumines questions that people really care bout
Assessment is most likely to lead to improvements when it is part of the large set of conditions that promote change.
Through assessment, educators meet responsibilities to students and to the public.
9 most of the online teaching evaluation instruments in use today are created to evaluate content design rather than teaching practices.
29 stakeholders for the evaluation of online teaching
- faculty members with online teaching experience
- campus faculty members as a means of establishing equitable evaluation across modes of teaching
- contingent faculty members teaching online
- department or college administrators
- members of faculty unions or representative governing organizations
- administrative support specialists
- distance learning administrators
- technology specialists
- LMS administrators
- Faculty development and training specialists
- Institutional assessment and effectiveness specialists
Sample student rating q/s
Rate the effectiveness of the online library for locationg course materials
Based on your experience,
148. Checklist for Online Interactive Learning COIL
150. Quality Online Course Initiative QOCI
151 QM Rubric
154 The Online Insturctor Evaluation System OIES
163 Data Analytics: moving beyond student learning
- # of announcments posted per module
- # of contributions to the asynchronous discussion boards
- Quality of the contributions
- Timeliness of posting student grades
- Timelines of student feedback
- Quality of instructional supplements
- Quality of feedback on student work
- Frequency of logins
- 180 understanding big data
- factor structure
187 a holistics valuation plan should include both formative evaluation, in which observations and rating are undertaken with the purposes of improving teaching and learning, and summative evaluation, in which observation and ratings are used in order to make personnel decisions, such as granting promotion and tenure, remediation, and asking contingent faculty to teach again.
195 separating teaching behaviors from content design
more on online teaching in this IMS blog
Nobody’s Watching: Proctoring in Online Learning
There is no single best way to handle proctoring for digital courses, as this community college system pilot discovered.
By Dian Schaffhauser 07/26/17
The Higher Education Opportunity Act of 2008 lays out the rule: An institution offering “distance education” needs to have processes in place for verifying student identity to ensure that the student who registers for a class is the “same student who participates in and completes the program and receives the academic credit.”
OLC (Online Learning Consortium) Innovate conference and shared the solution: a combination of the use of an automated proctoring application and the creation of a network of colleges across the state that would provide no-cost proctoring on their campuses for students attending any of the member schools.
put together an online proctoring working group with “lots of faculty representation,” said Hadsell, which “paid off in the long run.” Other participants included people from testing centers and learning centers. Proctorio, the proctoring solution eventually recommended by the working group, is a web service that can be deployed through Canvas and installed by students with one click
more on proctoring in this IMS blog
20 essential apps to include in online courses
From attending class to talking with peers and professors, and from going to the local bookstore to having everything on a laptop in a dorm room, students on campus typically have a more “organic” learning experience than an online student who may not know how to best access these features of a higher education in an entirely mobile setting.
The essentials for getting started
Computer terms (Android) (Apple): Online learning means you’ll need to know basic computer technology terms. Both apps are free and break down terms ranging from words like “cache” to “hex code,” all in layman’s language.
Mint (Android) (Apple): Online learning students are usually financially savvy, looking for less expensive alternatives to traditional four-year tuition. This app allows students to keep careful track of personal finances and spending.
Study Tracker (Android) (Apple): These paid apps help track the time spent on courses, tasks and projects to help online students better manage their time and be able to visualize unique study patterns with the aim of ultimately improving efficiency.
Wi-Fi Finder (Android) (Apple): It’s a no-brainer: If you’re learning online and on-the-go, you’ll probably need to find a connection!
To access actual courses (LMS)
Blackboard Mobile (Android) (Apple): Access all courses that are integrated with Blackboard’s LMS.
Canvas (Android) (Apple). Access all courses integrated with Canvas by Instructure.
Moodle (Android) (Apple): Access all courses integrated with this open-source learning platform.
My note: No D2L in this list, folks; choose carefully in 2018, when MnSCU renews its D2L license
For access to files and remote annotation
Documents to Go (Android) (Apple): Students can access the full Microsoft Office suite, as well as edit and create new files without requiring a cloud app for syncing.
Dropbox (Android) (Apple): This app allows students to access any-size files from their computer anytime, anywhere. My Note: Google Drive, SCSU File space as alternatives.
iAnnotate (Android) (Apple): Read, edit and share PDFs, DOCs, PPTs, and image files.
Instapaper (Android) (Apple): Recall websites for research purposes; strip away clutter for an optimized view of content; and read anywhere, since no internet connection is needed.
Marvin (Apple): A completely customizable eBook reader that includes DRM-free books, customizable formats, layouts, and reading gestures, as well as highlighting and annotations tools. Considered one of the best replacements for the Stanza app, which is now discontinued.
Pocket (Android): An app that allows students to save websites, blog posts, videos, and other online resources to access at a later time. It also saves the information to the device, meaning no internet connection is needed.
Wolfram Alpha (Android) (Apple): Considered the scholar’s version of Google, this app is a search engine that reveals precise information for natural-language searches. For example, if you ask “What is the graduation rate for Harvard?” the engine will bring up exact numbers with citations and suggestions for similar queries.
For online communication with peers and profs
Dragon Dictation (Android) (Apple): Create text messages, social media posts, blog posts and more by using your voice (speech-to-text). According to the company, Dragon Dictation is up to five times faster than typing on the keyboard.
Evernote (Android) (Apple): Whenever you look at a list of education apps, Evernote is usually listed. This app allows students to scribble notes, capture text, send notes to computers and other users, and much more for ultimate multi-media communication.
Hangouts (Android) (Apple): Google’s social network shines for its own online video chat solution, which lets teachers, students and third-party experts easily videoconference in groups—it’s even been used to broadcast presenters live to packed auditoriums. My note: desktopsharing is THE most important part. Alternatives: SCSU subscription for Adobe Connect. Skype also has desktopsharing capabilities
Quora (Android) (Apple): Ask questions to experts including astronauts, police officers, lawyers, and much more to receive industry-insider responses.
Smartsheet (Android) (Apple): An app that allows students to create task lists and assign deadlines to share with remote group/team members.
Tom’s planner (Web): A Gantt chart-based, online planning tool that uses color-coded charts to reveal work completed and many more features for project management.
more on online learning in this IMS blog
The emergence of the chief online officer position at many institutions is strong evidence that online education is becoming more mainstream
Revenue generation and tuition
most responding institutions have online program tuition rates that are aligned with standard tuition or that are higher. Those higher tuition rates ranged from 12 percent of private institutions to 29 percent of four-year public institutions, and lower than standard tuition rates ranged from 3 percent of community colleges to 37 percent of private institutions. None of the larger online programs reported tuition rates for online students that are lower than standard tuition rates, and 20 percent reported higher tuition rates for online study.
Forty percent of chief online officers in larger programs larger programs use instructional design support, and 30 percent use a team approach to online course design. Ten percent outsource course design.
This kind of course development is in stark contrast to practices of chief online officers in mid-sized and smaller programs. Among the smallest online education programs, 18 percent of chief online officers expect faculty to develop online courses independently, and 53 percent treat instructional design support as a faculty option. This means that a combined 71 percent of smaller programs do not mandate the use of instructional design specialists.
In 13 percent of mid-sized programs, faculty are expected to develop courses independently, and in 64 percent of mid-sized programs, they are free to choose whether or not to involve instructional design specialists, yielding a combined 77 percent of programs that do not require the use of instructional design expertise.
Teaching, learning and technology
The CHLOE survey also asked chief online officers to name three technologies or tools they consider most important or innovative for their institution’s fully-online programs. Eighty-one percent first listed an LMS, while others named audio and video conferencing and lecture capture. The technologies most-cited for second- and third-most important were conferencing, video and lecture capture software. (see Plamen’s effort to start faculty discussion on lecture capture here: http://blog.stcloudstate.edu/coursecapture/)
“There was no sign of much-hyped innovations like adaptive learning, competency-based education LMS solutions, or simulation or game-based learning tools,” according to the study. “Such tools may be in use for specific courses or programs but based on responses to CHLOE, these have yet to achieve institution-wide adoption at any scale.” (see Plamen’s efforts start a discussion on game-based learning here: https://blog.stcloudstate.edu/ims?s=game-based+learning
more on online ed in this IMS blog:
Request from Plovdiv University faculty and teachers from the Plovdiv school district for literature on the issue of online reading for K4 students
- Putman, S. M. (2014). Exploring Dispositions Toward Online Reading: Analyzing the Survey of Online Reading Attitudes and Behaviors. Reading Psychology, 35(1), 1-31. doi:10.1080/02702711.2012.664250
Research continues to emerge that pro-vides us with information about the cognitive skills and strategies relevant to the proficient use of the new literacies of the Internet, but conclusions regarding dispositions and affective variables are notably limited. For this reason, it is important that researchers begin to focus concurrently on both areas to inform the educational community regarding how to meet the rapidly changing needs of our current and future students.
- Coiro, J. (2011). Talking About Reading as Thinking: Modeling the Hidden Complexities of Online Reading Comprehension. Theory Into Practice, 50(2), 107-115. doi:10.1080/00405841.2011.558435
- Hutchison, A. C., Woodward, L., & Colwell, J. (2016). What Are Preadolescent Readers Doing Online? An Examination of Upper Elementary Students’ Reading, Writing, and Communication in Digital Spaces. Reading Research Quarterly, 51(4), 435-454. doi:10.1002/rrq.146
he performance of 1,262 fourth and fifth graders on the Survey of Internet Use and Online Reading.
(c) despite reporting a preference for using the Internet, preadolescent students believe that it is more difficult to use it than to read a book, and believe that they would learn
more from a book than from the Internet;
- Huang, S., Orellana, P., & Capps, M. (2016). U.S. and Chilean College Students’ Reading Practices: A Cross-Cultural Perspective. Reading Research Quarterly, 51(4), 455-471. doi:10.1002/rrq.144
My note: this may seem peripheral study to the request in terms of age, but the cross-cultural study can help the Bulgarian research
Due to the impact of the Internet on reading resources, students’ reading patterns today are different from how they were in the past. College students’ reading practices have moved to different venues with the advent of Internet technology, and the modality has migrated to online reading.
- Naumann, J. (2015). A model of online reading engagement: Linking engagement, navigation, and performance in digital reading. Computers In Human Behavior, 53263-277. doi:10.1016/j.chb.2015.06.051
model of online reading engagement is outlined. This model proposes that online reading engagement predicts dedication in digital reading. Dedication in digital reading according to the model is reflected in task-adaptive navigation, and task-adaptive navigation predicts digital reading performance over and above print reading skill. Information engagement is assumed to positively predict task-adaptive navigation, while social engagement is assumed to negatively predict task-adaptive navigation. These hypotheses were tested using OECD PISA 2009 Digital Reading Assessment data from 17 countries and economies ( N = 29,395).
- Alvermann, D. E., & Harrison, C. (2016). Are Computers, Smartphones, and the Internet a Boon or a Barrier for the Weaker Reader?. Journal Of Adolescent & Adult Literacy, 60(2), 221-225. doi:10.1002/jaal.569
If boys are spending nine hours a day media multitasking and prefer computers to books, shouldn’t they be successful at online learning? Online learning requires online reading, which means that boys, who are significantly poorer readers than girls in every nation in the world, may well be struggling to keep up. an online student may not have access to the learning that can come from group interaction, nor to the social and emotional support that can come from peers or a teacher, and the online reader could be heading for a learning apocalypse
- Park, H., & Kim, D. (2017). English language learners’ strategies for reading online texts: Influential factors and patterns of use at home and in school. International Journal Of Educational Research, 8263-74. doi:10.1016/j.ijer.2017.01.002
five fourth and fifth-grade English language learners’ (ELLs) strategy use when they read online texts at home and in school. We also identify factors that play a role when these learners read online texts, as well as similar and different patterns in reading strategies at home and in school. The findings show that three factors influence the ELLs’ selection of online texts and use of reading strategies. In addition, the ELLs used nine reading strategies to enhance their reading online texts. Based on these findings, we discuss (a) the ELLs’ online reading strategies in different contexts, (b) the multidimensional zone of proximal development, and (c) collaboration between parents and teachers.
- Leu, D. J., Forzani, E., Timbrell, N., & Maykel, C. (2015). Seeing the Forest, Not the Trees. Reading Teacher, 69(2), 139-145. doi:10.1002/trtr.1406
a primary goal is to develop the ability to read in order to learn with online information. Technologies that support this goal, especially the Internet, and instructional practices that support the development of online reading should be our primary consideration for reading and literacy education, beginning in the primary grades.
- Brynge, E., Case, H., Forsyth, E., Green, G., & Hölke, U. (2015). Libraries: Sustaining the Digital Reader Experience. Scholarly & Research Communication, 1-10.
my note: role of the library
- Leu, D. J., Forzani, E., & Kennedy, C. (2015). Income Inequality and the Online Reading Gap. Reading Teacher, 68(6), 422-427. doi:10.1002/trtr.1328
my note: when you make a decision about a textbook, income and social inequality are factors needed to be considered.