Posts Tagged ‘Assessment and Evaluation’

game based learning

https://www.edsurge.com/news/2016-01-20-game-based-learning-has-practical-applications-for-nontraditional-learners

Muzzy Lane Software, a Newbury, Mass.-based game development platform.

The study, “The Potential for Game-based Learning to Improve Outcomes for Nontraditional Students,” is based on research funded by the Bill & Melinda Gates Foundation and includes insights from a survey of 1,700 students, 11 in-person focus groups and interviews with teachers and school leaders. Educators said games could be especially helpful in several areas: auto-assessing whether students can apply what they’ve learned, building employment competencies and improving study skills.

Definition: Muzzy Lane characterizes them as learners who meet two of the following criteria: – returning to school after pausing their education,
– balancing education with work and family responsibilities,
– lower-income,
– English as a second language learners, or
– the first members of their families to attend college.

++++++++++++++
more about game based learning in this IMS blog
http://blog.stcloudstate.edu/ims?s=game+based+learning

microcredentialing and students abilities

Badge breakthroughs

Micro-credentials awarded for in-demand skills give employers deeper detail about a student’s abilities.Matt Zalaznick. June 7, 2017
While employers increasingly demand that new hires have college degrees, the transcripts supporting those hard-earned credentials are no longer the most informative tool students have to exhibit their skills.

An estimated 1 in 5 institutions issue digital badges, which can be posted to social media, stored on digital portfolios and displayed by other specially designed platforms. When clicked on, the badge lists a range of skills a student has demonstrated beyond grades.

“The reason they’re taking off in higher education is most employers are not getting the information they need about people emerging from higher ed, with previous tools we’ve been using,” says Jonathan Finkelstein, founder and CEO of the widely used badging platform Credly. “The degree itself doesn’t get to level of describing particular competencies.”

For instance, a Notre Dame student who goes on a trip to Ecuador to build bridges can earn a badge for mastering the calculations involved in the construction, says G. Alex Ambrose, associate program director of e-portfolio assessment at the Indiana university’s Kaneb Center for Teaching & Learning.

Students can be pretty certain when they have passed calculus or creative writing, but they don’t always recognize when they’ve excelled in demonstrating soft skills such as critical thinking, communication and work ethic, says MJ Bishop, director of the system’s William E. Kirwan Center for Academic Innovation.

Badges have been most popular in the school of education—including with student teachers who, in turn, have created badges for the elementary and secondary classrooms where they’ve apprenticed, says Anna Catterson, the university’s educational technology director.

The campus library is another badging hotspot. Students there have earned microcredentials for research, 3D printing and other skills. These badges are being shared on LinkedIn and other platforms to obtain internships and scholarships.

The university runs faculty training sessions on badging and has established a review process for when faculty submit ideas for microcredentials.

One pothole to avoid is trying to create a schoolwide badge that’s standardized across a wide range of courses or majors. This can force the involvement of committees that can bog down the process, so it’s better to start with skills within single courses, says Ambrose at Notre Dame.

When creating a badge, system faculty have to identify a business or industry interested in that credential.

Badges that have the backing of a college or university are more impressive to job recruiters than are completion certificates from skill-building websites like Lynda.com.

Students won’t be motivated to earn a badge that’s a stock blue ribbon downloaded off the internet. Many institutions put a lot work into the design, and this can include harnessing expertise from the marketing department and graphic designers

+++++++++++
more on micro-credentialing in this IMS blog
http://blog.stcloudstate.edu/ims?s=microcredentialing

assessment and evaluation of serious games

Learners Assessment and Evaluationin Serious Games: Approachesand Techniques Review

Ibtissem Daoudi, Erwan Tranvouez Raoudha Chebil, Bernard Espinasse, and Wided Lejouad Chaari
https://www.academia.edu/37625162/Learners_Assessment_and_Evaluation_in_Serious_Games_Approaches_and_Techniques_Review
Overview of Crisis Management SG focused on their learners ’ assessment and evaluation capabilities. This synthesis can help researchers and gamecreators by enlighten the main criteria and techniques for learners ’ assessment andevaluation. The described benefits and limitations of each technique may facilitate thechoice of the most adequate way to evaluate a particular SG.

+++++++++
more on serious games in this IMS blog
http://blog.stcloudstate.edu/ims?s=serious+games

Embedded Librarianship in Online Courses

Embedded Librarianship in Online Courses

Mimi O’Malley, October workshop w inquiries@libraryjuiceacademy.com
http://libraryjuiceacademy.com/
https://libraryjuiceacademy.com/news/?p=559
This class will start with simple ways librarians may embed their skills remotely starting with the LMS especially through the use of portal tabs, blocks, eReserves, knowledge bases, and student/faculty orientations. We’ll then move on to discussing how to bring the traditional face-to-face BI session (which librarians know so well) into the online class through the use of team teaching, guest lecturing, and conducting synchronous workshops. We’ll explore in the 3rd week how the librarian can become more influential in online course design and development. The session concludes with an examination of the ways librarians can evaluate whether or not their virtual efforts are impacting student access to library resources as well as possible learning outcomes.
++++++++++
more on embedded librarianship in this iMS blog
http://blog.stcloudstate.edu/ims?s=embedded+librarian

grading for art faculty

Meaningful Grading: A Guide for Faculty in the Arts

Natasha Haugnes, Hoag Holmgren, and Martin Springborg

https://wvupressonline.com/node/759#2

Martin’s own LinkedIn post: https://www.linkedin.com/feed/update/activity:6425014893287657472/

College and university faculty in the arts (visual, studio, language, music, design, and others) regularly grade and assess undergraduate student work but often with little guidance or support. As a result, many arts faculty, especially new faculty, adjunct faculty, and graduate student instructors, feel bewildered and must “reinvent the wheel” when grappling with the challenges and responsibilities of grading and assessing student work.

Meaningful Grading: A Guide for Faculty in the Arts enables faculty to create and implement effective assessment methodologies—research based and field tested—in traditional and online classrooms. In doing so, the book reveals how the daunting challenges of grading in the arts can be turned into opportunities for deeper student learning, increased student engagement, and an enlivened pedagogy.

Measuring Learning Outcomes of New Library Initiatives

International Conference on Qualitative and Quantitative Methods in Libraries 2018 (QQML2018)

conf@qqml.net

Where: Cultural Centre Of Chania
ΠΝΕΥΜΑΤΙΚΟ ΚΕΝΤΡΟ ΧΑΝΙΩΝ

https://goo.gl/maps/8KcyxTurBAL2

also live broadcast at https://www.facebook.com/InforMediaServices/videos/1542057332571425/

Posted by InforMedia Services on Thursday, May 24, 2018

When: May 24, 12:30AM-2:30PM (local time; 4:40AM-6:30AM, Chicago Central)

Programme QQML2018-23pgopv

Live broadcasts from some of the sessions:

#QQML2018 Sebastian Bock w @Springer Nature about citation #metrics and beyond

Posted by InforMedia Services on Wednesday, May 23, 2018

Here is a link to Sebastian Bock’s presentation:
https://drive.google.com/file/d/1jSOyNXQuqgGTrhHIapq0uxAXQAvkC6Qb/view

#qqml2018

Posted by InforMedia Services on Wednesday, May 23, 2018

#qqml2018 after two hurricanes presenting

Posted by InforMedia Services on Thursday, May 24, 2018

#qqml2018 Carla Fulgham hashtags

Posted by InforMedia Services on Wednesday, May 23, 2018

Information literacy skills and college students from Jade Geary

Session 1:
http://qqml.org/wp-content/uploads/2017/09/SESSION-Miltenoff.pdf

Session Title: Measuring Learning Outcomes of New Library Initiatives Coordinator: Professor Plamen Miltenoff, Ph.D., MLIS, St. Cloud State University, USA Contact: pmiltenoff@stcloudstate.edu Scope & rationale: The advent of new technologies, such as virtual/augmented/mixed reality, and new pedagogical concepts, such as gaming and gamification, steers academic libraries in uncharted territories. There is not yet sufficiently compiled research and, respectively, proof to justify financial and workforce investment in such endeavors. On the other hand, dwindling resources for education presses administration to demand justification for new endeavors. As it has been established already, technology does not teach; teachers do; a growing body of literature questions the impact of educational technology on educational outcomes. This session seeks to bring together presentations and discussion, both qualitative and quantitative research, related to new pedagogical and technological endeavors in academic libraries as part of education on campus. By experimenting with new technologies such as Video 360 degrees and new pedagogical approaches such as gaming and gamification, does the library improve learning? By experimenting with new technologies and pedagogical approaches, does the library help campus faculty to adopt these methods and improve their teaching? How can results be measured, demonstrated?

Conference program

http://qqml.org/wp-content/uploads/2017/09/7.5.2018-programme_final.pdf

More information and bibliography:

https://www.academia.edu/Documents/in/Videogame_and_Virtual_World_Technologies_Serious_Games_applications_in_Education_and_Training

https://www.academia.edu/Documents/in/Measurement_and_evaluation_in_education

Social Media:
https://www.facebook.com/QQML-International-Conference-575508262589919/

 

 

 

assessment learning outcomes

The Misguided Drive to Measure ‘Learning Outcomes’

digital badges in academic libraries

David Demaine, S., Lemmer, C. A., Keele, B. J., & Alcasid, H. (2015). Using Digital Badges to Enhance Research Instruction in Academic Libraries. In B. L. Eden (Ed.), Enhancing Teaching and Learning in the 21st-Century Academic Library: Successful Innovations That Make a Difference (2015th ed.). Retrieved from https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2882671

At their best, badges can create a sort of interactive e-resume.

the librarian may be invited into the classroom, or the students may be sent to the Iibrary for a single research lesson on databases and search tem1s- not enough for truly high-quality research. A better alternative may be that the professor require the students to complete a series of badges- designed, implemented, and managed by the librarian- that build thorough research skills and ultimately produce a better paper.

Meta- badges are s impl y badges that indicate comp letion o f multiple related badges.

Authentication (determining that the badge has not been altered) and validation/verification (checking that the badge has actually been earned and issued by the stated issuer) are major concerns. lt is also important, particularly in the academic context, to make sure that the badge does not come to replace the learning it represents. A badge is a symbol that other skills and knowledge exist in this individual’s portfolio of skills and talents. Therefore, badges awarded in the educational context must reflect time and effort and be based on vetted standards, or they will become empty symbols

Digital credentialing recognizes “learning of many kinds which are acquired beyond formal education institutions .. . ; it proliferates and disperses author- ity over what learning to recognize; and it provides a means of translation and commensuration across multiple spheres” (Oineck, 2012, p. I)

University digital badge projects are rarely a top-down undertaking. Typi- cally, digital badge programs arise from collaborative efforts “of people agi- tating from the middle” (Raths, 2013).

 

online teaching evaluation

Tobin, T. J., Mandernach, B. J., & Taylor, A. H. (2015). Evaluating Online Teaching: Implementing Best Practices (1 edition). San Francisco, CA: Jossey-Bass.
  1. 5 measurable faculty competencies for on line teaching:
  • attend to unique challenges of distance learning
  • Be familiar with unique learning needs
  • Achieve mastery of course content, structure , and organization
  • Respond to student inquiries
  • Provide detailed feedback
  • Communicate effectively
  • Promote a safe learning environment
  • Monitor student progress
  • Communicate course goals
  • Provide evidence of teaching presence.

Best practices include:

  • Making interactions challenging yet supportive for students
  • Asking learners to be active participants in the learning process
  • Acknowledging variety on the ways that students learn best
  • Providing timely and constructive feedback

Evaluation principles

  • Instructor knowledge
  • Method of instruction
  • Instructor-student rapport
  • Teaching behaviors
  • Enthusiastic teaching
  • Concern for teaching
  • Overall

8. The American Association for higher Education 9 principle4s of Good practice for assessing student learning from 1996 hold equally in the F2F and online environments:

the assessment of student learning beings with educational values

assessment is most effective when it reflects an understanding of learning as multidimensional, integrated and revealed in performance over time

assessment works best when the programs it seeks to improve have clear, explicitly stated purposes.

Assessment requires attention to outcomes but also and equally to the experiences that lead to those outcomes.

Assessment works best when it is ongoing, not episodic

Assessment fosters wider improvement when representatives from across the educational community are involved

Assessment makes a difference when it begins with issues of use and illumines questions that people really care bout

Assessment is most likely to lead to improvements when it is part of the large set of conditions that promote change.

Through assessment, educators meet responsibilities to students and to the public.

9 most of the online teaching evaluation instruments in use today are created to evaluate content design rather than teaching practices.

29 stakeholders for the evaluation of online teaching

  • faculty members with online teaching experience
  • campus faculty members as a means of establishing equitable evaluation across modes of teaching
  • contingent faculty members teaching online
  • department or college administrators
  • members of faculty unions or representative governing organizations
  • administrative support specialists
  • distance learning administrators
  • technology specialists
  • LMS administrators
  • Faculty development and training specialists
  • Institutional assessment and effectiveness specialists
  • Students

Sample student rating q/s

University resources

Rate the effectiveness of the online library for locationg course materials

Based on your experience,

148. Checklist for Online Interactive Learning COIL

150. Quality Online Course Initiative QOCI

151 QM Rubric

154 The Online Insturctor Evaluation System OIES

 

163 Data Analytics: moving beyond student learning

  • # of announcments posted per module
  • # of contributions to the asynchronous discussion boards
  • Quality of the contributions
  • Timeliness of posting student grades
  • Timelines of student feedback
  • Quality of instructional supplements
  • Quality of feedback on student work
  • Frequency of logins
  1. 180 understanding big data
  • reliability
  • validity
  • factor structure

187 a holistics valuation plan should include both formative evaluation, in which observations and rating are undertaken with the purposes of improving teaching and learning, and summative evaluation, in which observation and ratings are used in order to make personnel decisions, such as granting promotion and tenure, remediation, and asking contingent faculty to teach again.

195 separating teaching behaviors from content design

 

 

 

 

+++++++++++++++++
more on online teaching in this IMS blog
http://blog.stcloudstate.edu/ims?s=online+teaching

1 2