Rubrics: online scoring guides to evaluate students’ work.
Annotations: notes or comments added digitally to essays and other assignments.
Audio: a sound file of your voice giving feedback on students’ work.
Video: a recorded file of you offering feedback either as a “talking head,” a screencast, or a mix of both.
Peer review: online systems in which students review one another’s work.
Two main types of feedback — formative and summative — work together in that process but have different purposes. Formative feedback occurs during the learning process and is used to monitor progress. Summative feedback happens at the end of a lesson or a unit and is used to evaluate the achievement of the learning outcomes.
Good feedback should be: Frequent, Specific, Balanced, Timely
ForceBot is a four year project to develop an exoskeleton for commercial and enterprise applications using HaptX’s microfluidic touch feedback technology to simulate virtual objects. The NSF grant will be distributed between each company to contribute individual components to ForceBot, and then the resulting IP will be used for commercial products.
Most professors we hear from want to assess their students on higher levels and that if current assessments kept student at the lowest level of Bloom’s Taxonomy, they wouldn’t feel rewarded as educators.
However, assessment is by far the most labour-intensive part of teaching. Assessment plans and rubrics must be prepped. Test questions must be written. Every student needs a mark, personalized feedback and a road-map for improvement. The larger the class, the more work for the instructor. Add in formative assessments like weekly assignments and exercises that precipitate subtle, ongoing tweaks to the syllabus and it’s easy to see why many faculty opt to stick with what they know: An accumulation of easy-to-grade summative assessments that almost inevitably rely upon memorization and the most basic understanding of concepts
Curation Activities can be one of the most effective teaching strategies to help students compare what they’re learning in the classroom with real-world examples, and gain insight into how they can relate to each other.
Curation Activities can apply to all disciples, such as Business, Arts, or Sciences.
When students explain what they’ve learned to other students, they help consolidate and strengthen connections to those concepts while simultaneously engaging in active learning Find more project ideas here.
By actively engaging with their classmates and applying their own evaluative skills to feedback they’re delivering to their peers, students are developing lifelong critical thinking and creative analysis skills. Additionally, peer assessment is proven to be effective in getting students faster feedback from diverse sources, increases meta-cognition, independence and self-reflection, and improves student learning. These are all important skills that provide value far beyond the classroom. More details on the benefits of peer assessment here.
Got a new open access article out on the ways AI is embedding in education research. Well-funded precision education experts and learning engineers aim to collect psychodata, brain data and biodata as evidence of the embodied substrates of learning. https://t.co/CbdHReXUiz
This article presents an examination of how education research is being remade as an experimental data-intensive science. AI is combining with learning science in new ‘digital laboratories’ where ownership over data, and power and authority over educational knowledge production, are being redistributed to research assemblages of computational machines and scientific expertise.
Research across the sciences, humanities and social sciences is increasingly conducted through digital knowledge machines that are reconfiguring the ways knowledge is generated, circulated and used (Meyer and Schroeder, 2015).
Knowledge infrastructures, such as those of statistical institutes or research-intensive universities, have undergone significant digital transformation with the arrival of data-intensive technologies, with knowledge production now enacted in myriad settings, from academic laboratories and research institutes to commercial research and development studios, think tanks and consultancies. Datafied knowledge infrastructures have become hubs of command and control over the creation, analysis and exchange of data (Bigo et al., 2019).
The combination of AI and learning science into an AILSci research assemblage consists of particular forms of scientific expertise embodied by knowledge actors – individuals and organizations – identified by categories including science of learning, AIED, precision education and learning engineering.
Precision education overtly uses psychological, neurological and genomic data to tailor or personalize learning around the unique needs of the individual (Williamson, 2019). Precision education approaches include cognitive tracking, behavioural monitoring, brain imaging and DNA analysis.
Expert power is therefore claimed by those who can perform big data analyses, especially those able to translate and narrate the data for various audiences. Likewise, expert power in education is now claimed by those who can enact data-intensive science of learning, precision education and learning engineering research and development, and translate AILSci findings into knowledge for application in policy and practitioner settings.
the thinking of a thinking infrastructure is not merely a conscious human cognitive process, but relationally performed across humans and socio-material strata, wherein interconnected technical devices and other forms ‘organize thinking and thought and direct action’.
As an infrastructure for AILSci analyses, these technologies at least partly structure how experts think: they generate new understandings and knowledge about processes of education and learning that are only thinkable and knowable due to the computational machinery of the research enterprise.
Big data-based molecular genetics studies are part of a bioinformatics-led transformation of biomedical sciences based on analysing exceptional volumes of data (Parry and Greenhough, 2018), which has transformed the biological sciences to focus on structured and computable data rather than embodied evidence itself.
Isin and Ruppert (2019) have recently conceptualized an emergent form of power that they characterize as sensory power. Building on Foucault, they note how sovereign power gradually metamorphosed into disciplinary power and biopolitical forms of statistical regulation over bodies and populations. Sensory power marks a shift to practices of data-intensive sensing, and to the quantified tracking, recording and representing of living pulses, movements and sentiments through devices such as wearable fitness monitors, online natural-language processing and behaviour-tracking apps. Davies (2019: 515–20) designates these as ‘techno-somatic real-time sensing’ technologies that capture the ‘rhythms’ and ‘metronomic vitality’ of human bodies, and bring about ‘new cyborg-type assemblages of bodies, codes, screens and machines’ in a ‘constant cybernetic loop of action, feedback and adaptation’.
Techno-somatic modes of neural sensing, using neurotechnologies for brain imaging and neural analysis, are the next frontier in AILSci. Real-time brainwave sensing is being developed and trialled in multiple expert settings.
the HyFlex model for the fall… reflects a rift between administrators and professors, who are raising alarms over the health risks of teaching in person, and about the logistical, technical, and pedagogical complications of the model itself. Search HyFlex on Facebook and Twitter and you’ll come across comments like this one: “Whoever the hell thought of this is a bean counter, not an educator, and an idiot.”
Teaching experts and others familiar with hybrid teaching say that HyFlex can work, but it requires effective technology, careful planning, instructional support, and creative course design.
“If HyFlex is part of the plan, it has to be done with will faculty participation,” says Brian Beatty, an associate professor of instructional technologies at San Francisco State, who created the model. “Otherwise, if it’s top down and the administration is saying, We’re doing this, then the faculty are saying, But why are we doing this?”
Much of what bothers professors about the push for HyFlex is that so many details about its mechanics remain ill defined. And assumptions about its value seem rooted in a particular idea of teaching, one where the professor stands at the front of a classroom and lectures.
“We are the ones holding the bag if this does not work, or if it’s chaos,” says Michelle Miller, a psychology professor at Northern Arizona University and author of Minds Online: Teaching Effectively With Technology.
Miller is a fan of the original HyFlex model from San Francisco State, but says that colleges need to be mindful that the conditions under which it’s now being adapted — quickly, at scale, and without giving students much choice — will limit its effectiveness.
To work effectively, she says, hybrid teaching requires a lot of support, such as having teaching assistants help manage the complexities of working simultaneously with two different audiences. Otherwise it risks becoming a “lecture-centric, passive consumption view of learning.” That goes against years of hard work faculty members have been doing to make their classrooms more inclusive, active, and engaged.
To help think through pedagogical challenges, faculty groups are testing out teaching strategies, some departments meet weekly to discuss course design, and a student-leadership team is providing feedback and creating online tools to help their peers learn effectively online.Even so, the process has been challenging and frustrating at times for faculty members. Professors are both looking for templates and wanting to maintain control over their courses, which inevitably creates tension with the administration.
Presentation 1: Inspiring Faculty (+ Students) with Tales of Immersive Tech (Practitioner Presentation #106)
Authors: Nicholas Smerker
Immersive technologies – 360º video, virtual and augmented realities – are being discussed in many corners of higher education. For an instructor who is familiar with the terms, at least in passing, learning more about why they and their students should care can be challenging, at best. In order to create a font of inspiration, the IMEX Lab team within Teaching and Learning with Technology at Penn State devised its Get Inspired web resource. Building on a similar repository for making technology stories at the sister Maker Commons website, the IMEX Lab Get Inspired landing page invites faculty to discover real world examples of how cutting edge XR tools are being used every day. In addition to very approachable video content and a short summary calling out why our team chose the story, there are also instructional designer-developed Assignment Ideas that allow for quick deployment of exercises related to – though not always relying upon – the technologies highlighted in a given Get Inspired story.
Presentation 2: Lessons Learned from Over A Decade of Designing and Teaching Immersive VR in Higher Education Online Courses (Practitioner Presentation #101)
Authors: Eileen Oconnor
This presentation overviews the design and instruction in immersive virtual reality environments created by the author beginning with Second Life and progressing to open source venues. It will highlight the diversity of VR environment developed, the challenges that were overcome, and the accomplishment of students who created their own VR environments for K12, college and corporate settings. The instruction and design materials created to enable this 100% online master’s program accomplishment will be shared; an institute launched in 2018 for emerging technology study will be noted.
Presentation 3: Virtual Reality Student Teaching Experience: A Live, Remote Option for Learning Teaching Skills During Campus Closure and Social Distancing (Practitioner Presentation #110)
Summary: During the Coronavirus pandemic, Ithaca College teacher education majors needed a classroom of students in order to practice teaching and receive feedback, but the campus was closed, and gatherings forbidden. Students were unable to participate in live practice teaching required for their program. We developed a virtual reality pilot project to allow students to experiment in two third-party social VR programs, AltSpaceVR and Rumii. Social VR platforms allow a live, embodied experience that mimics in-person events to give students a more realistic, robust and synchronous teaching practice opportunity. We documented the process and lessons learned to inform, develop and scale next generation efforts.
Sunday, June 21 • 8:00am – 9:00am Escape the (Class)room games in OpenSim or Second Life FULLhttps://ilrn2020.sched.com/event/ceKP/escape-the-classroom-games-in-opensim-or-second-lifePre-registration for this tour is required as places are limited. Joining instructions will be emailed to registrants ahead of the scheduled tour time.The Guided Virtual Adventure tour will take you to EduNation in Second Life to experience an Escape room game. For one hour, a group of participants engage in voice communication and try to solve puzzles, riddles or conundrums and follow clues to eventually escape the space. These scenarios are designed for problem solving and negotiating language and are ideal for language education. They are fun and exciting and the clock ticking adds to game play.Tour guide(s)/leader(s): Philp Heike, let’s talk online sprl, Belgium
Presentation 1: Evaluating the impact of multimodal Collaborative Virtual Environments on user’s spatial knowledge and experience of gamified educational tasks (Full Paper #91)
Authors: Ioannis Doumanis and Daphne Economou
>>Access Video Presentation<<
Several research projects in spatial cognition have suggested Virtual Environments (VEs) as an effective way of facilitating mental map development of a physical space. In the study reported in this paper, we evaluated the effectiveness of multimodal real-time interaction in distilling understanding of the VE after completing gamified educational tasks. We also measure the impact of these design elements on the user’s experience of educational tasks. The VE used reassembles an art gallery and it was built using REVERIE (Real and Virtual Engagement In Realistic Immersive Environment) a framework designed to enable multimodal communication on the Web. We compared the impact of REVERIE VG with an educational platform called Edu-Simulation for the same gamified educational tasks. We found that the multimodal VE had no impact on the ability of students to retain a mental model of the virtual space. However, we also found that students thought that it was easier to build a mental map of the virtual space in REVERIE VG. This means that using a multimodal CVE in a gamified educational experience does not benefit spatial performance, but also it does not cause distraction. The paper ends with future work and conclusions and suggestions for improving mental map construction and user experience in multimodal CVEs.
Presentation 2: A case study on student’s perception of the virtual game supported collaborative learning (Full Paper #42)
Authors: Xiuli Huang, Juhou He and Hongyan Wang
>>Access Video Presentation<<
The English education course in China aims to help students establish the English skills to enhance their international competitiveness. However, in traditional English classes, students often lack the linguistic environment to apply the English skills they learned in their textbook. Virtual reality (VR) technology can set up an immersive English language environment and then promote the learners to use English by presenting different collaborative communication tasks. In this paper, spherical video-based virtual reality technology was applied to build a linguistic environment and a collaborative learning strategy was adopted to promote their communication. Additionally, a mixed-methods research approach was used to analyze students’ achievement between a traditional classroom and a virtual reality supported collaborative classroom and their perception towards the two approaches. The experimental results revealed that the virtual reality supported collaborative classroom was able to enhance the students’ achievement. Moreover, by analyzing the interview, students’ attitudes towards the virtual reality supported collaborative class were reported and the use of language learning strategies in virtual reality supported collaborative class was represented. These findings could be valuable references for those who intend to create opportunities for students to collaborate and communicate in the target language in their classroom and then improve their language skills
Presentation 1: Reducing Cognitive Load through the Worked Example Effect within a Serious Game Environment (Full Paper #19)
Authors: Bernadette Spieler, Naomi Pfaff and Wolfgang Slany
>>Access Video Presentation<<
Novices often struggle to represent problems mentally; the unfamiliar process can exhaust their cognitive resources, creating frustration that deters them from learning. By improving novices’ mental representation of problems, worked examples improve both problem-solving skills and transfer performance. Programming requires both skills. In programming, it is not sufficient to simply understand how Stackoverflow examples work; programmers have to be able to adapt the principles and apply them to their own programs. This paper shows evidence in support of the theory that worked examples are the most efficient mode of instruction for novices. In the present study, 42 students were asked to solve the tutorial The Magic Word, a game especially for girls created with the Catrobat programming environment. While the experimental group was presented with a series of worked examples of code, the control groups were instructed through theoretical text examples. The final task was a transfer question. While the average score was not significantly better in the worked example condition, the fact that participants in this experimental group finished significantly faster than the control group suggests that their overall performance was better than that of their counterparts.
Presentation 2: A literature review of e-government services with gamification elements (Full Paper #56)
Authors: Ruth S. Contreras-Espinosa and Alejandro Blanco-M
>>Access Video Presentation<<
Nowadays several democracies are facing the growing problem of a breach in communication between its citizens and their political representatives, resulting in low citizen’s engagement in the participation of political decision making and on public consultations. Therefore, it is fundamental to generate a constructive relationship between both public administration and the citizens by solving its needs. This document contains a useful literature review of the gamification topic and e-government services. The documents contain a background of those concepts and conduct a selection and analysis of the different applications found. A set of three lines of research gaps are found with a potential impact on future studies.
Presentation 1: Connecting User Experience to Learning in an Evaluation of an Immersive, Interactive, Multimodal Augmented Reality Virtual Diorama in a Natural History Museum & the Importance of Story (Full Paper #51)
Authors: Maria Harrington
>>Access Video Presentation<<
Reported are the findings of user experience and learning outcomes from a July 2019 study of an immersive, interactive, multimodal augmented reality (AR) application, used in the context of a museum. The AR Perpetual Garden App is unique in creating an immersive multisensory experience of data. It allowed scientifically naïve visitors to walk into a virtual diorama constructed as a data visualization of a springtime woodland understory, and interact with multimodal information directly through their senses. The user interface comprised of two different AR data visualization scenarios reinforced with data based ambient bioacoustics, an audio story of the curator’s narrative, and interactive access to plant facts. While actual learning and dwell times were the same between the AR app and the control condition, the AR experience received higher ratings on perceived learning. The AR interface design features of “Story” and “Plant Info” showed significant correlations with actual learning outcomes, while “Ease of Use” and “3D Plants” showed significant correlations with perceived learning. As such, designers and developers of AR apps can generalize these findings to inform future designs.
Presentation 2: The Naturalist’s Workshop: Virtual Reality Interaction with a Natural Science Educational Collection (Short Paper #11)
Authors: Colin Patrick Keenan, Cynthia Lincoln, Adam Rogers, Victoria Gerson, Jack Wingo, Mikhael Vasquez-Kool and Richard L. Blanton
>>Access Video Presentation<<
For experiential educators who utilize or maintain physical collections, The Naturalist’s Workshop is an exemplar virtual reality platform to interact with digitized collections in an intuitive and playful way. The Naturalist’s Workshop is a purpose-developed application for the Oculus Quest standalone virtual reality headset for use by museum visitors on the floor of the North Carolina Museum of Natural Sciences under the supervision of a volunteer attendant. Within the application, museum visitors are seated at a virtual desk. Using their hand controllers and head-mounted display, they explore drawers containing botanical specimens and tools-of-the-trade of a naturalist. While exploring, the participant can receive new information about any specimen by dropping it into a virtual examination tray. 360-degree photography and three-dimensionally scanned specimens are used to allow user-motivated, immersive experience of botanical meta-data such as specimen collection coordinates.
Presentation 3: 360˚ Videos: Entry level Immersive Media for Libraries and Education (Practitioner Presentation #132)
Authors: Diane Michaud
>>Access Video Presentation<<
Within the continuum of XR Technologies, 360˚ videos are relatively easy to produce and need only an inexpensive mobile VR viewer to provide a sense of immersion. 360˚ videos present an opportunity to reveal “behind the scenes” spaces that are normally inaccessible to users of academic libraries. This can promote engagement with unique special collections and specific library services. In December 2019, with little previous experience, I led the production of a short 360˚video tour, a walk-through of our institution’s archives. This was a first attempt; there are plans to transform it into a more interactive, user-driven exploration. The beta version successfully generated interest, but the enhanced version will also help prepare uninitiated users for the process of examining unique archival documents and artefacts. This presentation will cover the lessons learned, and what we would do differently for our next immersive video production. Additionally, I will propose that the medium of 360˚ video is ideal for many institutions’ current or recent predicament with campuses shutdown due to the COVID-19 pandemic. Online or immersive 360˚ video can be used for virtual tours of libraries and/or other campus spaces. Virtual tours would retain their value beyond current campus shutdowns as there will always be prospective students and families who cannot easily make a trip to campus. These virtual tours would provide a welcome alternative as they eliminate the financial burden of travel and can be taken at any time.
Hi colleagues, My provost just put out a set of expected guidelines for instructors in online classes that emphasize expectations around discussion forums (I pasted them below). These discussion forum expectations are very narrowly defined. I am needing group-think on references that might help me put together some “best practice” alternatives. If an article or other resource comes to mind, please share!
Online Faculty Expectations
Weekly Required (all weeks)
• Faculty will demonstrate their presence in the class 5 days per week
• Respond to all students’ (who post on-time) primary discussion post if you have 9 or fewer students (1/2 of students if you have 10 or more).
• Faculty with larger courses should take special care to post to different students each week.
• Faculty who provide a weekly zoom lecture need only post on the board two other times (on two different days for a total of two other posts).
• Provide individual feedback (posted in the feedback section of the gradebook) for all discussion grades within a reasonable timeframe for students to complete subsequent assignments.
Dayna HenryI balk at the admin trying to tell us what to do. At the same time, I am very angry with colleagues who did not actually offer anything in the way of virtual learning when we went online in spring. It’s hard to balance academic freedom with faculty who don’t care to learn/offer a new way of learning (for your institution). I also recognize the admin was not in their F2F courses either and likely the slacking was occurring there too. The problem is the students LOVE these folks for giving them an easy A/pass.
Cathy CurranFor years I have said that administrators need to teach at least one each year or every other year. My Dean has been out of the classroom for over 20 years, the Provost for over 25 and the Chancellor has never taught. They have zero clue how to build or implement and online class. They keep making mandates that to those of us who do actually teach seem absurd. We know the “count and classify” nonsense never works but it is the same argument they use for numerical evaluations of teaching effectiveness: it is objective. The decisions they are making do not make instruction better they are all about power and control, they need us to “prove” that we are doing our job and somehow logging into the LMS five days a week does that. Sad really really sad. Well you know some do and other become administrators…
Freire’s pedagogical concepts, such as problem posing, dialogue, praxis, conscientiazation and the politics of education, were devel-oped in a pre-Internet era. His work in popular education was deeply interpersonal and involved spending significant time in a community becoming familiar with the culture, linguistic patterns, and lifestyle of the people before ever embarking on teaching.
struggles to employ a critical pedagogy in the increasingly assessment-oriented, outcomes-based environment
While designed to make teaching in the online environment more efficient, these systems confront the critical pedagogue with challenges to create a teaching-learning environment that promotes critical reflection not only on the content of a course but on the very way in which content is delivered.
teaching in cyberspace requires a different teaching paradigm altogether
p. 170 Feenberg (2009) developed the Critical Theory of Technology (CTT),
p. 171 As outlined by CTT, technology creates a cyber culture that redefines human identity and the meaning and means of human interaction (Gomez, 2009). When viewed through this lens, online education is not simply another tool for the promotion of learning, but rather an all-encompassing environment managing and controlling access to information, structuring relationships, and redefining individual identities.
p. 171 While masquerading as efforts to enhance student learning, these industries are clearly profit-oriented. Knowledge has become a commodity, students have become consumers, faculty have become content providers, and schools operate as businesses
p. 172 Like Feenberg (2009), Freire would be concerned with the values and principles embedded in the technology of online learning, as well as the cyber culture it has created.
p. 173 Schools did not venture into online learning because they thought it was a better way to teach, but rather because they saw it as a way to reach unreached student populations with the promise of off-site educational offerings. Only later was attention given to developing online pedagogies.
Whereas education in the United States was originally viewed as a way to prepare students for effective citizenship, now it is seen as a way to develop loyal and capable employees of their corporate overlords
p. 174 A second area of concern is the banking nature of the LMSs. One of the underlying assumptions of an LMS like Blackboard™, Moodle™, or Brightspace™ is that the online platform is a repository of resources for teaching and learning.
Freire vehemently rejected this banking approach to education because it did not recognize or encourage the student’s creative, exploratory, and critical abilities. In the banking model the teacher is regarded as the holder and transmitter of knowledge, which is then imparted to the student. The banking model assumes the student is an empty vessel and does not value or recognize the student’s experiential and cultural knowledge
By contrast Freire argued for a problem-posing, constructivist approach that invites students to critically engage their world and one another. In the critical classroom, the student at times takes on the role of teacher and the teacher becomes a learner, inviting a sharing of power and mutual learning. While this approach can be carried out to an extent online, the LMS is set up to be the primary source of information in a course, and the teacher is assigned as the expert designer of the learning experience, thus limiting the constructivist nature and mutuality of the learning process.
p. 175 A third area of concern is the limited access to online learning to large sectors of society. While e-learning advocates tout the greater access to learning provided by online learning (Goral, 2013; Kashi & Conway, 2010), the digital divide is a reality impacting millions of students.
p. 176 A final area of concern is the disembodied nature of the online learning process. One of the major attractions of online learning to potential students is the freedom from having to be in a classroom in a particular time or place.
p. 177 Embodied learning means students must not only engage the cognitive dimension (thinking and reflection), but also partake in concrete action. This action in reflection, and reflection in action, referred to as praxis, involves acting on and in the world as one is seeking to learn about and transform the world.
To limit education to the transmission and reception of text-based knowledge without action undermines the entire learning process (Escobar et al., 1994). Freire believed dialogue begins not with what the teacher professes to know, but with the student’s experience and knowledge.
p. 179 For Freire, the building of a learning community is essential to creating meaningful dialogue; this is also true for those who seek to teach effectively online. Palloff and Pratt (2007) contend that all online teaching must begin with building community and stress that a carefully constructed online learning community provides a space for students to test ideas, get feedback, and create a collaborative learning experience.
For Freire, learning was a social and democratic event where authoritarianism and control of the learning process are minimized. “reading the world,” or conscientization, that is, understanding the larger political context in which experience occurs and knowledge is situated. In the current era of Facebook, Twitter, instant message, and other social media, in-depth discussion and analysis is often absent in favor of brief, often innocuous statements and personal opinions. Through online academic databases, students have easy access to far more sources of information than previous generations. Furthermore, search engines like Google, Yahoo, and the like bring students in contact with remote sources, organizations, and individuals instantly.
p. 180 the challenge is not only the accessing of information, but also encouraging students to become discerning purveyors of information—to develop “critical digital literacy,” the capacity to effectively and critically navigate the databases and myriads of potential sources (Poore, 2011, p. 15)