new forms of human-computer interaction (HCI) such as augmented reality (AR),virtual reality (VR) and mixed reality (MR).
combining AR/VR/MR with cognitive computing and artificial intelligence (AI) technologies (such as machine learning, deep learning, natural language processing and chatbots).
Some thought-provoking questions include:
Will remote workers be able to be seen and interacted with via their holograms (i.e., attending their meetings virtually)? What would this mean for remote learners?
Will our smartphones increasingly allow us to see information overlaid on the real world? (Think Pokémon Go, but putting that sort of technology into a vast array of different applications, many of which could be educational in nature)
How do/will these new forms of HCI impact how we design our learning spaces?
Will students be able to pick their preferred learning setting (i.e., studying by a brook or stream or in a virtual Starbucks-like atmosphere)?
Will more devices/platforms be developed that combine the power of AI with VR/AR/MR-related experiences? For example, will students be able to issue a verbal question or command to be able to see and experience walking around ancient Rome?
Will there be many new types of learning experiences,like what Microsoft was able to achieve in its collaboration with Case Western Reserve University [OH]? Its HoloLens product transforms the way human anatomy can be taught.
p. 22 Extensive costs for VR design and development drive the need for collaborative efforts.
Case Western Reserve University, demonstrates a collaboration with the Cleveland Clinic and Microsoft to create active multi-dimensional learning using holography.
the development of more affordable high-quality virtual reality solutions.
AR game developed by the Salzburg University of Applied Sciences [Austria] (http://www.fh-salzburg.ac.at/en/) that teaches about sustainability, the environment and living green.
Whether using AR for a gamified course or to acclimate new students to campus, the trend will continue into 2017.
Google Expeditions This virtual reality field trip tool works in conjunction with Google Cardboard and has just been officially released. The app allows teachers to guide students through an exploration of 200 (and growing) historical sites and natural resources in an immersive, three-dimensional experience. The app only works on Android devices and is free.
Flippity This app works in conjunction with Google Sheets and allows teachers to easily make a Jeopardy-style game.
Google Science Journal This Android app allows users to do science experiments with mobile phones. Students can use sensors in the phone or connect external sensors to collect data, but can also take notes on observations, analyze and annotate within the app.
Google Cast This simple app solves issues of disparate devices in the classroom. When students download the app, they can project from their devices onto the screen at the front of the room easily. “You don’t have to have specific hardware, you just have to have Wi-Fi,”
Constitute This site hosts a database of constitutions from around the world. Anything digitally available has been aggregated here. It is searchable by topic and will pull out specific excerpts related to search terms like “freedom of speech.”
YouTube a database of YouTube Channels by subject to help educators with discoverability (hint subjects are by tab along the bottom of the document).
Zygote Body This freemium tool has a lot of functionality in the free version, allowing students to view different parts of human anatomy and dig into how various body systems work.
Pixlr This app has less power than Photoshop, but is free and fairly sophisticated. It works directly with Google accounts, so students can store files there.
uild With Chrome This extension to the Chrome browser lets kids play with digital blocks like Legos. Based on the computer’s IP address, the software assigns users a plot of land on which to build nearby. There’s a Build Academy to learn how to use the various tools within the program, but then students can make whatever they want.
Google CS First Built on Scratch’s programming language, this easy tool gives step-by-step instructions to get started and is great for the hesitant teacher who is just beginning to dip a toe into coding.
In 2013, Apple bought PrimeSense, which developed motion-sensing technology in Microsoft Corp.’s Kinect gaming system. Purchases of software startups in the field, Metaio Inc. and Flyby Media Inc., followed in 2015 and 2016.
“AR can be really great, and we have been and continue to invest a lot in this,” Cook said in a July 26 conference call with analysts. “We are high on AR for the long run. We think there are great things for customers and a great commercial opportunity.”
Augmented reality is a variation of virtual environments, but has a few added advantages for special needs learning. With virtual environments the user is completely immersed in a virtual world and cannot see the real environment around him or her. This may cause some confusion for special needs learners and can hinder learning. In contrast, augmented reality allows the user to see the real world with virtual objects superimposed upon or composited with the real world. This provides the greatest benefit as learners remain part of the world around them and learn easily.
more on the topic
Muñoz, Silvia Baldiris Navarro and Ramón, “Gremlings in My Mirror: An Inclusive AR-Enriched Videogame for Logical Math Skills Learning”, Advanced Learning Technologies (ICALT) 2014 IEEE 14th International Conference on, pp. 576-578, 2014.
Topics: Assistive and adaptive technologies, Augmented reality, Learning spaces, Mobile learning, Tools
the Universal Design for Learning (UDL) framework, which aims to develop expert learners. In addition to removing barriers and making learning accessible to the widest varied of learners possible, UDL addresses many of the metacognitive and self-efficacy skills associated with becoming an expert learner, including:
Executive functions. These cognitive processes include initiation, goal setting, attention, planning and organization.
Comprehension skills. This skillset encompasses knowledge construction, making connections, developing strategies and monitoring understanding.
Engagement principles. These soft skills include coping, focus, resilience, effort, persistence, self-assessment and reflection.
AR apps : two types of AR apps: those for experience and for creation. Experience AR apps, such as Star Walk, are designed to provide the user with an AR experience within a specific content or context. Creation AR apps, such as BlippAR and Aurasma, allow users to create their own AR experiences.
Posters : To support comprehension and metacognitive skills, images related to classroom topics, or posters related to a process could serve as the trigger image.
iBeacons : Beacon technology, such as iBeacon, shares some similarities with QR codes and AR, as it is a way to call up digital content from a specific spot in the physical world. However, unlike QR codes and AR, you do not have to point your device at a code or use a trigger image to call up content with iBeacon. Your device will automatically sync when it is near a beacon, a small device that emits a low-power Bluetooth signal, if you have an iBeacon-enabled app. The beacon then automatically launches digital content, such as a video, audio file or webpage. Beacon technology is well suited for center-based activities, as you can set up the app to trigger instructions for each center, exemplars of what the finished work will look like and/or prompts for the reflection when the center’s activity has been completed.
More on QR codes in this IMS blog:
the power of VR goes beyond simply recruiting. The University of Michigan uses the technology as a learning tool, and by instituting a virtual reality “cave” they’ve allowed engineering students to interact with virtual structures as they “come together, buckle and collapse.” Instead of relying on physical models—which tend to be large, expensive, and slow to build—a student using the MIDEN VR cave can fly around a virtual structure to study mechanical connections.
Google, for instance, has made virtual field trips to inaccessible locations easier for history and social studies classes with its Cardboard viewers used in conjunction with the Expeditions app. And technologies like zSpace have expanded opportunities in STEM subjects with virtual interactive dissections, diagrams and experiments.
more on VR in education in this IMS blog