While COVID is driving clinical learning to VR, the teaching of human anatomy — which typically takes place in the early years of a medical degree — has already shifted to virtual reality in some universities. Case Western Reserve University’s medical school, for example, had been teaching anatomy on campus through content on Microsoft Hololens, rather than by dissecting cadavers as many universities do. Now, with students unable to come onto campus, the university has shipped headsets to students at home so they can continue learning at home.
p. 5 a LibGuide was created that provided a better description of the available software for both the Microsoft Hololens and the HTC Vive and also discussed potential applications for the technology.
Both the HTC Vive and the Hololens were made bookable through the library’s LibCalendar booking system, streamlining the booking process and creating a better user experience.
When the decision was made to bring virtual and augmented reality into the McGill University Library, an important aspect of this project was to develop a collection of related software to be used alongside the technology. In building this software collection a priority was placed on acquiring software that could be demonstrated as having educational value, or that could potentially be used in relation to, or in support of, university courses.
For the Microsoft Hololens, all software was acquired through Microsoft’s Online Store. The store has a number of educationally relevant HoloLens apps available for purchase. The app ARchitect, for example, gives a basic sense of how augmented reality could be used for viewing new building designs. The app Robotics BIW allows user to simulate robotic functions. A select number of apps, such as Land of the Dinosaurs and Boulevard, provide applications for natural history and art. There were a select number of apps related to science, mathematics and medicine, and others with artistic applications. All of the HoloLens applications were free but, compared to what is available for virtual reality, the experiences were much smaller in size and scope.
For the HoloLens, a generic user account was created and shared with person who booked the HoloLens at the time of their booking. After logging into this account – which could sometimes prove to be a challenge because typing is done using the headset’s gesture controls – the user could select a floating tile which would reveal a list of available software. An unresolved problem was that users would then need to refer to the HoloLens LibGuide for a detailed description of the software, or else choose software based on name alone, and the names were not always helpful.
For the Microsoft HoloLens, the three most popular software programs were Land of the Dinosaurs, Palmyra and Insight Heart. Insight Heart allow users to view and manipulate a 3D rendering of a high-resolution human heart, Land of the Dinosaurs provided an augment reality experience featuring 3D renderings of dinosaurs, and Palmyra gave an augmented reality tour of the ancient city of Palmyra.
p. 7 Though many students had ideas for research projects that could make use of the technology, there was no available software that would have allowed them to use augmented reality in the way they wanted. There were no students interested in developing their own software to be used with the technology either.
p. 8 we found that the Microsoft HoloLens received significant use from our patrons, we would recommend the purchase of one only for libraries serving researchers and developers.
++++++++++++
Getting Real in the Library: A Case Study at the University of Florida
As an alternative, Microsoft offers a Hololens with enterprise options geared toward multiple users for $5000.
The transition from mobile app development to VR/AR technology also reflected the increased investment in VR/AR by some of the largest technology companies in the world. In the past four years, Facebook purchased the virtual reality company Oculus, Apple released the ARKit for developing augmented reality applications on iOS devices, Google developed Google Cardboard as an affordable VR option, and Sony released Playstation VR to accompany their gaming platform, just to name a few notable examples. This increase of VR/AR development was mirrored by a rise in student interest and faculty research in using and creating new VR/AR content at UF.
+++++++++++
Arnhem, J.-P. van, Elliott, C., & Rose, M. (2018). Augmented and Virtual Reality in Libraries. Rowman & Littlefield.
Hammady, R., & Ma, M. (2018). Designing Spatial UI as a Solution of the Narrow FOV of Microsoft HoloLens: Prototype of Virtual Museum Guide. In Proceedings of the 4th International AR & VR Conference 2018. Springer. Retrieved from https://eprints.staffs.ac.uk/4799/
‘HoloMuse’ that engage users with archaeological artefacts through gesture-based interactions (Pollalis, Fahnbulleh, Tynes, & Shaer, 2017). Another research utilised HoloLens to provide in-situ assistant for users (Blattgerste, Strenge, Renner, Pfeiffer, & Essig, 2017). HoloLens also used to provide magnification for low vision users by complementary finger-worn camera alongside with the HMD (Stearns, DeSouza, Yin, Findlater, & Froehlich, 2017). Even in the medical applications, HoloLens contributed in 3D visualisation purposes using AR techniques (Syed, Zakaria, & Lozanoff, 2017) and provide optimised measurements in medical surgeries(Pratt et al., 2018) (Adabi et al., 2017). Application of HoloLens extended to visualise prototype designs (DeLaOsa, 2017) and showed its potential in gaming industry (Volpe, 2015) (Alvarez, 2015) and engaging cultural visitors with gaming activities (Raptis, Fidas, & Avouris, 2017).
++++++++++++
van Arnhem, J.-P., & Spiller, J. M. (2014). Augmented Reality for Discovery and Instruction. Journal of Web Librarianship, 8(2), 214–230. https://doi.org/10.1080/19322909.2014.904208
+++++++++++
Evaluating the Microsoft HoloLens through an augmented reality assembly application
To assess the HoloLens’ potential for delivering AR assembly instructions, the cross-platform Unity 3D game engine was used to build a proof of concept application. Features focused upon when building the prototype were: user interfaces, dynamic 3D assembly instructions, and spatially registered content placement. The research showed that while the HoloLens is a promising system, there are still areas that require improvement, such as tracking accuracy, before the device is ready for deployment in a factory assembly setting.
+++++++++++
Pollalis, C., Fahnbulleh, W., Tynes, J., & Shaer, O. (2017). HoloMuse: Enhancing Engagement with Archaeological Artifacts Through Gesture-Based Interaction with Holograms. In Proceedings of the Eleventh International Conference on Tangible, Embedded, and Embodied Interaction (pp. 565–570). New York, NY, USA: ACM. https://doi.org/10.1145/3024969.3025094
Gračanin, D., Ciambrone, A., Tasooji, R., & Handosa, M. (2017). Mixed Library — Bridging Real and Virtual Libraries. In S. Lackey & J. Chen (Eds.), Virtual, Augmented and Mixed Reality (pp. 227–238). Springer International Publishing.
We use Microsoft HoloLens device to augment the user’s experience in the real library and to provide a rich set of affordances for embodied and social interactions.We describe a mixed reality based system, a prototype mixed library, that provides a variety of affordances to support embodied interactions and improve the user experience.
Computer science as an engineering discipline has been spectacularly successful. Yet it is also a philosophical enterprise in the way it represents the world and creates and manipulates models of reality, people, and action. In this book, Paul Dourish addresses the philosophical bases of human-computer interaction. He looks at how what he calls “embodied interaction”—an approach to interacting with software systems that emphasizes skilled, engaged practice rather than disembodied rationality—reflects the phenomenological approaches of Martin Heidegger, Ludwig Wittgenstein, and other twentieth-century philosophers. The phenomenological tradition emphasizes the primacy of natural practice over abstract cognition in everyday activity. Dourish shows how this perspective can shed light on the foundational underpinnings of current research on embodied interaction. He looks in particular at how tangible and social approaches to interaction are related, how they can be used to analyze and understand embodied interaction, and how they could affect the design of future interactive systems.
++++++++++
Pollalis, C., Fahnbulleh, W., Tynes, J., & Shaer, O. (2017). HoloMuse: Enhancing Engagement with Archaeological Artifacts Through Gesture-Based Interaction with Holograms. In Proceedings of the Eleventh International Conference on Tangible, Embedded, and Embodied Interaction (pp. 565–570). New York, NY, USA: ACM. https://doi.org/10.1145/3024969.3025094
HoloMuse, an AR application for the HoloLens wearable device, which allows users to actively engage with archaeological artifacts from a museum collection
pick up, rotate, scale, and alter a hologram of an original archeological artifact using in-air gestures. Users can also curate their own exhibit or customize an existing one by selecting artifacts from a virtual gallery and placing them within the physical world so that they are viewable only using the device. We intend to study the impact of HoloMuse on learning and engagement with college-level art history and archeology students.
new forms of human-computer interaction (HCI) such as augmented reality (AR),virtual reality (VR) and mixed reality (MR).
p. 21
combining AR/VR/MR with cognitive computing and artificial intelligence (AI) technologies (such as machine learning, deep learning, natural language processing and chatbots).
Some thought-provoking questions include:
Will remote workers be able to be seen and interacted with via their holograms (i.e., attending their meetings virtually)? What would this mean for remote learners?
Will our smartphones increasingly allow us to see information overlaid on the real world? (Think Pokémon Go, but putting that sort of technology into a vast array of different applications, many of which could be educational in nature)
How do/will these new forms of HCI impact how we design our learning spaces?
Will students be able to pick their preferred learning setting (i.e., studying by a brook or stream or in a virtual Starbucks-like atmosphere)?
Will more devices/platforms be developed that combine the power of AI with VR/AR/MR-related experiences? For example, will students be able to issue a verbal question or command to be able to see and experience walking around ancient Rome?
Will there be many new types of learning experiences,like what Microsoft was able to achieve in its collaboration with Case Western Reserve University [OH]? Its HoloLens product transforms the way human anatomy can be taught.
p. 22 Extensive costs for VR design and development drive the need for collaborative efforts.
Case Western Reserve University, demonstrates a collaboration with the Cleveland Clinic and Microsoft to create active multi-dimensional learning using holography.
the development of more affordable high-quality virtual reality solutions.
AR game developed by the Salzburg University of Applied Sciences [Austria] (http://www.fh-salzburg.ac.at/en/) that teaches about sustainability, the environment and living green.
Whether using AR for a gamified course or to acclimate new students to campus, the trend will continue into 2017.
Google Expeditions This virtual reality field trip tool works in conjunction with Google Cardboard and has just been officially released. The app allows teachers to guide students through an exploration of 200 (and growing) historical sites and natural resources in an immersive, three-dimensional experience. The app only works on Android devices and is free.
Flippity This app works in conjunction with Google Sheets and allows teachers to easily make a Jeopardy-style game.
Google Science Journal This Android app allows users to do science experiments with mobile phones. Students can use sensors in the phone or connect external sensors to collect data, but can also take notes on observations, analyze and annotate within the app.
Google Cast This simple app solves issues of disparate devices in the classroom. When students download the app, they can project from their devices onto the screen at the front of the room easily. “You don’t have to have specific hardware, you just have to have Wi-Fi,”
Constitute This site hosts a database of constitutions from around the world. Anything digitally available has been aggregated here. It is searchable by topic and will pull out specific excerpts related to search terms like “freedom of speech.”
YouTube a database of YouTube Channels by subject to help educators with discoverability (hint subjects are by tab along the bottom of the document).
Zygote Body This freemium tool has a lot of functionality in the free version, allowing students to view different parts of human anatomy and dig into how various body systems work.
Pixlr This app has less power than Photoshop, but is free and fairly sophisticated. It works directly with Google accounts, so students can store files there.
uild With Chrome This extension to the Chrome browser lets kids play with digital blocks like Legos. Based on the computer’s IP address, the software assigns users a plot of land on which to build nearby. There’s a Build Academy to learn how to use the various tools within the program, but then students can make whatever they want.
Google CS First Built on Scratch’s programming language, this easy tool gives step-by-step instructions to get started and is great for the hesitant teacher who is just beginning to dip a toe into coding.
Microsoft’s forthcoming AR headset, HoloLens, is at the forefront of this technology. The company calls it the first holographic computer. In AR, instead of being surrounded by a virtual world, viewers see virtual objects projected on top of reality through a transparent lens.
“With a computer or tablet, we always have to look at a screen. … The technology is always in between the people. With HoloLens, the technology very quickly becomes invisible, and we have seen groups of people have very intense interactions around models that are completely digital — they aren’t really there.”
Virtual reality, like the new Facebook Oculus and HTC Vive, completely immerse you inside a computer generated world. It’s like being inside a 360-degree video game, or movie, or computer-generated simulation.
according to a report in The Information today, Google’s long-term bet is on augmented reality. The company is making not one but several follow-ups to Glass, and has a project called “Tango” that aims to outfit smartphones with computerized “eyes” that can map a 3D space.
D.Frank Smith