2019 Realities360 Conference and Expo
San Jose, USA
25 – 27 June 2019
EXPLORE AR AND VR IN YOUR WORK
Augmented and virtual reality technologies are the latest buzz in the training and education sector. 2019 Realities360 Conference and Expo is the event for you to explore this tech, and get started building and implementing your AR/VR strategy. You won’t want to miss it.
The 2019 Realities360 program delivers over 50 sessions covering the critical topics that will help you develop new skills, strategies, and expertise within the AR/VR world. Plus, in several sessions you’ll build the knowledge and skills directly with hands-on learning experiences.
Here are some essential sessions you’ll need to attend:
– Better Than the Real Thing: VR Learning Surpassing Real-world Training
– Transforming Learning with Digital Reality
– Designing Instructionally-Effective Virtual Experiences
– Lessons from a Year of Cost-Effective Immersive Strategies in Higher Ed
– Exploring the Efficacy of Virtual Reality for Training Centers of the Future
In May 2018, Google announced a partnership with Labster, a virtual lab simulator, to develop immersive high school and college biology and anatomy courses.
Course title: IM 554 Developing Skills for Online Teaching and Learning
Topic for this week: Game-based learning, Virtual Reliability, and Augmented Reality
Audience: IM Graduate students working for K12 schools or in business
2. How did GBL change in the past year? Who is the leader in this research (country)? Is K12 the “playground” for GBL and DGBL?
China: Liao, C., Chen, C., & Shih, S. (2019). The interactivity of video and collaboration for learning achievement, intrinsic motivation, cognitive load, and behavior patterns in a digital game-based learning environment. Computers & Education, 133, 43–55. https://doi.org/10.1016/j.compedu.2019.01.013
Finalnd: Brezovszky, B., Mcmullen, J., Veermans, K., Hannula-Sormunen, M., Rodríguez-Aflecht, G., Pongsakdi, N., … Lehtinen, E. (2019). Effects of a mathematics game-based learning environment on primary school students’ adaptive number knowledge. Computers & Education, 128, 63–74. https://doi.org/10.1016/j.compedu.2018.09.011
Tunesia: Denden, M., Tlili, A., Essalmi, F., & Jemni, M. (2018). Implicit modeling of learners’ personalities in a game-based learning environment using their gaming behaviors. Smart Learning Environments, 5(1), 1–19. https://doi.org/10.1186/s40561-018-0078-6
Pitarch, R. (2018). An Approach to Digital Game-based Learning: Video-games Principles and Applications in Foreign Language Learning. Journal of Language Teaching and Research, 9(6), 1147–1159. https://doi.org/10.17507/jltr.0906.04
min 29 from start: University of Connecticut (chapter 1)
min 58 from start: Dan Getz with Penn State (chapter 2)
hour 27 min from start: Randy Rode, Yale (chapter 3)
Thousands of people, from kids to teachers to big brands, are creating all kinds of Augmented Reality Experiences (games, interactive stories, educational curriculum, scavenger hunts, RPGs and much more!)
p. 5 a LibGuide was created that provided a better description of the available software for both the Microsoft Hololens and the HTC Vive and also discussed potential applications for the technology.
Both the HTC Vive and the Hololens were made bookable through the library’s LibCalendar booking system, streamlining the booking process and creating a better user experience.
When the decision was made to bring virtual and augmented reality into the McGill University Library, an important aspect of this project was to develop a collection of related software to be used alongside the technology. In building this software collection a priority was placed on acquiring software that could be demonstrated as having educational value, or that could potentially be used in relation to, or in support of, university courses.
For the Microsoft Hololens, all software was acquired through Microsoft’s Online Store. The store has a number of educationally relevant HoloLens apps available for purchase. The app ARchitect, for example, gives a basic sense of how augmented reality could be used for viewing new building designs. The app Robotics BIW allows user to simulate robotic functions. A select number of apps, such as Land of the Dinosaurs and Boulevard, provide applications for natural history and art. There were a select number of apps related to science, mathematics and medicine, and others with artistic applications. All of the HoloLens applications were free but, compared to what is available for virtual reality, the experiences were much smaller in size and scope.
For the HoloLens, a generic user account was created and shared with person who booked the HoloLens at the time of their booking. After logging into this account – which could sometimes prove to be a challenge because typing is done using the headset’s gesture controls – the user could select a floating tile which would reveal a list of available software. An unresolved problem was that users would then need to refer to the HoloLens LibGuide for a detailed description of the software, or else choose software based on name alone, and the names were not always helpful.
For the Microsoft HoloLens, the three most popular software programs were Land of the Dinosaurs, Palmyra and Insight Heart. Insight Heart allow users to view and manipulate a 3D rendering of a high-resolution human heart, Land of the Dinosaurs provided an augment reality experience featuring 3D renderings of dinosaurs, and Palmyra gave an augmented reality tour of the ancient city of Palmyra.
p. 7 Though many students had ideas for research projects that could make use of the technology, there was no available software that would have allowed them to use augmented reality in the way they wanted. There were no students interested in developing their own software to be used with the technology either.
p. 8 we found that the Microsoft HoloLens received significant use from our patrons, we would recommend the purchase of one only for libraries serving researchers and developers.
++++++++++++
Getting Real in the Library: A Case Study at the University of Florida
As an alternative, Microsoft offers a Hololens with enterprise options geared toward multiple users for $5000.
The transition from mobile app development to VR/AR technology also reflected the increased investment in VR/AR by some of the largest technology companies in the world. In the past four years, Facebook purchased the virtual reality company Oculus, Apple released the ARKit for developing augmented reality applications on iOS devices, Google developed Google Cardboard as an affordable VR option, and Sony released Playstation VR to accompany their gaming platform, just to name a few notable examples. This increase of VR/AR development was mirrored by a rise in student interest and faculty research in using and creating new VR/AR content at UF.
+++++++++++
Arnhem, J.-P. van, Elliott, C., & Rose, M. (2018). Augmented and Virtual Reality in Libraries. Rowman & Littlefield.
Hammady, R., & Ma, M. (2018). Designing Spatial UI as a Solution of the Narrow FOV of Microsoft HoloLens: Prototype of Virtual Museum Guide. In Proceedings of the 4th International AR & VR Conference 2018. Springer. Retrieved from https://eprints.staffs.ac.uk/4799/
‘HoloMuse’ that engage users with archaeological artefacts through gesture-based interactions (Pollalis, Fahnbulleh, Tynes, & Shaer, 2017). Another research utilised HoloLens to provide in-situ assistant for users (Blattgerste, Strenge, Renner, Pfeiffer, & Essig, 2017). HoloLens also used to provide magnification for low vision users by complementary finger-worn camera alongside with the HMD (Stearns, DeSouza, Yin, Findlater, & Froehlich, 2017). Even in the medical applications, HoloLens contributed in 3D visualisation purposes using AR techniques (Syed, Zakaria, & Lozanoff, 2017) and provide optimised measurements in medical surgeries(Pratt et al., 2018) (Adabi et al., 2017). Application of HoloLens extended to visualise prototype designs (DeLaOsa, 2017) and showed its potential in gaming industry (Volpe, 2015) (Alvarez, 2015) and engaging cultural visitors with gaming activities (Raptis, Fidas, & Avouris, 2017).
++++++++++++
van Arnhem, J.-P., & Spiller, J. M. (2014). Augmented Reality for Discovery and Instruction. Journal of Web Librarianship, 8(2), 214–230. https://doi.org/10.1080/19322909.2014.904208
+++++++++++
Evaluating the Microsoft HoloLens through an augmented reality assembly application
To assess the HoloLens’ potential for delivering AR assembly instructions, the cross-platform Unity 3D game engine was used to build a proof of concept application. Features focused upon when building the prototype were: user interfaces, dynamic 3D assembly instructions, and spatially registered content placement. The research showed that while the HoloLens is a promising system, there are still areas that require improvement, such as tracking accuracy, before the device is ready for deployment in a factory assembly setting.
+++++++++++
Pollalis, C., Fahnbulleh, W., Tynes, J., & Shaer, O. (2017). HoloMuse: Enhancing Engagement with Archaeological Artifacts Through Gesture-Based Interaction with Holograms. In Proceedings of the Eleventh International Conference on Tangible, Embedded, and Embodied Interaction (pp. 565–570). New York, NY, USA: ACM. https://doi.org/10.1145/3024969.3025094
Gračanin, D., Ciambrone, A., Tasooji, R., & Handosa, M. (2017). Mixed Library — Bridging Real and Virtual Libraries. In S. Lackey & J. Chen (Eds.), Virtual, Augmented and Mixed Reality (pp. 227–238). Springer International Publishing.
We use Microsoft HoloLens device to augment the user’s experience in the real library and to provide a rich set of affordances for embodied and social interactions.We describe a mixed reality based system, a prototype mixed library, that provides a variety of affordances to support embodied interactions and improve the user experience.
Computer science as an engineering discipline has been spectacularly successful. Yet it is also a philosophical enterprise in the way it represents the world and creates and manipulates models of reality, people, and action. In this book, Paul Dourish addresses the philosophical bases of human-computer interaction. He looks at how what he calls “embodied interaction”—an approach to interacting with software systems that emphasizes skilled, engaged practice rather than disembodied rationality—reflects the phenomenological approaches of Martin Heidegger, Ludwig Wittgenstein, and other twentieth-century philosophers. The phenomenological tradition emphasizes the primacy of natural practice over abstract cognition in everyday activity. Dourish shows how this perspective can shed light on the foundational underpinnings of current research on embodied interaction. He looks in particular at how tangible and social approaches to interaction are related, how they can be used to analyze and understand embodied interaction, and how they could affect the design of future interactive systems.
++++++++++
Pollalis, C., Fahnbulleh, W., Tynes, J., & Shaer, O. (2017). HoloMuse: Enhancing Engagement with Archaeological Artifacts Through Gesture-Based Interaction with Holograms. In Proceedings of the Eleventh International Conference on Tangible, Embedded, and Embodied Interaction (pp. 565–570). New York, NY, USA: ACM. https://doi.org/10.1145/3024969.3025094
HoloMuse, an AR application for the HoloLens wearable device, which allows users to actively engage with archaeological artifacts from a museum collection
pick up, rotate, scale, and alter a hologram of an original archeological artifact using in-air gestures. Users can also curate their own exhibit or customize an existing one by selecting artifacts from a virtual gallery and placing them within the physical world so that they are viewable only using the device. We intend to study the impact of HoloMuse on learning and engagement with college-level art history and archeology students.
On Thursday, virtual reality company HTC VIVE announced its new headset called the Vive Focus, which is aimed at enterprises.
It can be used for business collaboration, training and education, such as teaching medical students about sleep apnea, showing car designers how to fix and prototype a car, and conducting remote meetings in a 3D virtual space.
Although virtual reality is typically associated with consumers, such as for video gaming, the technology is increasingly being adopted for use in professional settings. VR and augmented reality are projected to grow to $162 billion by 2020, and more products are targeting enterprise use.
What makes this hardware significant is that it’s much simpler and more portable for customers to use, says Dan O’Brien, General Manager of the Americas at HTC VIVE (My note: so he said…). Other VR headsets that only developers may use might involve expensive hardware and require users to stay in one place.
VIVE Sync. This can be used to help employees collaborate with each other in a virtual space, especially when they work remotely. Each employee’s avatar can share ideas, show presentations, import images, show videos and more all in a 3D virtual space (My note: Second Life tried this; and failed; Do you have any NEW ideas, Dan?).
at a session on the umbrella concept of “mixed reality” (abbreviated XR) here Thursday, attendees had some questions for the panel’s VR/AR/XR evangelists: Can these tools help students learn? Can institutions with limited budgets pull off ambitious projects? Can skeptical faculty members be convinced to experiment with unfamiliar technology?
Yale has landed on a “hub model” for project development — instructors propose projects and partner with students with technological capabilities to tap into a centralized pool of equipment and funding. (My note: this is what I suggest in my Chapter 2 of Arnheim, Eliot & Rose (2012) Lib Guides)
Several panelists said they had already been getting started on mixed reality initiatives prior to the infusion of support from Educause and HP, which helped them settle on a direction
While 3-D printing might seem to lend itself more naturally to the hard sciences, Yale’s humanities departments have cottoned to the technology as a portal to answering tough philosophical questions.
institutions would be better served forgoing an early investment in hardware and instead gravitating toward free online products like Unity, Organon and You by Sharecare, all of which allow users to create 3-D experiences from their desktop computers.
XR technologies encompassing 3D simulations, modeling, and production.
This project sought to identify
current innovative uses of these 3D technologies,
how these uses are currently impacting teaching and learning, and
what this information can tell us about possible future uses for these technologies in higher education.
p. 5 Extended reality (XR) technologies, which encompass virtual reality (VR) and augmented reality (AR), are already having a dramatic impact on pedagogy in higher education. XR is a general term that covers a wide range of technologies along a continuum, with the real world at one end and fully immersive simulations at the other.
p. 6The Campus of the Future project was an exploratory evaluation of 3D technologies for instruction and research in higher education: VR, AR, 3D scanning, and 3D printing. The project sought to identify interesting and novel uses of 3D technology
p. 7 HP would provide the hardware, and EDUCAUSE would provide the methodological expertise to conduct an evaluation research project investigating the potential uses of 3D technologies in higher education learning and research.
The institutions that participated in the Campus of the Future project were selected because they were already on the cutting edge of integrating 3D technology into pedagogy. These institutions were therefore not representative, nor were they intended to be representative, of the state of higher education in the United States. These institutions were selected precisely because they already had a set of use cases for 3D technology available for study
p. 9 At some institutions, the group participating in the project was an academic unit (e.g., the Newhouse School of Communications at Syracuse University; the Graduate School of Education at Harvard University). At these institutions, the 3D technology provided by HP was deployed for use more or less exclusively by students and faculty affiliated with the particular academic unit.
p. 10 definitions
there is not universal agreement on the definitions of these
terms or on the scope of these technologies. Also, all of these technologies
currently exist in an active marketplace and, as in many rapidly changing markets, there is a tendency for companies to invent neologisms around 3D technology.
A 3D scanner is not a single device but rather a combination of hardware and
software. There are generally two pieces of hardware: a laser scanner and a digital
camera. The laser scanner bounces laser beams off the surface of an object to
determine its shape and contours.
p. 11 definitions
Virtual reality means that the wearer is completely immersed in a computer
simulation. Several types of VR headsets are currently available, but all involve
a lightweight helmet with a display in front of the eyes (see figure 2). In some
cases, this display may simply be a smartphone (e.g., Google Cardboard); in other
cases, two displays—one for each eye—are integrated into the headset (e.g., HTC
Vive). Most commercially available VR rigs also include handheld controllers
that enable the user to interact with the simulation by moving the controllers
in space and clicking on finger triggers or buttons.
p. 12 definitions
Augmented reality provides an “overlay” of some type over the real world through
the use of a headset or even a smartphone.
In an active technology marketplace, there is a tendency for new terms to be
invented rapidly and for existing terms to be used loosely. This is currently
happening in the VR and AR market space. The HP VR rig and the HTC Vive
unit are marketed as being immersive, meaning that the user is fully immersed in
a simulation—virtual reality. Many currently available AR headsets, however, are
marketed not as AR but rather as MR (mixed reality). These MR headsets have a
display in front of the eyes as well as a pair of front-mounted cameras; they are
therefore capable of supporting both VR and AR functionality.
p. 13 Implementation
Technical difficulties.
Technical issues can generally be divided into two broad categories: hardware
problems and software problems. There is, of course, a common third category:
human error.
p. 15 the technology learning curve
The well-known diffusion of innovations theoretical framework articulates five
adopter categories: innovators, early adopters, early majority, late majority, and
laggards. Everett M. Rogers, Diffusion of Innovations, 5th ed. (New York: Simon and Schuster, 2003).
It is also likely that staff in the campus IT unit or center for teaching and learning already know who (at least some of) these individuals are, since such faculty members are likely to already have had contact with these campus units.
Students may of course also be innovators and early adopters, and in fact
several participating institutions found that some of the most creative uses of 3D technology arose from student projects
p. 30 Zeynep Tufekci, in her book Twitter and Tear Gas
definition: There is no necessary distinction between AR and VR; indeed, much research
on the subject is based on a conception of a “virtuality continuum” from entirely
real to entirely virtual, where AR lies somewhere between those ends of the
spectrum. Paul Milgram and Fumio Kishino, “A Taxonomy of Mixed Reality Visual Displays,” IEICE Transactions on Information Systems, vol. E77-D, no. 12 (1994); Steve Mann, “Through the Glass, Lightly,” IEEE Technology and Society Magazine 31, no. 3 (2012): 10–14.
For the future of 3D technology in higher education to be realized, that
technology must become as much a part of higher education as any technology:
the learning management system (LMS), the projector, the classroom. New
technologies and practices generally enter institutions of higher education as
initiatives. Several active learning classroom initiatives are currently under
way,36 for example, as well as a multi-institution open educational resources
(OER) degree initiative.37
p. 32 Storytelling
Some scholars have argued that all human communication
is based on storytelling;41 certainly advertisers have long recognized that
storytelling makes for effective persuasion,42 and a growing body of research
shows that narrative is effective for teaching even topics that are not generally
thought of as having a natural story, for example, in the sciences.43
p. 33 accessibility
The experience of Gallaudet University highlights one of the most important
areas for development in 3D technology: accessibility for users with disabilities.
p. 34 instructional design
For that to be the case, 3D technologies must be incorporated into the
instructional design process for building and redesigning courses. And for that
to be the case, it is necessary for faculty and instructional designers to be familiar
with the capabilities of 3D technologies. And for that to be the case, it may not be necessary but would certainly be helpful for instructional designers to collaborate closely with the staff in campus IT units who support and maintain this hardware.
Every institution of higher education has a slightly different organizational structure, of course, but these two campus units are often siloed. This siloing may lead to considerable friction in conducting the most basic organizational tasks, such as setting up meetings and apportioning responsibilities for shared tasks. Nevertheless, IT units and centers for teaching and learning are almost compelled to collaborate in order to support faculty who want to integrate 3D technology into their teaching. It is necessary to bring the instructional design expertise of a center for teaching and learning to bear on integrating 3D technology into an instructor’s teaching (My note: and where does this place SCSU?) Therefore, one of the most critical areas in which IT units and centers for teaching and learning can collaborate is in assisting instructors to develop this integration and to develop learning objects that use 3D technology. p. 35 For 3D technology to really gain traction in higher education, it will need to be easier for instructors to deploy without such a large support team.
p. 35 Sites such as Thingiverse, Sketchfab, and Google Poly are libraries of freely
available, user-created 3D models.
ClassVR is a tool that enables the simultaneous delivery of a simulation to
multiple headsets, though the simulation itself may still be single-user.
p. 37 data management:
An institutional repository is a collection of an institution’s intellectual output, often consisting of preprint journal articles and conference papers and the data sets behind them.49 An institutional repository is often maintained by either the library or a partnership between the library and the campus IT unit. An institutional repository therefore has the advantage of the long-term curatorial approach of librarianship combined with the systematic backup management of the IT unit. (My note: leaves me wonder where does this put SCSU)
Sharing data sets is critical for collaboration and increasingly the default for
scholarship. Data is as much a product of scholarship as publications, and there
is a growing sentiment among scholars that it should therefore be made public.50
Our survey polled 232 faculty members across the country about their use of technology in the classroom, their likes and dislikes, their predictions for the future and more. The majority of respondents (68 percent) come from public institutions, with 28 percent from private nonprofits and 4 percent working at for-profit schools. Seventy-two percent work at four-year colleges or universities; 26 percent are at community colleges (the remaining 2 percent designated their institutional level as “other”).
Respondents represent institutions of a range of sizes, with about one-third (32 percent) working in colleges or universities with 2,500 to 9,999 students. Just under half (45 percent) of respondents are from institutions with 10,000 students or more.
Our respondents are veterans of higher education: The largest group (47 percent) has more than 20 years of experience, with 81 percent logging at least 11 years in the field.
The top three most common school and college types among our respondents are education (22 percent), business/business administration (17 percent) and liberal arts (12 percent). But overall, respondents work in a wide range of disciplines, from engineering and medicine to humanities and fine arts. The top 10 states with the most survey respondents are New York, Texas, California, Florida, Georgia, Virginia, Illinois, Missouri, Pennsylvania and Massachusetts.
Indiana University explores that question by bringing together tech partners and university leaders to share ideas on how to design classrooms that make better use of faculty and student time.
Untether instructors from the room’s podium, allowing them control from anywhere in the room;
Streamline the start of class, including biometric login to the room’s technology, behind-the-scenes routing of course content to room displays, control of lights and automatic attendance taking;
Offer whiteboards that can be captured, routed to different displays in the room and saved for future viewing and editing;
Provide small-group collaboration displays and the ability to easily route content to and from these displays; and
Deliver these features through a simple, user-friendly and reliable room/technology interface.
Key players from Crestron, Google, Sony, Steelcase and Spectrum met with Indiana University faculty, technologists and architects to generate new ideas related to current and emerging technologies. Activities included collaborative brainstorming focusing on these questions:
What else can we do to create the classroom of the future?
What current technology exists to solve these problems?
What could be developed that doesn’t yet exist?
What’s next?
top five findings:
Screenless and biometric technology will play an important role in the evolution of classrooms in higher education. We plan to research how voice activation and other Internet of Things technologies can streamline the process for faculty and students.
The entire classroom will become a space for student activity and brainstorming; walls, windows, desks and all activities are easily captured to the cloud, allowing conversations to continue outside of class or at the next class meeting.
Technology will be leveraged to include advance automation for a variety of tasks, so the faculty member is released from duties to focus on teaching.
The technology will become invisible to the process and enhance and customize the experience for the learner.
Virtual assistants could play an important role in providing students with a supported experience throughout their entire campus career.
In September 2015, the back-then library dean (they change every 2-3 years) requested a committee of librarians to meet and discuss the remodeling of Miller Center 2018. By that time the SCSU CIO was asserting the BYOx as a new policy for SCSU. BYOx in essence means the necessity for stronger (wider) WiFI pipe. Based on that assertion, I, Plamen Miltenoff, was insisting to shift the cost of hardware (computers, laptops) to infrastructure (more WiFi nods in the room and around it) and prepare for the upcoming IoT by learning to remodel our syllabi for mobile devices and use those (students) mobile devices, rather squander University money on hardware. At least one faculty member from the committee honestly admitted she has no idea about IoT and respectively the merit of my proposal. Thus, my proposal was completely disregarded by the self-nominated chair of the committee of librarians, who pushed for her idea to replace the desktops with a cart of laptops (a very 2010 idea, which by 2015 was already passe). As per Kelly (2018) (second article above), it is obvious the failure of her proposal to the dean to choose laptops over mobile devices, considering that faculty DO see mobile devices completely replacing desktops and laptops; that faculty DO not see document cameras and overhead projectors as a tool to stay.
Here are the notes from September 2015 https://blog.stcloudstate.edu/ims/2015/09/25/mc218-remodel/
As are result, my IoT proposal as now reflected in the Johnston (2018) (first article above), did not make it even formally to the dean, hence the necessity to make it available through the blog.
The SCSU library thinking regarding physical remodeling of classrooms is behind its times and that costs money for the university, if that room needs to be remodeled again to be with the contemporary times.
