For the purpose of this chapter, Cross Reality or XR refers to technologies and applications that involve combinations of mixed reality (MR), augmented reality (AR), virtual reality (VR), and virtual worlds (VWs). These are technologies that connect computer technology (such as informational overlays) to the physical world for the purposes of augmenting or extending experiences beyond the real. Especially relevant to the definition of XR is the fact that this term encompasses a wide range of options for delivering learning experiences, from minimal technology and episodic experiences to deep immersion and persistent platforms. The preponderance of different terms for slightly different technologies indicate that this is a growth area within the field. Here we provide a few definitions of these technologies.
MR—Mixed reality refers to a blend of technologies used to influence the human perception of an experience. Motion sensors, body tracking, and eye tracking interplay with overlaid technology to give a rich and full version of reality displayed to the user. For example, technology could add sound or additional graphics to an experience in real time. Examples include the Magic Leap One and Microsoft HoloLens 2.0. MR and XR are often used interchangeably.
AR—Augmented reality refers to technology systems that overlay information onto the real world, but the technology might not allow for real-time feedback. As such, AR experiences can move or animate, but they might not interact with changes in depth of view or external light conditions. Currently, AR is considered the first generation of the newer and more interactive MR experiences.
VR—Virtual reality, as a technological product, traces its history to approximately 1960 and tends to encompass user experiences that are visually and auditorily different from the real world. Indeed, the real world is often blocked from interacting with the virtual one. Headsets, headphones, haptics, and haptic clothing might purposely cut off all input except that which is virtual. In general, VR is a widely recognizable term, often found in gaming and workplace training, where learners need to be transported to a different time and place. VR experiences in STEM often consist of virtual labs or short virtual field trips.
VW—Virtual worlds are frequently considered a subset of VR with the difference that VWs are inherently social and collaborative; VWs frequently contain multiple simultaneous users, while VRs are often solo experiences. Another discrimination between virtual reality and virtual worlds is the persistence of the virtual space. VR tends to be episodic, with the learner in the virtual experience for a few minutes and the reality created within the experience ends when the learner experience ends. VWs are persistent in that the worlds continue to exist on computer servers whether or not there are active avatars within the virtual space (Bell 2008). This discrimination between VR and VW, however, is dissolving. VR experiences can be created to exist for days, and some users have been known to wear headsets for extended periods of time. Additionally, more and more VR experiences are being designed to be for game play, socialization, or mental relaxation. The IEEE VR 2020 online conference and the Educators in VR International Summit 2020 offered participants opportunities to experience conference presentations in virtual rooms as avatars while interacting with presenters and conference attendees (see Sect. 2.5 for more information).
CVEs—Collaborative virtual environments are communication systems in which multiple interactants share the same three-dimensional digital space despite occupying remote physical locations (Yee and Bailenson 2006).
Embodiment—Embodiment is defined by Lindgren and Johnson-Glenberg (2013) as the enactment of knowledge and concepts through the activity of our bodies within an MR (mixed reality) and physical environment
Human-Centered Design philosophy that involves putting human needs, capabilities, and behavior first (Jerald 2018: 15). XR provides the opportunity to experience just-in-time immersive, experiential learning that uses concrete yet exploratory experiences involving senses that result in lasting memories. Here we discuss opportunities for social applications with XR.
XR learner activities are usually created for individual use, which may or may not need to be simultaneously experienced as a class together at the same time or place with the instructor. Activities can be designed into instruction with VR headsets, high-resolution screens, smartphones, or other solo technological devices for use inside and outside of the classroom.
Do we address the challenges in the grant proposal?
some learners will be held back from full XR activity by visual, physical, and social abilities such as stroke, vertigo, epilepsy, or age-related reaction time. It should also be noted that the encompassing nature of VR headsets might create some discomfort or danger for any learners as they can no longer fully see and control their body and body space.
Among a myriad of other definitions, Noor (2016) describes Virtual Reality (VR) as “a computer generated environment that can simulate physical presence in places in the real world or imagined worlds. The user wears a headset and through specialized software and sensors is immersed in 360-degree views of simulated worlds” (p. 34).
Noor, Ahmed. 2016. “The Hololens Revolution.” Mechanical Engineering 138(10):30-35.
Weiss and colleagues wrote that “Virtual reality typically refers to the use of interactive simulations created with computer hardware and software to present users with opportunities to engage in environments that appear to be and feel similar to real-world objects and events”
Weiss, P. L., Rand, D., Katz, N., & Kizony, R. (2004). Video capture virtual reality as a flexible and effective rehabilitation tool. Journal of NeuroEngineering and Rehabilitation, 1(1), 12. https://doi.org/10.1186/1743-0003-1-12
Henderson defined virtual reality as a “computer based, interactive, multisensory environment that occurs in real time”
Rubin, 2018, p. 28. Virtual reality is an 1. artificial environment that’s 2. immersive enough to convince you that you are 3. actually inside it. ”artificialenvironment ” could mean just about anything. The photograph is an artificial environment of video game is an artificial environment a Pixar movie is an artificial environment the only thing that matters is that it’s not where are you physically are. p. 46 “VR is potentially going to become a direct interface to the subconscious”
p. 225 Virtual reality: the illusion of an all-enveloping artificial world, created by wearing an opaque display in front of your eyes.
From: https://blog.stcloudstate.edu/ims/2018/11/07/can-xr-help-students-learn/ : p. 10 “there is not universal agreement on the definitions of these terms or on the scope of these technologies. Also, all of these technologies currently exist in an active marketplace and, as in many rapidly changing markets, there is a tendency for companies to invent neologisms around 3D technology.” p. 11 Virtual reality means that the wearer is completely immersed in a computer simulation.
There is no necessary distinction between AR and VR; indeed, much research
on the subject is based on a conception of a “virtuality continuum” from entirely
real to entirely virtual, where AR lies somewhere between those ends of the
spectrum. Paul Milgram and Fumio Kishino, “A Taxonomy of Mixed Reality Visual Displays,” IEICE Transactions on Information Systems, vol. E77-D, no. 12 (1994); Steve Mann, “Through the Glass, Lightly,” IEEE Technology and Society Magazine 31, no. 3 (2012): 10–14.
++++++++++++++++++++++
Among a myriad of other definitions, Noor (2016) describes Virtual Reality (VR) as “a computer generated environment that can simulate physical presence in places in the real world or imagined worlds. The user wears a headset and through specialized software and sensors is immersed in 360-degree views of simulated worlds” (p. 34). Weiss and colleagues wrote that “Virtual reality typically refers to the use of interactive simulations created with computer hardware and software to present users with opportunities to engage in environments that appear to be and feel similar to real-world objects and events.” Rubin takes a rather broad approach ascribing to VR: 1. artificial environment that’s 2. immersive enough to convince you that you are 3. actually inside it. (p. 28) and further asserts “VR is potentially going to become a direct interface to the subconscious” (p. 46). Most importantly, as Pomeranz (2018) asserts, “there is not universal agreement on the definitions of these terms or on the scope of these technologies. Also, all of these technologies currently exist in an active marketplace and, as in many rapidly changing markets, there is a tendency for companies to invent neologisms.” (p. 10)
Noor, Ahmed. 2016. “The Hololens Revolution.” Mechanical Engineering 138(10):30-35.
Rubin, P. (2018). Future Presence: How Virtual Reality Is Changing Human Connection, Intimacy, and the Limits of Ordinary Life (Illustrated edition). HarperOne.
Weiss, P. L., Rand, D., Katz, N., & Kizony, R. (2004). Video capture virtual reality as a flexible and effective rehabilitation tool. Journal of NeuroEngineering and Rehabilitation, 1(1), 12. https://doi.org/10.1186/1743-0003-1-12
eXtended Reality (XR): The New World of Human/Machine Interaction
Wednesday, October 31 | 9:45am – 10:30am MT |
Session Type: Breakout Session
Delivery Format: Interactive Presentation
eXtended reality (XR) technologies present opportunities to advance the higher education mission and prepare students for a new world of human/machine interaction. In this interactive session, we will explore what is being done today and what is possible in four key areas of XR: use, technology, content development, and gamification.
Outcomes:
*Identify best-of-class tools and methods available for the design and support of XR in higher ed
* Explain to campus stakeholders the potential of XR to support pedagogy, research, and student success
* Understand the areas of focus of our growing XR community of practice and how you can participate
ThirdEye Announces Razor MR Glasses, Expands into Consumer Metaverse with New Lightweight Solution
Going beyond the enterprise metaverse, the Razor MR Glasses will be ThirdEye’s first foray into the consumer market, offering 100+ apps, hands-free features and a wide field of vision
ThirdEye, a leader in augmented and mixed reality (AR/MR) solutions, today announces its first consumer mixed reality glasses – the Razor MR Glasses. Adding upon the technology that’s proven to be successful in the enterprise, ThirdEye is expanding its lineup of hardware solutions by introducing a new product directly for consumers.
What the metaverse will (and won’t) be, according to 28 experts
metaverse (hopefully) won’t be the virtual world of ‘Snow Crash,’ or ‘Ready Player One.’ It will likely be something more complex, diverse, and wild.
The metaverse concept clearly means very different things to different people. What exists right now is a series of embryonic digital spaces, such as Facebook’s Horizon, Epic Games’ Fortnite, Roblox‘s digital space for gaming and game creation, and the blockchain-based digital world Decentraland–all of which have clear borders, different rules and objectives, and differing rates of growth.
TIFFANY ROLFE
different layers of realities that we can all be experiencing, even in the same environment or physical space. We’re already doing that with our phones to a certain extent—passively in a physical environment while mentally in a digital one. But we’ll see more experiences beyond your phone, where our whole bodies are fully engaged, and that’s where the metaverse starts to get interesting—we genuinely begin to explore and live in these alternate realities simultaneously.
It will have legacy parts that look and feel like the web today, but it will have new nodes and capabilities that will look and feel like the Ready Player One Oasis (amazing gaming worlds), immersion leaking into our world (like my Magicverse concept), and every imaginable permutation of these. I feel that the Xverse will have gradients of sentience and autonomy, and we will have the emergence of synthetic life (things Sun and Thunder is working on) and a multitude of amazing worlds to explore. Building a world will become something everyone can do (like building a webpage or a blog) and people will be able to share richer parts of their external and inner lives at incredibly high-speed across the planet.
YAT SIU, COFOUNDER AND EXECUTIVE CHAIRMAN OF GAMING AND BLOCKCHAIN COMPANY ANIMOCA BRANDS
Reality will exist on a spectrum ranging from physical to virtual (VR), but a significant chunk of our time will be spent somewhere between those extremes, in some form of augmented reality (AR). Augmented reality will be a normal part of daily life. Virtual companions will provide information, commentary, updates and advice on matters relevant to you at that point in time, including your assets and activities, in both virtual and real spaces.
TIMONI WEST, VP OF AUGMENTED AND VIRTUAL REALITY, UNITY:
I think we can all agree our initial dreams of a fully immersive, separate digital world is not only unrealistic, but maybe not what we actually want. So I’ve started defining the metaverse differently to capture the zeitgeist: we’re entering an era where every computer we interact with, big or small, is increasingly world-aware. They can recognize faces, voices, hands, relative and absolute position, velocity, and they can react to this data in a useful way. These contextually aware computers are the path to unlocking ambient computing: where computers fade from the foreground to the background of everyday, useful tools. The metaverse is less of a ‘thing’ and more of a computing era. Contextual computing enables a multitude of new types of interactions and apps: VR sculpting tools and social hangouts, self-driving cars, robotics, smart homes.
as carbon is to the organic world, AI will be both the matrix that provides the necessary structural support and the material from which digital representation will be made. Of all the ways in which AI will shape the form of the metaverse, perhaps most essential is the role it will play in the physical-digital interface. Translating human actions into digital input–language, eye movement, hand gestures, locomotion–these are all actions which AI companies and researchers have already made tremendous progress on.
Qualcomm views the metaverse as an ever-present spatial internet complete with personalized digital experiences that spans the physical and virtual worlds, where everything and everyone can communicate and interact seamlessly.
As an active researcher in the security and forensics of VR systems, should the metaverse come into existence, we should explore and hypothesize the ways it will be misused.
CHITRA RAGAVAN, CHIEF STRATEGY OFFICER AT BLOCKCHAIN DATA ANALYTICS COMPANY ELEMENTUS
I picture [the metaverse] almost like The Truman Show. Only, instead of walking into a television set, you walk into the internet and can explore any number of different realities
We imagine the metaverse as reality made better, a world infused with magic, stories, and functionality at the intersection of the digital and physical worlds.
CAROLINA ARGUELLES NAVAS, GLOBAL PRODUCT MARKETING, AUGMENTED REALITY, SNAP
Rather than building the “metaverse,” a separate and fully virtual reality that is disconnected from the physical world, we are focused on augmenting reality, not replacing it. We believe AR–or computing overlaid on the world around us–has a smoother path to mass adoption, but will also be better for the world than a fully virtual world.
URHO KONTTORI, COFOUNDER AND CTO OF AR/VR HEADSET MAKER VARJO
In the reality-based metaverse, we will be able to more effectively design products of the future, meet and collaborate with our colleagues far away, and experience any remote place in real-time.
ATHERINE ALLEN, CEO OF IMMERSIVE TECH RESEARCH CONSULTANCY LIMINA IMMERSIVE
I prefer to think of the metaverse as simply bringing our bodies into the internet.
The metaverse isn’t just VR! Those spaces will connect to AR glasses and to 2D spaces like Instagram. And most importantly, there will be a real sense of continuity where the things you buy are always available to you.
At its core will be a self-contained economy that allows individuals and businesses to create, own or invest in a range of activities and experiences.
NANDI NOBELL, SENIOR ASSOCIATE AT GLOBAL ARCHITECTURE AND DESIGN FIRM CALLISONRTKL
the metaverse experience can be altered from the individual’s point of view and shaped or curated by any number of agents—whether human or A.I. In that sense, the metaverse does not have an objective look beyond its backend. In essence, the metaverse, together with our physical locations, forms a spatial continuum.
NICK CHERUKURI, CEO AND FOUNDER OF MIXED REALITY GLASSES MAKER THIRDEYE
The AR applications of the metaverse are limitless and it really can become the next great version of the internet.
SAM TABAR, CHIEF STRATEGY OFFICER, BITCOIN MINING COMPANY BIT DIGITAL
It seems fair to predict that the actual aesthetic of any given metaverse will be determined by user demand. If users want to exist in a gamified world populated by outrageous avatars and fantastic landscapes then the metaverse will respond to that demand. Like all things in this world the metaverse will be market driven
Tech CEOs keep talking about “the metaverse.” Mark Zuckerberg insists that Facebook will be seen as a “metaverse company” instead of a social media company. Satya Nadella proclaims Microsoft is creating a “metaverse stack” for the enterprise.
Author Neil Stephenson coined the term “metaverse” in Snow Crash, a dystopian cyberpunk novel published in 1992.
In the novel, the metaverse is a sort of 3D virtual world. It’s not simply a virtual reality game but is a persistent, shared virtual world. Or rather, the metaverse is a whole universe of shared virtual spaces seemingly linked together—you could, essentially, teleport between them.
If you think this all sounds a bit like Ready Player One or a higher-tech version of Second Life, you’re right.
virtual reality (VR) and not augmented reality (AR) was necessary for that kind of vision
To Zuckerberg and other tech CEOs, the concept of “the metaverse” seems to have more in common with “Web 2.0.” It’s a bunch of new technologies: VR headsets! Presence! Persistent digital worlds
Microsoft’s vision of the metaverse seems to take the form of rambling, buzzword-heavy talk about “digital twins” and “converging the physical with the digital” with “mixed reality.” Microsoft’s Azure cloud can do it!
The terms ‘extended reality’ or ‘cross reality’ refer to “technologies and applications that involve combinations of mixed reality (MR), augmented reality (AR), virtual reality (VR), and virtual worlds (VWs)” (Ziker, Truman, & Dodds, 2021, p. 56). Immersive learning definitions draw from Milgram and Kishino’s key taxonomy (1994) emphasizing the continuum of experiences that range from where a computer adds to a learner’s reality with overlays of information, or a computer experientially transports a learner to a different place and time by manipulating sight and sound.
VR Design Model
three different design models (see Figure 3): the ADDIE Design Model (Branson, 1978), Design Thinking (Brown & Wyatt, 2010) from user experience (UX), and the 3D Learning Experience Design Model (Kapp & O’Driscoll, 2009).
Serrat (2008) defines storytelling as “the vivid description of ideas, beliefs, personal experiences, and life-lessons through stories or narratives that evoke powerful emotions and insights” (p.1).
The foundational theory for most XR experiences is experiential learning theory. In cases where users create within XR, constructivist learning theory also applies.
XR experiences can include a story arc (See Appendix D), a tutorial of user affordances, intentional user actions, and place the user into first or third person experiences (Spillers, 2020).
Apple’s upcoming mixed reality headset will reportedly weigh less than an iPhone
Ming-Chi Kuo says it will weigh less than 150 grams
A weight of 150 grams would make Apple’s headset lighter than the Oculus Quest 2 (503 grams), Microsoft’s HoloLens 2 (645 grams), and the Valve Index (809 grams). It would be lighter than Google’s Daydream View, a fabric VR headset designed to hold your phone, which weighed 220 grams. The headset could even be lighter than your iPhone, given that the standard iPhone 12 weighs 164 grams.
The headset, codenamed “N301,” may also have 8K displays, eye-tracking technology, and more than a dozen cameras to both track your hand movements and capture footage that can be displayed inside the headsetapp