Nov
2021
Hand Tracking UX Design
How to Set Up Hand Tracking in Unity 3D
+++++++++++++++++
more on haptic in this IMS blog
https://blog.stcloudstate.edu/ims?s=haptic
Digital Literacy for St. Cloud State University
+++++++++++++++++
more on haptic in this IMS blog
https://blog.stcloudstate.edu/ims?s=haptic
++++++++++++
More on haptics in this blog
https://blog.stcloudstate.edu/ims?s=haptics
For the purpose of this chapter, Cross Reality or XR refers to technologies and applications that involve combinations of mixed reality (MR), augmented reality (AR), virtual reality (VR), and virtual worlds (VWs). These are technologies that connect computer technology (such as informational overlays) to the physical world for the purposes of augmenting or extending experiences beyond the real. Especially relevant to the definition of XR is the fact that this term encompasses a wide range of options for delivering learning experiences, from minimal technology and episodic experiences to deep immersion and persistent platforms. The preponderance of different terms for slightly different technologies indicate that this is a growth area within the field. Here we provide a few definitions of these technologies.
MR—Mixed reality refers to a blend of technologies used to influence the human perception of an experience. Motion sensors, body tracking, and eye tracking interplay with overlaid technology to give a rich and full version of reality displayed to the user. For example, technology could add sound or additional graphics to an experience in real time. Examples include the Magic Leap One and Microsoft HoloLens 2.0. MR and XR are often used interchangeably.
AR—Augmented reality refers to technology systems that overlay information onto the real world, but the technology might not allow for real-time feedback. As such, AR experiences can move or animate, but they might not interact with changes in depth of view or external light conditions. Currently, AR is considered the first generation of the newer and more interactive MR experiences.
VR—Virtual reality, as a technological product, traces its history to approximately 1960 and tends to encompass user experiences that are visually and auditorily different from the real world. Indeed, the real world is often blocked from interacting with the virtual one. Headsets, headphones, haptics, and haptic clothing might purposely cut off all input except that which is virtual. In general, VR is a widely recognizable term, often found in gaming and workplace training, where learners need to be transported to a different time and place. VR experiences in STEM often consist of virtual labs or short virtual field trips.
VW—Virtual worlds are frequently considered a subset of VR with the difference that VWs are inherently social and collaborative; VWs frequently contain multiple simultaneous users, while VRs are often solo experiences. Another discrimination between virtual reality and virtual worlds is the persistence of the virtual space. VR tends to be episodic, with the learner in the virtual experience for a few minutes and the reality created within the experience ends when the learner experience ends. VWs are persistent in that the worlds continue to exist on computer servers whether or not there are active avatars within the virtual space (Bell 2008). This discrimination between VR and VW, however, is dissolving. VR experiences can be created to exist for days, and some users have been known to wear headsets for extended periods of time. Additionally, more and more VR experiences are being designed to be for game play, socialization, or mental relaxation. The IEEE VR 2020 online conference and the Educators in VR International Summit 2020 offered participants opportunities to experience conference presentations in virtual rooms as avatars while interacting with presenters and conference attendees (see Sect. 2.5 for more information).
CVEs—Collaborative virtual environments are communication systems in which multiple interactants share the same three-dimensional digital space despite occupying remote physical locations (Yee and Bailenson 2006).
Embodiment—Embodiment is defined by Lindgren and Johnson-Glenberg (2013) as the enactment of knowledge and concepts through the activity of our bodies within an MR (mixed reality) and physical environment
https://hyp.is/mBiunvx3EeudElMRwHm5dQ/www.ncbi.nlm.nih.gov/pmc/articles/PMC7948004/
Human-Centered Design philosophy that involves putting human needs, capabilities, and behavior first (Jerald 2018: 15). XR provides the opportunity to experience just-in-time immersive, experiential learning that uses concrete yet exploratory experiences involving senses that result in lasting memories. Here we discuss opportunities for social applications with XR.
https://hyp.is/wJSoFPx3Eeu1mAPmeAp2tQ/www.ncbi.nlm.nih.gov/pmc/articles/PMC7948004/
XR learner activities are usually created for individual use, which may or may not need to be simultaneously experienced as a class together at the same time or place with the instructor. Activities can be designed into instruction with VR headsets, high-resolution screens, smartphones, or other solo technological devices for use inside and outside of the classroom.
https://hyp.is/wJSoFPx3Eeu1mAPmeAp2tQ/www.ncbi.nlm.nih.gov/pmc/articles/PMC7948004/
Ready to go relationship between STEM courses and XR. In bullet points!
https://hyp.is/wJSoFPx3Eeu1mAPmeAp2tQ/www.ncbi.nlm.nih.gov/pmc/articles/PMC7948004/
Do we address the challenges in the grant proposal?
some learners will be held back from full XR activity by visual, physical, and social abilities such as stroke, vertigo, epilepsy, or age-related reaction time. It should also be noted that the encompassing nature of VR headsets might create some discomfort or danger for any learners as they can no longer fully see and control their body and body space.
Apple AR motion controllers may detect fingers without covering the hand from r/gadgets
++++++++++++++
more on haptic in this IMS blog
https://blog.stcloudstate.edu/ims?s=haptic
+++++++++++++
more on haptic in this IMS blog
https://blog.stcloudstate.edu/ims?s=haptic
For details, go here:
https://www.eventbrite.com/e/behind-the-scenes-with-microsoft-vr-in-the-wild-tickets-128181001827
Behind the Scenes: Microsoft’s Principal Researcher Eyal Ofek speaking about technical and social perspectives of XR
About this Event
The XR Bootcamp Open Lecture Series continues with Microsoft’s Principal Researcher Eyal Ofek!
Agenda:
Virtual Reality (VR) & Augmented reality (AR) pose challenges and opportunities from both a technical and social perspective. We could now have digital, and not physical objects change our understanding of the world around us. It is a unique opportunity to change reality as we sense it.
The Microsoft Researchers are looking for new possibilities to extend our abilities when we are not bound by our physical limitations, enabling superhuman abilities on one hand, and leveling the playfield for people with physical limitations.
Dr. Ofek will describe efforts to design VR & AR applications that will adjust according to the user’s uncontrolled environment, enabling a continuous use during work and leisure, over the large variance of environments. He will also review efforts to the extent the rendering to new capabilities such as haptic rendering.
His lecture will be followed by a Q&A session where you can ask all your questions about the topic.
Lead Instructors:
Eyal Ofek is a principal researcher at the Microsoft Research lab in Redmond, WA. His research interests include Augmented Reality (AR)/Virtual Reality (VR), Haptics, interactive projection mapping, and computer vision for human-computer interaction. He is also the Specialty Chief Editor of Frontiers in Virtual Reality, for the area of Haptics and an Assoc. Editor of IEEE Computer Graphics and Application (CG&A).
Prior to joining Microsoft Research, he obtained his Ph.D. at the Hebrew University of Jerusalem and has founded a couple of companies in computer graphics, including a successful drawing and photo editing application and developing the world’s first time-of-flight video cameras which was a basis for the HoloLens depth camera.
This event is part of the Global XR Bootcamp event:
The Global XR Bootcamp 2020 will be the biggest community-driven, FREE, online Virtual, Augmented and Mixed Reality event in the world! Join us on YouTube or AltspaceVR for a 24 hour live stream with over 50 high quality talks, panels and sessions. Meet your fellow XR enthousiasts in our Community Zone, and win amazing prizes – from vouchers to XR hardware.
++++++++++++++++++++
more on XR in this IMS blog
https://blog.stcloudstate.edu/ims?s=xr
https://stcloudstate.learn.minnstate.edu/d2l/home/4819732
Jan. 21, MC 205 (how to get to the PDR room:
Plan: learn to create, edit and use still 360 degrees images and videos.
#scalability
https://www.digitaltrends.com/photography/how-to-edit-360-photos-in-photoshop/
https://tonyredhead.com/adobe/360-photoshop-advanced-editing
Phot
Error messages working with Action Director
More on VR in this IMS blog:
https://blog.stcloudstate.edu/ims/2018/11/01/vendors-for-vr/
https://docs.google.com/document/d/1efFVsOIwxlTO2Qy-onKbG0dgr8qum3onq3bgFkaVfec/edit?usp=sharing
+++++++++++
more on haptic in this IMS blog
https://blog.stcloudstate.edu/ims?s=haptic
p. 74 serious games, Carrie Heeter. p. 49
p. 52 guided meditation VR GMVR
p. 57
p. 61 Hedgehog Love
engineering feelings with social presence. p.64 remember presents? This is the beginning of social presence. Mindfulness is cool, but making eye contact with Henry is the first step into the future.
When you premiered at the Cannes film Festival in early 2017, it was housed in an airplane hangar; viewers were a shirt, barefoot, into a room with a sand-covert floor, where they could watch and interact with other people trying to make it over the border. Arrests, detention centers, dehydration-the extremity of the human condition happening all around you. India announcement, the Academy of motion picture arts and sciences called the peas “deeply emotional and physically immersive”
p. 83 empathy versus intimacy. Why good stories need someone else
p. 84 Chris Milk
http://www.thewildernessdowntown.com/
p. 85 empathy vs intimacy: appreciation vs emotion
Both of these words are fuzzy, to say the least. Both have decades of study behind him, but both have also appeared and more magazine covers in just about any words, other than possibly “abs”
Empathy: dear Do it to do identify with and understand dollars, particularly on an emotional level. It involves imagining yourself in the place of another and, therefore, appreciating how do you feel.
Intimacy: a complex sphere of ‘inmost’ relationships with self and others that are not usually minor or incidental (though they may be a transitory) and which usually touch the personal world very deeply. They are our closest relationships with friends, family, children, lovers, but they are also the deep into important experiences we have with self
Empathy necessarily needs to involve other people; intimacy doesn’t. Empathy involves emotional understanding; intimacy involves emotion itself. Empathy, at its base, isn’t act of getting outside yourself: you’re protecting yourself into someone’s else experience, which means that in some ways you are leaving your own experience behind, other than as a reference point. Intimacy, on the other hand, is at its base act of feeling: you might be connecting quit someone or something Else, but you are doing so on the basis of the emotions you feel. p 86. Any type of VR experience perfectly illustrates the surprising gap between empathy and intimacy: life action VR. p. 87 unlike CGI-based storytelling, which full somewhere in between game in movie, live action VR feels much more like the conventional video forms that we are used to from television and movies. Like those media, people have been using VR to shoot everything from narrative fiction to documentary the sports.
Nonny de la Peña Hunger in Los Angeles at Sundance
p. 89 Clouds over Sidra Chris Milk
p. 90 SXSW south by southwest Austin Texas
p. 92 every single story has only one goal at its base: to make you care. This holds true whether it is a tale told around a campfire at night, one related to a sequence of panels in the comic book, or dialogue-heavy narrative of a television show. The story might be trying to make you laugh, or just scare you, or to make you feel sad or happy on behalf of one of the characters, but those are all just forms of caring, right? Your emotional investment-the fact that what kept us in this tale matters to you-is the fundamental aim of the storyteller.
Storytelling, than, has evolved to find ways to draw you out of yourself, to make you forget that what you are hearing or seeing or reading isn’t real. It’s only at that point, after all, that our natural capacity for empathy can kick in. p. 93 meanwhile, technology continues to evolve to detaches from those stories. For one, the frame itself continues to get smaller. Strangers still, this distraction has happened well stories continue to become more and more complex. Narratively, at least, stories are more intricate then the have ever been. p. 94. Now, with VR storytelling, the distracting power of multiple screens his met it’s match.
p. 101 experiencing our lives- together
What videos two cannot do, though, he’s bringing people together insights VR, the way re-McClure’s sinking-multicoloredat-blogs-at-each-other tag-team project is VVVR does. That’s why even V are filmmaking powerhouses like Within ( https://www.with.in/get-the-app) are moving beyond mere documentary and narrative and trying to turn storytelling into a shared experience.
Make no mistake: storytelling has always been a shirt experience. Being conscripted into the story, or even being the story.
https://www.linkedin.com/in/jess-engel-96421010/
https://medium.com/@Within/welcome-jess-aea620df0ca9
p. 103 like so many VR experiences, life of us defies many of the ways we describe a story to each other. For one, it feels at fonts shorter and longer than its actual seven-minutes runtime; although it’s seems to be over in a flash, flash contains so many details that in retrospect it is as full and vivid is a two-our movie.
There is another think, though, that sets life of us apart from so many other stories-it is the fact that not only was I in the story, but someone else was in there with me. In that someone wasn’t a field character talking to a camera that they some calling about it, or a video game creature that was programmed to look in ‘my’ direction, but a real person-a person who saw what I saw, a person who was present for each of those moments and who know is inextricably part of my old, shard-Like memory of them.
p. 107 what to do and what to do it with . How social VR is reinventing everything from game night to online harassment.
https://uploadvr.com/facebook-hires-altspace-ceo-eric-romo/
p. 110 VR isn’t given Romo’s first bet on the future. When he was finishing up his masters degree in mechanical engineering, a professor emailed him on behalf of two men who were recruiting for a rocket company there were starting. One of those man was a Elon musk, which is how Romo became the 13th employee at space X. Eventually, she started the company focusing go solar energy, but when the bottom fell out of the industry, she shut down the company and looked for his next opportunity. Romo spent the next year and a half researching the technology and thinking about what kind of company might make sense in the new VR enabled world. He had read Snow crash, but he oh soon you get our hopes for DVR future could very well end up like gay themed flying car: defined-and limited-bite an expectation that might not match perfectly which what we actually want.
https://www.amazon.com/Snow-Crash-Neal-Stephenson/dp/1491515058
p. 116 back in the day, trolling just trim forward to pursuing a provocative argument for kicks. Today, the word used to describe the actions of anonymous mobs like the one that, for instance, Rolf actor Leslie Jones off Twitter with an onslaught of racist and sexist abuse. Harassment has become one of the defining characteristics of the Internet is for use it today. But with the emergernce of VR, our social networks have become, quite literally, embodied.
p. 116 https://medium.com/athena-talks/my-first-virtual-reality-sexual-assault-2330410b62ee
p. 142 increasing memory function by moving from being a voyeur to physically participating in the virtual activity. embodied presence – bringing not just your head into your hands, but your body into VR-strengthens memories in the number of ways.
p. 143 at the beginning of 2017, Facebook fit published some of its. New Ron’s in internal research about the potential of social VR. Neurons INc. The agency measured eye movements, Brain activity, and pools of volunteers who were watching streaming video on smart phones and ultimately discovered that buffering and lag were significantly more stressful than waiting can line it a store, and even slightly more stressful than watching a horror movie.
p. 145 after the VR experience, more than 80% of introverts — is identified by a short survey participants took before hand-wanted to become friends with the person they had chatted with, as opposed to less than 60% of extroverts
p. 149 Rec Room Confidential: the anatomy in evolution of VR friendships
p. 165 reach out and touch someone; haptics, tactile presence and making VR physical.
VOID: Vision of Infinite Dimensions p. 167
p. 169 the 4-D-effects: steam, cool air, moisture,
p. 170 Copresence
https://www.researchgate.net/profile/Shanyang_Zhao
https://www.researchgate.net/publication/2532682_Toward_A_Taxonomy_of_Copresence
https://astro.temple.edu/~bzhao001/Taxonomy_Copresence.pdf
p. 171 Zhao laid out two different criteria. The first was whether or not to people are actually in the same place-basically, are they or their stand-ins physically close enough to be able to communicate without any other tools? To people, she wrote, can either have “physical proximity” or “electronic proximity” the latter being some sort of networked connection. The second criterion was whether each person is corporeally there; in other words, is it their actual flesh-and-blood body? The second condition can have three outcomes: both people can be there corporeally; neither can be there corporeally , instead using some sort of stand in like an avatar or a robot; or just one of them can be there corporeally, with the other using case stent in
“virtual copresence” is when a flesh and blood person interacts physically with a representative of a human; if that sounds confusing, 80 good example is using an ATM call mom where are the ATM is a stent in for a bank teller
p. 172 “hypervirtual copresence,” which involves nonhuman devices that are interacting in the same physical space in a humanlike fashion. social VR does not quite fit into any of this category. Zhao refers to this sort of hybrid as a “synthetic environment” and claims that it is a combination of corporeal https://www.waze.com/telecopresence (like Skyping) and virtual telecopresence(like Waze directions )
p. 172 haptic tactics for tactile aptness
Of the five human senses, a VR headset ca currently stimulates only to: vision and hearing. That leaves treat others-and while smell and taste me come some day.
P. 174; https://en.wikipedia.org/wiki/Aldous_Huxley Brave New World. tactile “feelies”
p. 175 https://en.wikipedia.org/wiki/A._Michael_Noll, 1971
p. 177 https://www.pcmag.com/review/349966/oculus-touch
p. 178 haptic feedback accessories, gloves. full body suites, p. 179 ultrasonics, low-frequency sound waves.
p. 186 the dating game: how touch changes intimacy.
p. 187 MIT Presence https://www.mitpressjournals.org/loi/pres
p. 186-190 questionnaire for the VRrelax project
p. 195 XXX-chnage program: turning porn back into people
p. 221 where we are going, we don’t need headsets. lets get speculative
p. 225 Magic Leap. p. 227 Magic Leap calls its technology “mixed reality,” claiming that the three dimensional virtual objects it brings into your world are far more advanced than the flat, static overlays of augmented reality. In reality, there is no longer any distinction between the two; in fact, the air are by now so many terms being accused in various ways by various companies that it’s probably worth a quick clarification.
definitions
Virtual reality: the illusion of an all-enveloping artificial world, created by wearing an opaque display in front of your eyes.
augmented reality: Bringing artificial objects into the real world-these can be as simple as a ” heads-up display,” like a speedometer project it onto your car’s windshield, or as complex as seen to be virtual creature woke across your real world leaving room, casting a realistic shadow on the floor
mixed reality: generally speaking, this is synonymous with AR, or eight at least with the part of AR that brings virtual objects into the real world. However, some people prefer “mixed” because they think “augmented” implies that reality isn’t enough.
extended or synthetic reality (XR or SR): all of the above! this are bought catch old terms that encompass the full spectrum of virtual elements individual settings.
p. 228 https://avegant.com/.
Edward Tang:
p. 231 in ten years, we won’t even have smartphone anymore.
p. 229 Eve VR is these come blink toddler, though, AR/MR is a third-trimester fetus: eat may be fully formed book eat is not quite ready to be out in the world yet. The headsets or large, the equipment is far more expensive than VR Anthony in many cases we don’t even know what a consumer product looks like.
p. 235 when 2020 is hindsight: what life in 2028 might actually look like.
++++++++++++
presence (VR different from other media), virtual pit, haptic devices and environment
4 min: what’s the point?…
VR is a paradox, no rules,
what should you do and what to avoid
Ketaki Shriram dissertation
addiction
Gerd Bruder observed the other German person confused between VR and real world.
Common Sense Media – when children can VR and for how long
Jackie Baily worked with children VR Sesame street Grover
impossible, counterproductive, rare/expensive, dangerous are the 4 reasons to use it. Not ubiquitous!
12 min. empathy
Tobin Asher “Becoming Homeless” blame the situation or the character (min 17)
counterproductive:
June Lubchenko, 2013. NOAA. min 19. natural disasters, not trusting self-report, but actions.
Fio Micheli. counter productive to fly children to the coral in Italy, but VR makes it possible. learning efficacy. Motivation to learn. min 21.
min 26. MOOC – materials are for free. not replacing field trips, just making them more often.
min 27. spherical video to practice football with VR
min 29. Walmart – “academies” Mark Gill the nursing home simulation.
dangerous:
learning to drive.
freedom speech over all media but VR is specific, different. If you won’t do it in the real world, don’t do it in VR
questions
min 33. what is the iPhone for VR.
Fred Brooks
min 37. disentization. how many times to do something to have effect. Kathy Mayhew and Mark Gill research
min 38. AR and psychology – not much resources. virtual person breaks physics – walks through chairs. Greg Weltch Central Florida – AR breaks physics study.
min 42. if his lab gives grants for art content creation. Immersive Journalism, storytelling syllabus. Mark Gill for our class, Bill Gorcica . Robert Wood Johnson Foundation, Gordon and Betty Moore Foundation, Mayday Foundation
+++++++++
more on VR in this IMS blog
https://blog.stcloudstate.edu/ims?s=virtual+reality