I Met Magic Leap’s AI Assistant Mica & Saw the Future of Augmented Reality

In AR, everything is about how “you” see things interacting with your real environment. Such is the case with what I’m calling the most important demonstration of Magic Leap technology to date in the form of an AI assistant called Mica.

Together, the team described a world in which a Magic Leap user will be able to interact with intelligent assistants in the form of fully realized augmented reality humans that can recognize your position in a room, as well as items in that room. Having mapped the area and your position within it, the AI assistant will then interact with you to help you do any number of things.

For example, as detailed in the presentation, the AI assistant might scan the Magic Leap One wearer’s eyes to detect his mood and then suggest an appropriate song to play through the home’s music system. Similarly, the AI assistant my access the Magic Leap One user’s preferences to adjust things such a the level of light in a room at a certain time of day.

Image via Magic Leap

We’re already becoming accustomed to such interactions on the audio plane via digital assistants like Amazon’s AlexaGoogle Home, and, to a lesser extent, Apple’s Siri. But what Magic Leap is describing is putting an even more robust and responsive version of such a digital assistant in the form of a human that inhabits the same space as you, thus taking the assistant metaphor to its highest level. It sounds and looks a bit like science fiction, but it’s not.

What Magic Leap is describing is so close to reality, the company now feels comfortable enough to offer demonstrations of a rudimentary version of the dynamic at work with the Magic Leap One in conjunction with its intelligent assistant Mica.

Image via Magic Leap

The result is a stunning experience that takes AR into brand new and exciting territory.

I met Mica for the first time earlier this week. And if you get a chance to meet her, she will fundamentally change how your view the Magic Leap One and augmented reality in general.

When Magic Leap’s team brought me into an empty room hidden deep in the bowels of an LA event center, I didn’t know what to expect. The space was designed to look like a normal room, complete with a table, two chairs, and other furniture situated around the table. Nothing looked particularly futuristic or tech-enabled, so I wasn’t expecting much. Wow, was I wrong.

Image via Magic Leap

Upon donning the Magic Leap One, I’m greeted by a virtual woman (Mica) sitting at the very real wooden table. Then, Mica, with an inviting smile, gestures for me to join her and sit in the chair opposite her. I oblige, and then a very weird interaction begins — she starts smiling at me, seemingly looking for a reaction.

I’ll admit, I deliberately avoided smiling (though it was really hard, Mica seems so nice) and kept a poker face in an attempt to see if I could somehow throw the experience off by not doing the expected, that is, returning the smile.

Undaunted, Mica continued to look into my eyes and go through a series of “emotions” that, surprisingly, made me feel a bit guilty about being so stoic.

It’s at this point that I should mention that she doesn’t speak yet, so all of our interactions were conducted in silence, and instead of using words, she communicated using gestures, eye moments, and various body language. At first, I thought this might be a limitation, but retrospect, I think this served to make the experience even more impactful.

Image via Magic Leap

That would have been enough to mildly impress me, but what came next was the kicker. She then pointed to a real wooden picture frame on the table, gesturing for me to hang it on a pin on the wall next to us. I did as asked, and… it was the eurekamoment. This was a virtual human sitting at a real world table and she just got me to change something in the real world based on her direction.

But then it got better. Once I’d hung the empty frame, Mica got up (she’s about five feet six inches tall) and began writing a message inside the frame, which in context looked about as real as if an actual person had begun writing on the space.

Alas, I don’t remember what the message was (honestly, I was too blown away by what was happening), but I’m assuming it was somewhat profound, as Mica then looked to me in a way that seemed to ask that I consider the meaning of the message. After a few beats, the life-sized, augmented reality human walked out of the room. But she didn’t just disappear into a wall in a flurry of sparkly AR dust. Instead, she walked behind a real wall in the room leading to a hallway. It was a subtle but powerful touch that increased the realism of the entire interaction.

As I said earlier, it’s incredibly difficult to describe just how profound this experience was, but if and when it’s made available to the public, you’ll be doing yourself a grave disservice if you pass the opportunity up. `

Image via Magic Leap

I’ve been trying to think of tool or app that would compel me to wear the Magic Leap One for an entire day. And while I’ve had the device for months now, I haven’t been able to think of anything that would get me to wear it beyond one hour spurts of activity. That’s all changed now. Although battery life and the experience itself aren’t quite ready for such rigorous and extended use, I could easily see coming home and slipping on the Magic Leap One for the rest of the night if it meant having access to such a fully realized AI assistant such as Mica.

After meeting Mica, I have no doubt that this is what the virtual assistant future will look like for most people in the very near future. It’s not assured that it will be Magic Leap that delivers it, but whichever company does, I think it’s safe to say that Magic Leap was first to show us that future in this particular way, and it’s incredible.

 

 

 

 

fonte: https://magic-leap.reality.news/news/met-magic-leaps-ai-assistant-mica-saw-future-augmented-reality-0188478/

NASA is using HoloLens AR headsets to build its new spacecraft faster

“Just about every time, we are building something for the first time,” says Brian O’Connor, the vice president of production operations at Lockheed Martin Space.

Traditionally, aerospace organizations have replied upon thousand-page paper manuals to relay instructions to their workers. In recent years, firms like Boeing and Airbus have started experimenting with augmented reality, but it’s rarely progressed beyond the testing phase. At Lockheed, at least, that’s changing. The firm’s employees are now using AR to do their jobs every single day.

This piece first appeared in our twice-weekly newsletter, Clocking In, which covers how technology is transforming the future of work. Sign up here—it’s free! 

Spacecraft technician Decker Jory uses a Microsoft HoloLens headset on a daily basis for his work on Orion, the spacecraft intended to one day sit atop the powerful—and repeatedly delayed—NASA Space Launch System. “At the start of the day, I put on the device to get accustomed to what we will be doing in the morning,” says Jory. He takes the headset off when he is ready to start drilling. For now, the longest he can wear it without it getting uncomfortable or too heavy is about three hours. So he and his team of assemblers use it to learn a task or check the directions in 15-minute increments rather than for a constant feed of instructions.

Photo augmented reality view of technician working on machinery

LOCKHEED MARTIN

In the headset, the workers can see holograms displaying models that are created through engineering design software from Scope AR. Models of parts and labels are overlaid on already assembled pieces of spacecraft. Information like torquing instructions—how to twist things—can be displayed right on top of the holes to which they are relevant, and workers can see what the finished product will look like.

The virtual models around the workers are even color-coded to the role of the person using the headset. For Jory’s team, which is currently constructing the heat shield skeleton of Orion, the new technology takes the place of a 1,500-page binder full of written work instructions.

Lockheed is expanding its use of augmented reality after seeing some dramatic effects during testing. Technicians needed far less time to get familiar with and prepare for a new task or to understand and perform processes like drilling holes and twisting fasteners.

Photo augmented reality view of technician working on machinery

LOCKHEED MARTIN

These results are prompting the organization to expand its ambitions for the headsets: one day it hopes to use them in space. Lockheed Martin’s head of emerging technologies, Shelley Peterson, says the way workers use the headsets back here on Earth gives insight into how augmented reality could help astronauts maintain the spacecraft the firm helped build. “What we want astronauts to be able to do is have maintenance capability that’s much more intuitive than going through text or drawing content,” says Peterson.

For now, these headsets still need some adjustments to increase their wearability and ease of use before they can be used in space. Creating the content the workers see is getting easier, but it still takes a lot of effort. O’Connor sees these as obstacles that can be overcome quickly, though.

“If you were to look five years down the road, I don’t think you will find an efficient manufacturing operation that doesn’t have this type of augmented reality to assist the operators,” he says.

 

 

 

fonte: https://www.technologyreview.com/s/612247/nasa-is-using-hololens-ar-headsets-to-build-its-new-spacecraft-faster/

Divulgazione e realtà virtuale per la rianimazione cardiopolmonare

Oggi solo nel 15% dei casi viene eseguita la rianimazione prima dell’arrivo dei soccorsi. Se la percentuale aumentasse al 50/60% si potrebbero salvare 100.000 ogni anno.

 

È per questo che, per la prima volta, da quest’anno il 16 ottobre si celebrerà il “World Restart A Heart Day” cioè il giorno mondiale di sensibilizzazione sul tema dell’arresto cardiaco che vedrà iniziative in tutto il mondo con il patrocinio dell’Organizzazione Mondiale della Salute.

In questa occasione, i ricercatori e i volontari di IRC, Italian Resuscitation Council, saranno all’interno del Parco Archeologico del Colosseo a Roma, dalle 10 alle 17 per informare sulle manovre salvavita con dimostrazioni pratiche e con la novità della realtà virtuale: sarà possibile simulare in 3D e in modo realistico una corretta procedura di rianimazione.

I ricercatori e i volontari di IRC saranno accompagnati dai volontari della Fondazione “Giorgio Castelli”, che ha formato alla rianimazione cardiopolmonare gli addetti del Parco Archeologico del Colosseo a Roma e donato 11 defibrillatori all’intera area. È prevista anche la partecipazione di volontari dell’ANPAS, della Croce Rossa Italiana, di Conacuore e di altre associazioni.

Quello del 16 ottobre, però, è solo uno degli eventi della campagna  “VIVA! la settimana per la rianimazione cardiopolmonare”. Durante la settimana che quest’anno è dal 15 al 21 ottobre, saranno organizzati incontri e dimostrazioni pratiche in tutta Italia.

«Vogliamo anche quest’anno attrarre l’attenzione per spiegare come alcune semplici azioni, eseguibili da chiunque, possono salvare la vita di chi è colpito da arresto cardiaco. Per questo la nostra associazione è molto impegnata nella formazione e nella divulgazione: solo nell’ultimo anno abbiamo realizzato oltre 10.000 corsi di formazione rivolti a quasi 130.000 partecipanti tra operatori sanitari e persone comuni con particolare attenzione al mondo della scuola», dice Andrea Scapigliati, presidente di Italian Resuscitation Council e dirigente medico dell’Unità operativa di cardioanestesia e terapia intensiva cardiochirurgica della Fondazione Policlinico Universitario A. Gemelli.

«VIVA! rappresenta un’ottima occasione di sensibilizzazione per la popolazione nei confronti della cultura del primo soccorso e delle buone pratiche di rianimazione, cultura di vita e di attenzione ai bisogni primari del prossimo», aggiunge Vincenzo Castelli, presidente della Fondazione Giorgio Castelli onlus e dirigente medico della Unità di Medicina interna dell’Ospedale Vannini di Roma.

Per favorire la diffusione delle manovre salvavita, cioè il massaggio cardiaco, le ventilazioni di soccorso e la defibrillazione precoce, IRC ha creato un nuovo strumento che utilizza la realtà virtuale indirizzato non solo agli operatori sanitari ma anche alla gente comune e agli alunni delle scuole. Indossando il caschetto della realtà virtuale è possibile infatti simulare un primo soccorso su una vittima di arresto cardiaco.

Per favorire l’insegnamento nella scuola, IRC, ha inoltre ormai consolidato l’applicazione per cellulari “Un picnic mozzafiato” dedicato ai bambini della scuola primaria.

L’elenco delle iniziative della settimana VIVA! è disponibile sul sito dedicato all’iniziativa.

 

 

 

fonte: http://www.healthdesk.it/cronache/divulgazione-realt-virtuale-diffondere-rianimazione-cardiopolmonare