Mano de niño manipulando mariposas en Professor Garfield

Immersive learning empowers education

In recent years we have seen how technology and creativity have become protagonists for the creation of new educational settings.

The benefits of the devices and the new technologies create the ideal conditions to evoke all the senses of the users and immerse them in an immersive learning experience.

But there is still a lot of potential that needs to be explored to perfect the user experience and take it to another level, and since Intel they have directed their efforts towards that goal with their technology. Intel RealSense.

Different companies that are committed to cutting-edge technology have coordinated their efforts with the Intel team to implement Intel RealSense technology in their educational and educational entertainment products.

We share their experiences that allow us to glimpse a range of possibilities that will enrich the educational experience.

A new experience in interactive stories and games

PlayTales knows how to interpret the needs of children by combining entertainment and education in its particular interactive stories. It has become a world leader in the interactive ebook market and the favorite choice for parents and children. It has also been one of the first companies to learn about the potential of Intel RealSense technology and how its functions can enrich the experience they provide to children with natural and intuitive interaction.

In a joint effort with the Intel team, they have implemented this technology in two of their products, an interactive story The Wizard of Oz and a Professor Garfield educational app. For example, at Professor Garfield they have used one of the hand modes that Intel RealSense works with, the outline mode. In this way, the contour of the child's hand is detected to represent it on the virtual stage. This will allow, as we see in the image, that the child can interact with the butterflies with their movements:

Child's hand manipulating butterflies in Professor Garfield

This PlayTales opportunity to meet and test Intel technology in its early stages has also served to anticipate the needs of its users, testing their level of knowledge and adaptability to this new interactive experience.

Regarding the potential of Intel RealSense, Enrique Tapias, CEO of PlayTale comments:

Intel RealSense technology is undoubtedly one of the most important to come next year, and not only on computers and laptops, but also on the devices that children are using, such as tablets and smartphones.

Another example of how Intel technology allows users to naturally interact with the scenarios presented to them through devices is I Spy Pirate Ship, interactive Scholastic game.

I Spy Pirate Ship screenshot

It offers a unique interactive experience by combining different benefits of Intel RealSense technology, as detailed by Jennifer Contrucci, director of digital production at Scholastic Media:

The application includes many of the functionality of the Intel RealSense SDK; uses gestures, open and closed hand detection, and face point tracking. In this game, you can see the entire range of perceptual abilities.

One detail that stands out in this case is that they managed to understand the behavior of children in the face of apps that demand so much interaction, and anticipate any difficulty that may harm their experience.

For example, it has been taken into account that children are restless and spontaneous, so detection of facial landmarks, such as the nose, is used to maintain precision when the game needs to capture head movements.

And when, in the game, one of the activities requires children to search for objects in the stars with a telescope, the program recognizes when the objective is achieved by capturing that their face has stopped at a specific place. A natural interaction.

On the potential of this feature, Jennifer Contrucci adds:

It will have many other applications. For example, if a little girl is looking at an eBook and pauses on the image of a lion, it is an opportunity for the software to react and communicate the name of the animal and its description. It will provide children with instant help.

Interactive learning in the field of health

Intel RealSense also has the features necessary to recreate complex activities that require maximum precision. Proof of this is the confidence that 3D4Medical has placed in this technology.

3D4Medical is a technology company that specializes in the development of health and fitness applications that has contributed to educational innovation with its interactive applications, such as Essential Anatomy.

Due to the precision required by apps related to the medical world, the 3D4Medical development team is testing the potential of this technology, implementing its SDK together with Unity. Creating limb and joint models is hard work that requires a thorough and detailed process.

In the image we can see the 22 points of the hand that the Intel RealSense 3D camera tracks, captures and digitizes:

Hand points detected by 3D Intel RealSense

This results in a stream of data that must be processed to come alive in virtual space, as detailed by Sergey Bushtyrkov, 3D4Medical Software Development Manager:

We push technology to the limit when we create very qualitative models of human hands, we adapt them to the information we get from the Intel RealSense 3D camera and we make them move, we coordinate them

The 3D4Medical development team will continue to invest in Intel RealSense in the coming years to explore the possibilities it offers and enhance its products with new technological trends.

Not only have these companies tested Intel technology, Intel has also invited developers to take advantage of the capabilities of Intel RealSense technology through the SDK and application kit. We can learn more about Intel RealSense on its page.

Much more to come

Immersive learning allows users to connect uniquely with content, as it allows them to interact with it, immersing them in an educational setting that connects them with previous experiences and allows them to assimilate concepts naturally.

In the words of Ornit Gross, Intel's Gaming and Education Product Manager:

When you bring educational material to life, be immersive and entertaining, it becomes easier to remember. It helps to learn

And this is just the beginning. Endless possibilities are opened with the integration of new technologies that will allow us to personalize the experience to meet the expectations of users and enrich interactive learning.

You can get more information in this article from the Intel Developer Zone.