{"id":2949,"date":"2024-12-27T14:24:17","date_gmt":"2024-12-27T14:24:17","guid":{"rendered":"https:\/\/horizon.peachpuff-wolverine-566518.hostingersite.com\/?p=2949"},"modified":"2024-12-27T14:24:17","modified_gmt":"2024-12-27T14:24:17","slug":"get-your-dancing-shoes-on-ai-and-virtual-reality-team-up-to-bring-the-party-to-you","status":"publish","type":"post","link":"https:\/\/scienceblog.com\/horizon\/2949\/get-your-dancing-shoes-on-ai-and-virtual-reality-team-up-to-bring-the-party-to-you\/","title":{"rendered":"Get your dancing shoes on! AI and virtual reality team up to bring the party to you"},"content":{"rendered":"

Staying home to dance the night away may soon be the next big thing. EU-funded researchers are using AI to create an online dancefloor for the whole world to share.<\/p>\n

By<\/em> Tom Cassauwers<\/p>\n

The festive season can be a lonely time for many, and too much time spent online can add to the feeling of isolation.<\/p>\n

\u201cWe have this fantastic tool with the internet, which is really changing the way the people interact,\u201d said Pieter van der Linden, co-founder of French digital solutions company Vivitnet. But the way we use the internet can inhibit real human connection.<\/p>\n

\u201cToday\u2019s interaction online is passive. It is about the brain. It\u2019s only about thinking and much less about feeling and emotions,\u201d he said. \u201cFor many people, the internet acts to isolate them instead of bringing them closer together.\u201d<\/p>\n

This is something that van der Linden and a team of researchers from Germany, Finland, the UK and France have set out to change. Their aim is to overcome the limitations of online interaction by extending it to include movement. And they have chosen dancing as their main use case.<\/p>\n

Dancing the blues away<\/strong><\/p>\n

Van der Linden is part of an EU-backed research project called CAROUSEL that has brought together AI and immersive interactive technologies to enable people to connect and dance with a partner \u2013 real or virtual \u2013 online.<\/p>\n

While loneliness has been shown to be detrimental to both physical and mental health, the opposite is true of dancing. Dancing offers a wide range of health benefits that span physical, mental and emotional well-being.<\/p>\n

\u201cDance is a profoundly human activity,\u201d said van der Linden. \u201cDance is used for celebrating, for rituals, and also for having fun.\u201d<\/p>\n

For the researchers, the most interesting aspect of their work is the deep connection created by dancing, where you have to concentrate on the other person and follow their movements.<\/p>\n

\u201cDancing is something very natural. It\u2019s not something you have to learn, even babies and toddlers dance spontaneously,\u201d said van der Linden.<\/p>\n

One of the driving motivations of the research team was to find a way to help combat loneliness in society, particularly in the wake of the COVID-19 pandemic.<\/p>\n

In an\u00a0EU-wide survey<\/a> in 2022, 13% of respondents reported feeling lonely most or all of the time over the four weeks before the survey, while 35% reported being lonely at least some of the time. Following the pandemic, loneliness is increasingly recognised as an issue of public importance, along with mental health problems.<\/p>\n

Keeping in sync\u00a0<\/strong><\/p>\n

The research is being led by the German Research Center for Artificial Intelligence in Kaiserslautern, Germany, which has partnered up with Grassroots Arts and Research UG, an SME based in Cologne, Germany, as well as with Aalto University in Finland, Edinburgh Napier University in the UK and Vivitnet.<\/p>\n

The research team has come up with a combination of technologies that allows users to sense each other\u2019s presence and movement, even if they are not physically in the same space.<\/p>\n

Cameras first capture the dancers\u2019 movements, while AI then transforms their bodies into avatars that accurately reproduce their movements on screen. One of the technical challenges was getting rid of any time lag in the communication which would make it difficult for dancers to stay in sync.<\/p>\n

An effort was made to use equipment that was as standard as possible \u2013 virtual reality headsets, movement trackers and 3D cameras. In the future, the researchers envision being able to use mobile phones and standard headsets.<\/p>\n

\u201cOur dream is to make this accessible to the mass market, so we have to bring down the price of the equipment to something in the area of a mobile phone,\u201d said van der Linden.<\/p>\n

Disconnecting to connect<\/strong><\/p>\n

German professional dancer Alexandra Schmuklermann is a research assistant on the CAROUSEL project. Her experience as a dancer was invaluable to the team effort, and she is enthusiastic about the results.<\/p>\n

\u201cI think it\u2019s a great addition for the dance world for many reasons,\u201d she said.\u00a0\u201cThe fact that two people from different places in the world can dance together in the same digital environment is amazing, even for professional dancers.\u201d<\/p>\n

If you want to collaborate with a choreographer who lives in the USA, for example, it can be very expensive, she says. \u201cBut you could meet in this online space and dance together, even choreograph together.\u201d<\/p>\n

For Schmuklermann, the ability to completely disconnect and tune into another world is also important.<\/p>\n

\u201cYou are transported immediately into this different world and it helps on a psychological level,\u201d she said. \u201cEven in a very crowded place, I could personally use this game to shut the whole world out.\u201d<\/p>\n

Not too easy, not too hard<\/strong><\/p>\n

To make the system accessible to everyone, whatever their age or fitness level, the team recognised that it was important to select moves and dances that are both creative and easy to copy.<\/p>\n

\u201cIt is a challenge,\u201d said Schmuklermann. \u201cThe dance moves need to be creative, but they also cannot be too crazy. You cannot have people being afraid to dance with the system.\u201d<\/p>\n

To avoid accidents, a virtual boundary is set out before the game starts. The user is alerted as soon as the boundary is crossed and the game instantly switches mode so that instead of being in the virtual space, the user is standing in their room again and can see any obstacles.<\/p>\n

Users can also choose the environment they want to dance in. Van der Linden acknowledges that although\u00a0some people love going into the virtual reality worlds created by the game, this is not the case for everyone.<\/p>\n

For this reason, the team also created an augmented reality mode for one application. Instead of being immersed in an imaginary environment, users can invite others into their own room.<\/p>\n

\u201cFor a number of people, this can be reassuring,\u201d he said.<\/p>\n

Avatar on the dancefloor<\/strong><\/p>\n

As well as real virtual dance partners, the CAROUSEL researchers have designed dancing avatars powered by AI systems.<\/p>\n

\u201cThey are a kind of digital icebreaker,\u201d said van der Linden. \u201cIt makes dancing with others feel less awkward.\u201d<\/p>\n

AI dancers were trained using several different approaches and algorithms. Getting into the spirit of things, the research team even recorded themselves dancing a salsa-type dance, as well as a group of semi-professional lindy hop dancers.<\/p>\n

These sessions were recorded in the experimental motion capture studio at the Max Planck Institute for Intelligent Systems in Tubingen, Germany. Adam, the AI avatar disco dancer, was trained by two professional dancers in Finland wearing motion suits.<\/p>\n

Healthy mind, healthy body<\/strong><\/p>\n

While much work remains to be done to turn this into a mass-market product, researchers are already contemplating the next steps.\u00a0The vision is to have a mass-market application that can be used by anybody, but is also geared towards medical needs.<\/p>\n

The aim is to combat isolation and loneliness \u2013 and also promote a healthy lifestyle. CAROUSEL will encourage people to move rather than just sit at their desks, for example.<\/p>\n

\u201cMoving has a lot of benefits, a lot of studies show how useful it is,\u201d said van der Linden. Dancing is also a great mood lifter, helping people feel happy and connected. \u201cThat is basically what the project is about,\u201d said\u00a0van der Linden.<\/p>\n

Research in this article was funded by the EU\u2019s Horizon Programme. The views of the interviewees don\u2019t necessarily reflect those of the European Commission. <\/em><\/p>\n

More info<\/p>\n