Video | Mona Lisa raps...but how?

Written By ندى ماهر عبدربه on 2024/04/25

This article was written originally in Arabic and is translated using a 3rd party automated service. ArabiaWeather is not responsible for any grammatical errors whatsoever.

<p style=";text-align:left;direction:ltr">ArabiaWeather - A team of scientists at Microsoft Research Asia has developed a new artificial intelligence model called VASA-1, which turns images of people&#39;s faces and audio clips into synchronized videos with lip movements, facial expressions, and head movements in an accurate and realistic manner.</p><p style=";text-align:left;direction:ltr"> In a research paper, the team stated that they presented the VASA framework, which enables the creation of lifelike talking faces with attractive visual emotional skills from a single image and speech audio clip. The first model, VASA-1, is distinguished by its ability to generate exquisite lip movements in sync with sound, In addition to capturing a wide range of nuances in facial expressions and natural head movements that contribute to the authenticity and liveliness of the video.</p><p style=";text-align:left;direction:ltr"> The team claims that their method not only delivers high video quality with realistic face and head dynamics, but also supports online creation of 512 x 512 videos at up to 40 frames per second with almost negligible latency.</p><p style=";text-align:left;direction:ltr"></p><p style=";text-align:left;direction:ltr"> <a href="https://www.arabiaweather.com/ar/content/%D8%A8%D8%A7%D9%84%D9%81%D9%8A%... | A Saudi airline employee becomes a trend... What&#39;s the story?</a></p><p style=";text-align:left;direction:ltr"></p><blockquote class="twitter-tweet" data-media-max-width="560" style=";text-align:left;direction:ltr"><p lang="es" style=";text-align:left;direction:ltr"> Microsoft acaba de lanzar VASA-1.<br /><br /> This also causes the image to be alone and able to share with us the original audio format. Similar to EMO de Alibaba<br /><br /> 10 different salvajes<br /><br /> 1. Mona Lisa rapeando a Paparazzi <a href="https://t.co/74mZH9fTQO">pic.twitter.com/74mZH9fTQO</a></p> - Adam (@Adamaestr0_) <a href="https://twitter.com/Adamaestr0_/status/1781395640565530633?ref_src=twsrc... 19, 2024</a> </blockquote><script async src="https://platform.twitter.com/widgets.js" charset="utf-8"></script><p style=";text-align:left;direction:ltr"></p><h2 style=";text-align:left;direction:ltr"></h2><h2 style=";text-align:left;direction:ltr"> Singing the Mona Lisa and fears of impersonation</h2><p style=";text-align:left;direction:ltr"> VASA, or Visual Affective Skills Animator, is a name that stands for “Visual Affective Skills Animator,” and is capable of creating realistic videos that accurately and realistically mimic human conversational behaviors.</p><p style=";text-align:left;direction:ltr"> The VASA model can create videos that look completely real, with “realistic talking faces” mirroring conversational behaviors through natural facial gestures, eye and head movements, all starting from a single static head image.</p><p style=";text-align:left;direction:ltr"> The team used the VoxCeleb2 dataset, which includes videos of thousands of real-life celebrities, to train their model.</p><p style=";text-align:left;direction:ltr"> Their model was distinguished by its ability to deal with diverse inputs outside the training domain, such as artistic images and non-English speech.</p><p style=";text-align:left;direction:ltr"> While the model&#39;s capabilities raise impersonation concerns, the scientists stress that their goal with the tool is to develop virtual characters&#39; visual emotional skills, not to impersonate anyone in the real world.</p><p style=";text-align:left;direction:ltr"> Microsoft confirms that there are currently no plans to release the code supporting the model, and aims to use the technology responsibly and in accordance with appropriate regulations in the future.</p><p style=";text-align:left;direction:ltr"></p><p style=";text-align:left;direction:ltr"></p><p style=";text-align:left;direction:ltr"> Read also:</p><p style=";text-align:left;direction:ltr"> <a href="https://www.arabiaweather.com/ar/content/%D8%A7%D9%84%D8%B5%D9%8A%D9%86-... is drowning in dust... How so?</a></p><p style=";text-align:left;direction:ltr"> <a href="https://www.arabiaweather.com/ar/content/%D9%81%D9%8A-%D8%A7%D9%84%D9%8A... World Earth Day, frequently asked questions about...</a></p><p style=";text-align:left;direction:ltr"></p><hr /><p style=";text-align:left;direction:ltr"> Sources:</p><p style=";text-align:left;direction:ltr"> <a href="https://interestingengineering.com/">Interesting Engineering</a></p>

This article was written originally in Arabic and is translated using a 3rd party automated service. ArabiaWeather is not responsible for any grammatical errors whatsoever.


Browse on the official website



Your Air Fryer Might Be Spying On You... What&#39;s The Story?How to Measure Weather Temperature on Samsung Smart WatchIn light of the expected hot weather, learn about the highest temperature recorded by the Kingdom in April over the past years.From Tuesday to Thursday, the Kingdom will be affected by a relatively hot air mass and Khamasin weather conditions, with temperatures exceeding 40 degrees Celsius in the Jordan Valley and Aqaba (details and recommendations)Unstable weather conditions will gradually affect the Kingdom in the coming hours, with rain accompanied by thunder in some areas.Weather fluctuations will continue on Monday, and these are the areas expected to experience rain. A slight drop in temperatures on Monday and a rise at night. How is that?Update 4:00 PM | According to thunderstorms affecting 7 regions now, this is what we expect in the coming hours.The UAE mission in Italy calls on citizens to exercise caution due to bad weather conditions.