
AI 驱动的 EDGE 舞蹈动画师将生成式 AI 应用于编舞
AI-powered EDGE Dance Animator Applies Generative AI to Choreography
AI 驱动的 EDGE 舞蹈动画师将生成式 AI 应用于编舞
AI analyzes the music’s rhythmic and emotional content and creates realistic dances that are also physically plausible — a real dancer could perform them.
人工智能分析音乐的节奏和情感内容,并创造出逼真的舞蹈,这些舞蹈在物理上也是合理的——真正的舞者可以表演它们。
The EDGE generative AI model can help choreographers design new moves and sequences.
EDGE生成AI模型可以帮助编舞者设计新的动作和序列。
tanford University researchers have developed a generative AI model that can choreograph human dance animation to match any piece of music. It’s called Editable Dance GEneration (EDGE).
斯坦福大学的研究人员开发了一种生成式人工智能模型,可以编排人类舞蹈动画以匹配任何音乐。它被称为可编辑舞蹈GEneration(EDGE)。
“EDGE shows that AI-enabled characters can bring a level of musicality and artistry to dance animation that was not possible before,” says Karen Liu, a professor of computer science who led a team that included two student collaborators, Jonathan Tseng and Rodrigo Castellon, in her lab.
“EDGE表明,支持人工智能的角色可以为舞蹈动画带来以前不可能的音乐性和艺术性,”计算机科学教授Karen Liu说,她领导的团队包括两名学生合作者Jonathan Tseng和Rodrigo Castellon。
The researchers believe that the tool will help choreographers design sequences and communicate their ideas to live dancers by visualizing 3D dance sequences. Key to the program’s advanced capabilities is editability. Liu imagines that EDGE could be used to create computer-animated dance sequences by allowing animators to intuitively edit any parts of dance motion.
研究人员认为,该工具将帮助编舞者设计序列,并通过可视化3D舞蹈序列将他们的想法传达给现场舞者。该程序高级功能的关键是可编辑性。Liu认为EDGE可以通过允许动画师直观地编辑舞蹈动作的任何部分来创建计算机动画舞蹈序列。
For example, the animator can design specific leg movements of the character, and EDGE will “auto-complete” the entire body from that positioning in a way that is realistic, seamless, and physically plausible as well — a human could complete the moves. Above all, the moves are consistent with the animator’s choice of music.
例如,动画师可以设计角色的特定腿部动作,EDGE将以逼真,无缝且物理上合理的方式从该位置“自动完成”整个身体 - 人类可以完成动作。最重要的是,这些动作与动画师对音乐的选择是一致的。
Like other generative models for images and text — ChatGPT and DALL-E, for instance — EDGE represents a new tool for choreographic idea generation and movement planning. The editability means that dance artists and choreographers can iteratively refine their sequences move by move, position by position, adding specific poses at precise moments. EDGE then incorporates the additional details into the sequence automatically. In the near future, EDGE will allow users to input their own music and even demonstrate the moves themselves in front of a camera.
与其他图像和文本的生成模型(例如ChatGPT和DALL-E)一样,EDGE代表了用于编舞创意生成和运动规划的新工具。可编辑性意味着舞蹈艺术家和编舞者可以逐个动作、逐个位置地迭代地优化他们的序列,在精确的时刻添加特定的姿势。然后,EDGE会自动将其他详细信息合并到序列中。在不久的将来,EDGE将允许用户输入自己的音乐,甚至可以在相机前演示动作。
“We think it’s a really a fun and engaging way for everyone, not just dancers, to express themselves through movement and tap into their own creativity,” Liu says.
“我们认为这是一种真正有趣且引人入胜的方式,每个人,而不仅仅是舞者,都可以通过动作表达自己并发挥自己的创造力,”刘说。
“With its ability to generate captivating dances in response to any music, we think EDGE represents a major milestone in the intersection of technology and movement,” adds Tseng. “It will unlock new possibilities for creative expression and physical engagement,” says Castellon.
“凭借其响应任何音乐产生迷人舞蹈的能力,我们认为EDGE代表了技术和运动交叉的一个重要里程碑,”Tseng补充道。“它将为创造性表达和身体参与开启新的可能性,”卡斯特利翁说。
The team has published a paper and will formally introduce EDGE at the Computer Vision and Pattern Recognition conference in Vancouver, British Columbia, in June. There is also a website called “EDGE Playground” where anyone who is interested can pick the tune and watch as EDGE creates a new dance sequence from scratch.
该团队发表了一篇论文,并将在6月在不列颠哥伦比亚省温哥华举行的计算机视觉和模式识别会议上正式介绍EDGE。还有一个名为“EDGE Playground”的网站,任何有兴趣的人都可以选择曲调并观看EDGE从头开始创建新的舞蹈序列。
“Everyone is invited to play with it. It’s fun!” Liu says.
“每个人都被邀请玩它。真好玩!“刘斌说。