将文本转换为美国手语 [英] Convert text to American sign language

查看:194
本文介绍了将文本转换为美国手语的处理方法,对大家解决问题具有一定的参考价值,需要的朋友们下面随着小编来一起学习吧!

问题描述

我想文本转换成美国手语(ASL)。我想创建一组视频,然后再映射到一些话。

I want to convert text into American sign language (ASL). I am thinking of creating a set of videos first and then map to some words.

但是,它可以通过使用3D模型,并使其成为动画生成通过直接文字手语视频?

But is it possible to generate a sign language video through direct text by using a 3D model and making it to animate?

推荐答案

这绝对是一个活跃的研究领域。有一些良好的工作的人,在德保罗,你可能会感兴趣的正在做,请参见 HTTP://asl.cti .depaul.edu / 信息。

This is definitely an area of active research. There is some good work being done by people at DePaul that you might be interested in. See http://asl.cti.depaul.edu/ for information.

任务的确是复杂的。 @jonsca是正确的,它不是简单的字对字的翻译上的问题。所以从一开始,你将需要一个真正的机器翻译系统,该系统采用英文文本作为输入和输出的一系列翔升迹象(如粉饰)。然后,你需要一个系统,该系统采用了一系列的美化和生产的迹象。但是为了你的头像是现实的,种种迹象都完全吻合,流量正常。当创建一个分身,你必须担心恐怖谷,出现这种现象,当运动不是很人性化。

The task is indeed complex. @jonsca is right that it's not simply a matter of word-for-word translation. So right from the beginning you will need a real machine translation system that takes English text as input and outputs a series of ASL signs (like glosses). Then you would need a system that takes that series of glosses and produces signs. But in order for your avatar to be realistic, the signs have to fit together well and flow properly. When creating an avatar you have to worry about the Uncanny Valley, a phenomenon that occurs when the movement is not quite human.

编辑: 最后,一​​系列静止图像绝对不会削减它。有几个原因。首先,因为它被提到的,大多数的迹象涉及的运动,这将不能与静止图像的工作。但更重要的是,在标志的空间关系是非常重要的。例如,当你在谈论的人在ASL,你们每个人分配到的空间区域。然后,指着每个人就像是一个代名词。系统将必须是能够通过跟踪所有实体并正确指向它们来处理这

Finally, a series of still images definitely wouldn't cut it. There are a few reasons for this. First, as it was mentioned, most signs involve movement, which wouldn't work with a still image. But more importantly, the spatial relationships in the signs are very important. For example, when you are talking about people in ASL, you assign each person to an area in space. Then, pointing to each person is like a pronoun. Your system would have to be able to handle this by keeping track of all the entities and pointing to them properly.

这篇关于将文本转换为美国手语的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!

查看全文
登录 关闭
扫码关注1秒登录
发送“验证码”获取 | 15天全站免登陆