Project Tango的3D AR标记 [英] 3D AR Markers with Project Tango

问题描述

我正在为一个展览项目工作，其中应该将AR场景层叠在3D打印对象的顶部.将为访问者提供预装了该应用程序的设备.应当在展览的周围/顶部看到各种物体，因此跟踪的精度非常重要.

I'm working on a project for an exhibition where an AR scene is supposed to be layered on top of a 3D printed object. Visitors will be given a device with the application pre-installed. Various objects should be seen around / on top of the exhibit, so the precision of tracking is quite important.

我们正在使用Unity渲染场景，这已经可以进行开发了，因此无法更改.但是，我们在识别3D对象以定位AR摄像机所用的技术上有些灵活性.

We're using Unity to render the scene, this is not something that can be changed as we're already well into development. However, we're somewhat flexible on the technology we use to recognize the 3D object to position the AR camera.

到目前为止，我们一直在使用Vuforia. 3D目标功能无法很好地扫描物体，因此我们求助于打印2D标记并将其放置在展览品所在的桌子上.跟踪足够精确，缺点是每当标记丢失时场景都会消失，例如当用户尝试近距离观察时.

So far we've been using Vuforia. The 3D target feature didn't scan our object very well, so we're resorting to printing 2D markers and placing them on the table that the exhibit sits on. The tracking is precise enough, the downside is that the scene disappears whenever the marker is lost, e.g. when the user tries to get a closer look at something.

现在，我们最近开始接触Lenovo Phab 2 pro，并试图确定Tango是否可以改进此解决方案.如果我理解正确的话，Tango的优点是我们可以使用其内部传感器和运动跟踪来估计其轨迹，因此，即使丢失了标记，它也会继续非常准确地渲染场景，然后一旦重新获得标记.不幸的是，我一开始找不到关于如何定位标记的任何教程.

Now we've recently gotten our hands on a Lenovo Phab 2 pro and are trying to figure out if Tango can improve on this solution. If I understand correctly, the advantage of Tango is that we can use its internal sensors and motion tracking to estimate its trajectory, so even when the marker is lost it will continue to render the scene very accurately, and then do some drift correction once the marker is reacquired. Unfortunately, I can't find any tutorials on how to localize the marker in the first place.

以前有人使用Tango进行3D标记跟踪吗?我看了一下Unity插件中包含的Area Learning示例，让它在一个几乎没有特色的房间里扫描了我们的展览和桌子.即使将其移动到其他位置，它也能够以正确的方向识别对象，但是场景始终会偏离几厘米，这对于我们的目的而言不够精确.还有一个用于Tango的2D标记检测API，但看起来它仅适用于QR码或AR标签(例如

Has anyone used Tango for 3D marker tracking before? I had a look at the Area Learning example included in the Unity plugin, by letting it scan our exhibit and table in a mostly featureless room. It does recognize the object in the correct orientation even when it is moved to a different location, however the scene it always off by a few centimeters, which is not precise enough for our purposes. There is also a 2D marker detection API for Tango, but it looks like it only works with QR codes or AR tags (like this one), not arbitrary images like Vuforia.

我们正试图通过探戈实现什么?预先感谢您的任何建议.

Is what we're trying to achieve possible with Tango? Thanks in advance for any suggestions.

推荐答案

选项A)坚持使用Vuforia. 正如Hristo所指出的，您的标记丢失问题应该可以通过扩展跟踪来解决.这听起来绝对值得测试.

Option A) Sticking with Vuforia. As Hristo points out, Your marker loss problem should be fixable with Extended Tracking. This sounds definitely worth testing.

选项B)探戈 除了ARTags和QRCodes之外，Tango本身不支持其他标记.

Option B) Tango Tango doesn't natively support other markers than the ARTags and QRCodes.

它也不支持学到的领域"场景移动(很多).如果您的3D打印对象保持静止，则可以扫描ADF，并且应具有良好的质量跟踪.如果所有物体静止不动，则应该有一点但不会太大的漂移.

It also doesn't support the Area Learnt scene moving (much). If your 3DPrinted objects stayed stationary you could scan an ADF and should have good quality tracking. If all the objects stay still you should have a little but not too much drift.

但是，如果您要移动那些3D打印的对象，则肯定会取消该跟踪.因此，移动的对象不应成为扫描场景的一部分. 您可以在没有3D对象的情况下进行ADF扫描以跟踪用户位置，然后使用Tangos ARMarker检测通过ARMarker跟踪3D打印对象. (不确定-您是否已经尝试过?).如果这种方法不起作用，我认为您唯一的Tango选项是在空间中添加更多功能/照明等，以使跟踪更牢固.

However, if you are moving those 3D Printed objects, it will definitely throw that tracking off. So moving objects shouldn't be part of the scanned scene. You could make an ADF Scan without the 3D objects present to track the users position, and then track the 3D printed objects with ARMarkers using Tangos ARMarker detection. (unsure - is that what you tried already?) . If that approach doesn't work, I think your only Tango option is to add more features/lighting etc.. to the space to make the tracking more solid.

通过Vuforia进行的总体自然特征跟踪(或针对稳健性的标记跟踪)听起来更适合我认为您的项目正在做的事情，因为用户大多会关注ARTag/NFT对象.但是，如果它的健壮性不至于达到极限，Tango可以提供类似的解决方案.

Overall, Natural Feature tracking by Vuforia (or Marker tracking for robustness) sounds more suited to what I think your project is doing, as users will mostly be looking at the ARTag/NFT objects. However, if it's robustness is not up to scratch, Tango could provide a similar solution.

这篇关于Project Tango的3D AR标记的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！