AR Core 性能、学习曲线以及与其他框架的比较 [英] AR Core performance, learning curve and comparison with other frameworks

问题描述

我希望学习并投入大量时间来构建 3D 增强现实应用，因为它们正在缓慢但肯定地成为人机交互的未来.

I'm hoping to learn and dedicate serious amount of time on building 3D augmented reality apps since they are slowly but surely becoming the future for human and computer interaction.

我想学习 ARCore，但它只能在数量有限的全新手机上运行，​​由于价格原因，我暂时无法进行测试.我有几个关于 ARCore 的问题

I wish to learn ARCore but it only runs on limited number of brand new phones, it's not possible for me to test with, due to their prices,for now. I have few questions regarding to ARCore

1. 与其他流行框架相比，ARCore 的性能如何?它是否使用大量资源进行简单的操作，例如运动检测、跟踪和平面检测?
2. 此处是否需要了解和使用 OpenGL?它只是绘制网格、顶点和简单对象，还是您应该了解更多简单的 3D 建模?到目前为止，我所看到的 ARKit 使用自己的框架管理事物，这是一件好事.
3. 稳定吗?它是否经常崩溃或大部分时间导致 ANR?我找不到应用链接，但用户抱怨它有多糟糕.
4. 除了使用这些设备之外，没有其他方法可以测试和调试代码吗?>?我们可以在模拟器上运行一些 hack 或其他东西吗?
5. 您能否访问手动相机功能，如 ISO、测光等，是否像 camera.getParameters() 一样简单，或者需要一些广泛的工作和/或 NDK 知识?您可以选择使用哪个相机 api 还是只是 Camera2 api?我也想知道是否有任何 AR 框架可以让您使用简单的 get 或 set 方法更改相机参数，例如 Camera1 或 Camera2 api?

1. How is ARCore performence compared to other popular frameworks? Does it use extensive resources for simple operations such as motion detection, tracking and plane detection?
2. Does it require knowledge and use of OpenGL as mentioned here? Is it just drawing meshes, vertices and simple objects or you should know more for simple 3D modelling? As far i've seen so far ARKit manages things with it's own framework which is a good thing.
3. Is it stable? Does it crash often or cause ANR most of the time? I couldn't find the app link but users were complaining about how bad it was.
4. Isn't there no way to test and debug code other than using these device? Can we run it on a emulator with some hack or other stuff?
5. Can you access to manual camera features like ISO, metering, etc., is it easy like camera.getParameters() or some extensive work and/or NDK knowledge is required? Can you choose which camera api to use or is it just Camera2 api? I also wonder is there any AR framework that let you change camera parameters like Camera1 or Camera2 api with simple get or set methods?

我搜索了 ARToolKit，但我的印象是它很难学习，也很难实现，Vuforia 和 Wikitude 不是免费的，这让它们暂时没有问题.我搜索了每个框架的论坛，这个过时的线程和其他一些.

I searched for ARToolKit but i got an impression that it's hard to learn and it's hard to implement things, Vuforia and Wikitude is not being free makes them out of question for now. I searched forums of each framework and this outdated thread and few others.

我正在尝试根据经验数据了解框架的更多技术和软件开发方面的知识.如果你认为这个问题是题外话，请编辑问题或指导我防止出现这种情况，因为在 Android 上没有关于增强现实的集体数据，至少，我没能找到.其中大部分已弃用，基于单个用户的选项，但开发人员无法根据经验获得集体数据.我相信有很多开发人员想知道如何去做以及哪种框架适合他们.

I'm trying to learn more technical and software development aspects of frameworks depending on empirical data. If you thing this question is off-topic please edit the question or direct me to prevent being so since there is no collective data about augmented reality on Android, at least, i haven't been able to find. Most of it is depracated, option based from a single user but no collective data is available from developers based on experience. I'm sure there are lots of developers wondering how to do it and which framework is suitable for them.

推荐答案

ARCore 和其他 AR 框架一样，需要消耗大量资源:场景识别和跟踪不是简单的事情，所以让我们将所有 AR 引擎视为资源使用中重要的东西.

ARCore like other AR frameworks cost lot of resources : scene recognition and tracking are not simple things, so let's consider all AR engine as something important in resources usage.

了解 OpenGL 是一个加分项，因为您需要了解 3D 渲染循环的工作原理才能使用 AR.无需成为 OpenGL 高手，但需要具备基础知识才能理解示例并能够创建自己的 3D/AR 项目.除非你使用 ARKit &Metal 或 AR 与 Unity.

Knowing OpenGL is a plus since you'll need to know how a 3D render loop works ot be able to work AR. No need to be an OpenGL master, but basics are required to understand samples and to be able to create your own 3D/AR project. Unless you'r working with ARKit & Metal, or AR with Unity maybe.

我测试过的所有 AR 库都是稳定的，API 都经过测试并且永远不会崩溃.拥有稳定的 AR 跟踪更复杂，有些比其他更好，并且都有局限性(让我们在统一的白色石头地板上尝试 ARCore 和 ARKit……)但是无标记 AR 引擎在跟踪方面非常令人印象深刻，但需要最新的设备，仍处于测试阶段.

All AR lib I tested are stable, API are tested and quite never crash. It is more complex to have an AR tracking stable, some are better than other, and all have limitations (let's try ARCore and ARKit on a uniform white stone floor...) but markerless AR engine are pretty impressive on tracking, but need lastest devices and are still in beta.

说到 ARCore，只有一些设备是兼容的，据我所知，没有它们就无法测试.模拟器需要摄像头来测试，不知道有没有.

Speaking about ARCore, only some devices are compatibles, no way to test without them as far as I know. Emulator would need a camera to test, don't know if it exists.

在大多数 AR 框架中，Camera 不可用:我的意思是，框架配置并运行相机，大多数时候您甚至无法获得 Camera2 的实例，有时甚至很难获得相机当前设置(ARCore).AR 引擎或多或少是一个黑匣子，以跟踪作为输出.

In most of the AR framework, Camera is not available : I mean, the framework configure and run the camera, you cannot get even an instance of Camera2 most of the time, sometimes it is even hard to get camera current settings (ARCore). The AR engine is more or less a black box, with tracking as output.

我练习了所有这些引擎，我成功使用了一些引擎，但有些仍然无法正常工作(需要时间更深入地实施并使其按照我想要的方式工作，而不是像示例那样工作).我的观点是 ARKit 和 ARCore 将制作 Vuforia &Wikitude 已弃用，因为跟踪更好、无标记(更重要的一点)和......免费！

I practiced all these engines, I used some with success, and some are still not working (takes time to going deeper in the implementation and making it work as I want and not as the sample does). My opinion is ARKit and ARCore are going to make Vuforia & Wikitude deprecated since tracking is better, markerless (the more important point) and ... free of charge!

祝你好运！

这篇关于AR Core 性能、学习曲线以及与其他框架的比较的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！