自动 My Little Pony 检测和分类 [英] Automated My Little Pony detection and classification

问题描述

我正在寻找具有计算机视觉经验的人的建议，即哪种方法或算法最适合解决这个特定问题.我是一位经验丰富的程序员(主要是 .NET)，但我对计算机视觉几乎一无所知，我想节省时间.

What I'm looking for is advice from people with experience with computer vision on what approach or algorithm would be best on this particular problem. I'm an experienced programmer (mostly .NET), but I know next to nothing about computer vision and I want to save time.

我更喜欢不需要大型训练集的算法.

我要检测的内容:

独特的颜色、锐利的边缘、缺乏渐变和极少的噪点.

What I want to detect:

Distinctive colors, sharp edges, lack of gradients, and very little noise.

我设想最终结果类似于 Picasa 或 Windows Live Gallery 所做的 - 我在几张图像中标记一匹小马，然后程序会找到包含相同小马的其他图像.

I envision the end result to be something like what Picasa or Windows Live Gallery does - I mark a pony in a few images and the program finds other images containing the same pony.

推荐答案

漫画家在他们的绘画与未经修饰的照片中获得了特别强的许可.因此，试图通过颜色来识别萍琪派在她掉进一大桶黑色颜料的画面中并没有多大好处.或者你可能认为你可以通过她的角认出瑞瑞，但考虑一下她希望自己能成为普通小马的那一集……但在失去角后，她学到了做自己的教训.

Cartoonists take particularly strong license in their drawings vs. an unretouched photo. Thus trying to identify Pinkie Pie by color doesn't do a lot of good in a frame where she has fallen into a vat of black paint. Or you might think you could identify Rarity by her horn, but consider the episode where she wishes she could be a regular pony...but after losing her horn she learns a lesson about being oneself.

没错.如此真实.

这意味着根据您在此处尝试执行的操作及其规模，为众包系统提供接口可能是有意义的.如果您还没有看过白手套项目，您可能会从中找到一些灵感:

This means depending on what you're trying to do here and the scale of it, it may make sense to provide an interface to a crowdsourcing system. If you haven't seen the white glove project, you might find some inspiration in that:

http://whiteglovetracking.com/

不过，它不必全是自动的或手动的.您可以使用多种技术，并在存在不确定性阈值时引入人工编辑.

It doesn't have to be all automatic or manual, though. You could use a combination of techniques, and bring in human editors whenever there's a threshold of uncertainty.

至于设计启发式方法，似乎要从寻找小马的位置开始着手.从搜索小马形状的东西"开始可能会有点失败......特别是如果这些是可能有特写镜头的卡通帧.其实这里单看你的例子，独角兽就是个脑袋！

As for designing a heuristic, it seems the place to start in getting a sense of where ponies are is to look for the eyes. Beginning with a search for "pony shaped things" might be a bit of a lost cause...especially if these are frames from a cartoon which might have close ups. In fact, looking at just your example here, the unicorn is just a head!

我建议的下一步是在眼睛周围的某个半径范围内寻找与头发和身体相匹配的色块.我收藏的所有我的小马驹都有独特的头发和身体颜色，而且...等等...我的意思是我不知道我的小马驹角色是否有独特的颜色组合！！但他们可能会.

The next step I'd suggest would be to look in a certain radius around the eyes for color blocks matching hair and body. All of the My Little Ponies in my collection have unique hair and body colors, and...wait...I mean I don't know if My Little Pony characters have unique color combinations or not!! But they probably do.

一旦您直观地了解了小马的颜色指纹，您就可以进一步搜索，并可能通过使用类似洪水填充算法的方法获得一个边界框，假设小马是没有孔的单个多边形.再一次，眼睛可以让您很好地了解图片中小马的大小，但漫画家们可以随时打破这种期望.加上小马闭上眼睛或眨眼等，所以你在这里做的任何事情都需要审查.

Once you've intuited the pony's color fingerprint you can then search further and probably get a bounding box by using something like a flood-fill algorithm, assuming ponies are single polygons with no holes. Once again the eyes can give you a good idea of how large the pony will likely be in the picture, but once again cartoonists can break that expectation at any moment. Plus ponies close their eyes or blink etc. so anything you do here is going to need vetting.

(注意:如果你有一个完整的视频流，你可以想象使用帧间分析来解决眨眼问题.更一般地说，小马可能是最有活力的"大多数静态帧中的东西——这可能会增强你对找到它们的启发式方法的信心.)

但无论你选择做什么......记住友谊就是魔法——图像识别也是如此！！

But whatever you do choose to do...remember that Friendship Is Magic--and so is Image Recognition!!

这篇关于自动 My Little Pony 检测和分类的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！