Azure认知服务自定义愿景:如何设计适当的多标签分类法? [英] Azure Cognitive Services Custom Vision: How do I design an appropriate multi-label classification taxonomy?

问题描述

我已经使用约5000个我自己的域特定图像以及约30个层次和非层次标签构建了一个Azure自定义视觉模型.

I have built an Azure Custom Vision model using ~ 5000 of my own domain-specific images and a set of ~ 30 hierarchical and non-hierarchical labels.

我不确定在这个特殊的多标签分类问题中如何最好地组织我的标签动物园.最佳方法(请参见例如 https://www.researchgate.net/publication/225379571_A_Tutorial_on_Multi-label_Classification_Techniques 和 https://towardsdatascience.com/前往多标签分类中心-384c40229bff )必须取决于Custom Vision的内部工作原理，这是未记录的*.考虑例如

I am not sure how best to organize my label zoo in this particular multi-label classification problem. The best approach (see e.g. https://www.researchgate.net/publication/225379571_A_Tutorial_on_Multi-label_Classification_Techniques and https://towardsdatascience.com/journey-to-the-center-of-multi-label-classification-384c40229bff) must depend on the inner workings of Custom Vision, alas undocumented*. Consider for example

Image Document_Description
1 Barclays Bank Statement
2 HSBC Bank Statement
3 Joe Bloggs' Curriculum Vitae

考虑到Custom Vision使用的(也许)未知的建模方案及其对任意标签的支持，哪种标签分类法将是最有效的(就训练计算和模型性能而言)?

Given the (perhaps) unknown modelling scheme(s) used by Custom Vision, and its support for arbitrary tags, which labelling taxonomy will be most efficient (in terms of training compute and model performance)?

1. Hierarchical (choose one from each level):
        IsCV | IsBankStatement | IsOther | ...
                   |
             Barclays | HSBC | ...

2. Non-hierarchical:
        IsCV, IsBankStatementBarclays, IsBankStatementHSBC, IsOther, ...

3. Both
4. Some other scheme perhaps informed by insider information?

奖金::您将如何使用可用的性能指标(或V3.0 API)来衡量两个相互竞争的分类法的性能(只需最少的培训计算/成本)?

Bonus: How would you use the available performance indicators - or the V3.0 API - to measure the performance of two competing taxonomies (with minimal training compute/cost)?

*对于这个绝望的问题，我深表歉意.在投票关闭它之前，请让Azure Cognitive Services时间发表评论，因为这似乎是他们唯一能够提供意见的论坛，并且他们确实通过SO提出查询.谢谢.

*I apologise for the desperate question. Before voting to close it, please allow Azure Cognitive Services time to comment, since this seems to be about the only forum in which they might be able to give input, and they do ask for queries via SO. Thanks.

推荐答案

我认为自定义视觉目前仅支持非分层标签，但您可以在此处提交建议

I think custom vision only support non-hierarchical tags for now, but you can submit suggestions here https://cognitive.uservoice.com/forums/598141-custom-vision-service

这篇关于Azure认知服务自定义愿景:如何设计适当的多标签分类法?的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！