如何比较两种排名算法？ [英] How to compare two ranking algorithms?

问题描述

大家好，



我想比较两种排名算法。在这些算法中，客户端在他/她的搜索中指定了一些条件。根据客户的要求，这些算法应为数据库中的每个项目分配一个分数，并检索得分最高的项目。



我在网上搜索过。根据我的搜索，最相关的文章解释了比较排名算法的一些指标，是：

http://www.icml2010.org/papers/504.pdf

我认为prec @ k，MAP，MRR和NDCG是很好的指标，但我有一个问题：



我的算法排序结果，所以我的结果列表中的第一项是得分最高的第一项，第二项是第二项得分，依此类推。我限制我的搜索算法，例如找到5个最佳结果。结果是最前5项。因此，精度将为1.当我限制搜索以找到最佳结果时，它会找到最佳结果。再次，精度将是1.但问题是，对于看到这个结果的人来说这是不可接受的。



我该怎么办？我如何比较这些算法并显示一个比另一个好？

请帮助我。万分感谢。

Hello all,

I want to compare two ranking algorithms. In these algorithms, client specifies some conditions in his/her search. According to the client`s requirements, these algorithm should assign a score for each items in data base and retrieve items with highest scores.

I have searched the net. According to my searches, the most relevant article which explains about some metrics for comparing ranking algorithms, was this:
http://www.icml2010.org/papers/504.pdf
I think prec@k, MAP, MRR, and NDCG, are good metrics to use, but I have a problem:

My algorithm sort results, so the first item in my result list is the best one with highest score, the second result have the second top score, and so on. I limit my search algorithm to for example find 5 best results.The results are the most top 5 items. So,precision will be 1. When I limit my search to find best result,It finds the best one. Again, precision will be 1.But the problem is that,it is unacceptable for people who see this result.

What can I do? How I can I compare these algorithms and show one is better than the other?
Please help me. Thanks a million.

推荐答案

谁是客户？你老师？ （教师通常以他们指定的方式想要它。）



但无论这是否是家庭作业，您都需要了解客户的要求。

（我没看过您链接的学术论文。这只是常用标准）



用于比较两种算法的常用日常测量是

1.时间，这是最快的。

2.准确性，算法获得正确结果的频率。

3.资源使用情况。使用了多少内存，CPU等。

（例如，你的算法是否完全阻止CPU）

4.算法具体如何。是否可以用于其他任务。

Who is the client? You teacher? (Teachers usually want it in the way they specify.)

But regardless of if this is home work or not, you need to understand the client requirements.
(I did not read the academic paper you linked. This is just common criteria)

The usual everyday measurements used to compare two algorithms are
1. Time, which is the fastest.
2. Accuracy, how often does the algorithm get the correct result.
3. Resource usage. How much memory, CPU etc is used.
(for example, does your algorithm totally block the CPU)
4. How specific is the algorithm. Can it be adopted to other tasks.

这篇关于如何比较两种排名算法？的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！