音乐转录 [英] Music transcription

问题描述

我正在做一个复音音乐转录项目.我已经阅读了一些论文，并浏览了解释类似任务的文章.我对问题域的许多方面感到非常困惑.希望有人能够帮助我.

I'm working on a polyphonic music transcription project. I have read some papers and gone through articles which explains similar tasks. I'am very confused about many aspects of the problem domain. Hope someone will be able to help me.

到目前为止，我已经从给定的mp3中获得了解码的音频数据流.

So far I have obtained a stream of decoded audio data from a given mp3.

我已经知道，发作检测是转录的第一步. .有没有可用的Java库可用于检测发作.

I have understood onset detection is the first step towards transcription. . Is there any java library available which can be used for detecting onsets.

接下来，正如我所读过的，使用FFT也可以检测基频.

Next, detecting the fundamental frequency is also done with the use of FFT as I have read.

我想知道在这些任务中使用FFT的情况. (我对FFT不太熟悉).绝对需要执行FFT来进行起始检测和F0检测. 如果没有，还有其他方法. 我可以对已有的音频流执行FFT，还是必须执行一些其他操作才能处理这些音频数据.

I want to know the use of FFT in these tasks. (I'm not familiar with FFT much). Is it absolutely necessary to perform FFT for onset detection and F0 detection. If not what are the other ways. Can I perform the FFT on the audiostream I have, or is there some other operation that has to be done in order to manipulate these audio data.

非常感谢.

推荐答案

此字段称为机器监听.

数字编码音乐的和声转录是机器聆听的圣地之一.这是一个尚未解决的问题，也是一个积极研究的领域.子字段包括:

Polyphonic transcription of digitally encoded music is one of the holy grails of machine listening. It is an unsolved problem, and an area of active research. The sub-fields include:

• 发病检测
• 节拍提取(检测度量结构，时间信号等)
• 音高检测(可以对单音信号使用自相关和其他方法进行音高检测，但应用于复杂的复音音乐时仍未解决)
• 密钥检测(密钥签名检测).

根据项目的性质，您可能会发现探索 SuperCollider 有用. >编程环境. SC是为此类项目设计的语言，已经具有大量的机器侦听插件(ugens)，以及用于处理FFT，音频信号等的综合框架.

Depending on the nature of your project, you might find it useful to explore the SuperCollider programming environment. SC is a language designed for projects such as this, already has a large number of machine listening plugins (ugens), and a comprehensive framework for dealing with FFT, audio signals, and much more.

这篇关于音乐转录的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！