结合音频流和彩色流 [英] Combining Audio stream and Color Stream

问题描述

嘿，希望有人可以帮助我。我试图使用Kinect的音频和颜色流在c ++中进行图像检测和语音识别。唯一的问题是我一次只能运行一个......当Color流开启时，它不是
识别语音，反之亦然。它可能与我的Update（）函数有关，但我不知道该怎么做。 

以下是相关的示例函数： 

 int CColorBasics :: Run（HINSTANCE hInstance，int nCmdShow）
 {
 MSG msg = {0}; 
 WNDCLASS wc; 
 
 //对话框自定义窗口类
 ZeroMemory（& wc，sizeof（wc））; 
 wc.style = CS_HREDRAW | CS_VREDRAW; 
 wc.cbWndExtra = DLGWINDOWEXTRA; 
 wc.hInstance = hInstance; 
 wc.hCursor = LoadCursorW（NULL，IDC_ARROW）; 
 wc.hIcon = LoadIconW（hInstance，MAKEINTRESOURCE（IDI_APP））; 
 wc.lpfnWndProc = DefDlgProcW; 
 wc.lpszClassName = L" ColorBasicsAppDlgWndClass" ;; 
 
 if（！RegisterClassW（& wc））
 {
 return 0; 
} 
 
 //创建主应用程序窗口
 HWND hWndApp = CreateDialogParamW（
 hInstance，
 MAKEINTRESOURCE（IDD_APP），
 NULL，
（DLGPROC）CColorBasics :: MessageRouter，
 reinterpret_cast< LPARAM>（this））; 
 
 //显示窗口
 ShowWindow（hWndApp，nCmdShow）; 
 
 while（WM_QUIT！= msg.message）
 {
 //检查我们是否有消息（通过传入QS_ALLINPUT）
 //或者一个Kinect事件（事件）
 // Update（）将单独检查Kinect事件，以防多个信号通知
 MsgWaitForMultipleObjects（2，events，FALSE，INFINITE，QS_ALLINPUT）; 
 
 //显式检查Kinect帧事件，因为MsgWaitForMultipleObjects 
 //可以出于其他原因返回，即使它已发出信号。 
 Update（）; 
 
 while（PeekMessageW（& msg，NULL，0,0，PM_REMOVE））
 {
 //如果对话框proc $将对话消息进行处理b $ b if（（hWndApp！= NULL）&& IsDialogMessageW（hWndApp，& msg））
 {
 continue; 
} 
 
 TranslateMessage（& msg）; 
 DispatchMessageW（& msg）; 
} 
} 
 
返回static_cast< int>（msg.wParam）; 
} 
 
 void CColorBasics :: Update（）{
 HANDLE events [] = {m_hNextColorFrameEvent，m_hSpeechEvent}; 
 DWORD ret = WaitForMultipleObjects（2，events，FALSE，INFINITE）; 
 if（WAIT_OBJECT_0 == ret）
 ProcessColor（）
 else if（（WAIT_OBJECT_0 + 1）== ret）
 ProcessSpeech（）
} 
 
 

问题是我不认为曾经调用ProcessSpeech（）函数，如果我翻转订单，从不调用ProcessColor（）。它们都是单独工作，而不是在我的实现中。任何帮助将不胜感激！

解决方案

您是如何初始化传感器的？

 //初始化传感器
 hr = m_pNuiSensor-> NuiInitialize（NUI_INITIALIZE_FLAG_USES_AUDIO | NUI_INITIALIZE_FLAG_USES_COLOR）; 
 

< /跨度>

Hey, hopefully someone can help me out here. Im trying to use the Kinect's audio and color stream for image detection and speech recognition in c++. The only problem is I can only get one working at a time... When the Color stream is on it's not recognizing speech, and vice versa. It probably has something to do with my Update() functions, but I just have no idea what to do. 

Here are the relevant sample functions: 

int CColorBasics::Run(HINSTANCE hInstance, int nCmdShow)
{
	MSG       msg = { 0 };
	WNDCLASS  wc;

	// Dialog custom window class
	ZeroMemory(&wc, sizeof(wc));
	wc.style = CS_HREDRAW | CS_VREDRAW;
	wc.cbWndExtra = DLGWINDOWEXTRA;
	wc.hInstance = hInstance;
	wc.hCursor = LoadCursorW(NULL, IDC_ARROW);
	wc.hIcon = LoadIconW(hInstance, MAKEINTRESOURCE(IDI_APP));
	wc.lpfnWndProc = DefDlgProcW;
	wc.lpszClassName = L"ColorBasicsAppDlgWndClass";

	if (!RegisterClassW(&wc))
	{
		return 0;
	}

	// Create main application window
	HWND hWndApp = CreateDialogParamW(
		hInstance,
		MAKEINTRESOURCE(IDD_APP),
		NULL,
		(DLGPROC)CColorBasics::MessageRouter,
		reinterpret_cast<LPARAM>(this));

	// Show window
	ShowWindow(hWndApp, nCmdShow);

	while (WM_QUIT != msg.message)
	{
		// Check to see if we have either a message (by passing in QS_ALLINPUT)
		// Or a Kinect event (events)
		// Update() will check for Kinect events individually, in case more than one are signalled
		MsgWaitForMultipleObjects(2, events, FALSE, INFINITE, QS_ALLINPUT);

		// Explicitly check the Kinect frame event since MsgWaitForMultipleObjects
		// can return for other reasons even though it is signaled.
		Update();

		while (PeekMessageW(&msg, NULL, 0, 0, PM_REMOVE))
		{
			// If a dialog message will be taken care of by the dialog proc
			if ((hWndApp != NULL) && IsDialogMessageW(hWndApp, &msg))
			{
				continue;
			}

			TranslateMessage(&msg);
			DispatchMessageW(&msg);
		}
	}

	return static_cast<int>(msg.wParam);
}

void CColorBasics::Update() {	
HANDLE events[] = { m_hNextColorFrameEvent, m_hSpeechEvent };				
DWORD ret = WaitForMultipleObjects(2, events, FALSE, INFINITE);		
if (WAIT_OBJECT_0 == ret)
			ProcessColor()		
else if ((WAIT_OBJECT_0 + 1) == ret) 
        ProcessSpeech()	
}

The problem is I don't think the ProcessSpeech() function is ever called, and if I flip the order, the ProcessColor() is never called. They both work individually, just not together in my implementation. Any help would be appreciated!

解决方案

How have you initialized the sensor?

// initialize the sensor
hr = m_pNuiSensor->NuiInitialize(NUI_INITIALIZE_FLAG_USES_AUDIO | NUI_INITIALIZE_FLAG_USES_COLOR);

这篇关于结合音频流和彩色流的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！