目标c:通过套接字在rtp数据包中发送音频数据 [英] Objective c: Send audio data in rtp packet via socket

问题描述

在我的应用中，我必须捕获麦克风并以rtp数据包的形式发送音频数据.但是我只看到接收rtp数据，例如 iOS RTP实时音频接收或未答复的一个.

In my app, I have to capture microphone and send audio data in rtp packet. But I only see receive rtp data like iOS RTP live audio receiving or unanswered one.

我将以下代码与 AsuncUdpSocket 一起使用来发送音频数据，但它没有包装在rtp数据包中.是否有任何库可以将我的音频数据包装到rtp数据包中?

I used following code with AsuncUdpSocket to sent audio data but it wasn't wrap in rtp packet. Is there any library to wrap my audio data into rtp packet?

初始AsyncUdpSocket:

initial AsyncUdpSocket:

 udpSender = [[GCDAsyncUdpSocket alloc] initWithDelegate:self delegateQueue:dispatch_get_main_queue()];

NSError *error;
[udpSender connectToHost:@"192.168.1.29" onPort:1024 error:&error];   

我在播放回调函数中发送音频数据:

I send audio data in my playback callback function:

static OSStatus playbackCallback(void *inRefCon, 
                             AudioUnitRenderActionFlags *ioActionFlags, 
                             const AudioTimeStamp *inTimeStamp, 
                             UInt32 inBusNumber, 
                             UInt32 inNumberFrames, 
                             AudioBufferList *ioData) {    

/**
 This is the reference to the object who owns the callback.
 */
AudioProcessor *audioProcessor = (AudioProcessor*) inRefCon;

// iterate over incoming stream an copy to output stream
for (int i=0; i < ioData->mNumberBuffers; i++) { 
    AudioBuffer buffer = ioData->mBuffers[i];

    // find minimum size
    UInt32 size = min(buffer.mDataByteSize, [audioProcessor audioBuffer].mDataByteSize);

    // copy buffer to audio buffer which gets played after function return
    memcpy(buffer.mData, [audioProcessor audioBuffer].mData, size);

    // set data size
    buffer.mDataByteSize = size;

    //Send data to remote server      

    NSMutableData *data=[[NSMutableData alloc] init];
    Float32 *frame = (Float32*)buffer.mData;
    [data appendBytes:frame length:size];
    if ([udpSender isConnected])
    {
        [udpSender sendData:data withTimeout:-1 tag:1];
    }


}



return noErr;
} 

我如何做到这一点?

谢谢.

推荐答案

最后，这是我的解决方案.

Finally, here's my solution.

设置麦克风捕获过程:

-(void)open {
NSError *error;
m_capture = [[AVCaptureSession alloc]init];
AVCaptureDevice *audioDev = [AVCaptureDevice defaultDeviceWithMediaType:AVMediaTypeAudio];
if (audioDev == nil)
{
    printf("Couldn't create audio capture device");
    return ;
}
//m_capture.sessionPreset = AVCaptureSessionPresetLow;

// create mic device
AVCaptureDeviceInput *audioIn = [AVCaptureDeviceInput deviceInputWithDevice:audioDev error:&error];
if (error != nil)
{
    printf("Couldn't create audio input");
    return ;
}


// add mic device in capture object
if ([m_capture canAddInput:audioIn] == NO)
{
    printf("Couldn't add audio input");
    return ;
}
[m_capture addInput:audioIn];
// export audio data
AVCaptureAudioDataOutput *audioOutput = [[AVCaptureAudioDataOutput alloc] init];
[audioOutput setSampleBufferDelegate:self queue:dispatch_get_main_queue()];
if ([m_capture canAddOutput:audioOutput] == NO)
{
    printf("Couldn't add audio output");
    return ;
}


[m_capture addOutput:audioOutput];
[audioOutput connectionWithMediaType:AVMediaTypeAudio];
[m_capture startRunning];
return ;
}

捕获麦克风数据:

-(void) captureOutput:(AVCaptureOutput *)captureOutput didOutputSampleBuffer:(CMSampleBufferRef)sampleBuffer fromConnection:(AVCaptureConnection *)connection{
char szBuf[450];
int  nSize = sizeof(szBuf);

if (isConnect == YES)
{
if ([self encoderAAC:sampleBuffer aacData:szBuf aacLen:&nSize] == YES)
{
    [self sendAudioData:szBuf len:nSize channel:0];
}

}

初始化套接字

-(void)initialSocket{
    //Use socket
    printf("initialSocket\n");
    CFReadStreamRef readStream = NULL;
    CFWriteStreamRef writeStream = NULL;

    NSString *ip = @"192.168.1.147";   //Your IP Address
    uint *port = 22133;

    CFStreamCreatePairWithSocketToHost(kCFAllocatorDefault, (__bridge CFStringRef)ip, port, &readStream,  &writeStream);
    if (readStream && writeStream) {
    CFReadStreamSetProperty(readStream, kCFStreamPropertyShouldCloseNativeSocket, kCFBooleanTrue);
    CFWriteStreamSetProperty(writeStream, kCFStreamPropertyShouldCloseNativeSocket, kCFBooleanTrue);

    iStream = (__bridge NSInputStream *)readStream;
    [iStream setDelegate:self];
    [iStream scheduleInRunLoop:[NSRunLoop currentRunLoop] forMode:NSDefaultRunLoopMode];
    [iStream open];

    oStream = (__bridge NSOutputStream *)writeStream;
    [oStream setDelegate:self];
    [oStream scheduleInRunLoop:[NSRunLoop currentRunLoop] forMode:NSDefaultRunLoopMode];
    [oStream open];
    }
}

在捕获麦克风数据时将数据发送到套接字.

Send data to socket when capture the data form microphone.

-(void)sendAudioData: (char *)buffer len:(int)len channel:(UInt32)channel
{
    Float32 *frame = (Float32*)buffer;
    [globalData appendBytes:frame length:len];

    if (isConnect == YES)
    {
        if ([oStream streamStatus] == NSStreamStatusOpen)
        {
            [oStream write:globalData.mutableBytes maxLength:globalData.length];


            globalData = [[NSMutableData alloc] init];

        }
    }

}

希望这会对某人有所帮助.

Hope this will help someone.

这篇关于目标c:通过套接字在rtp数据包中发送音频数据的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！