1

I have an array of Float (representing audio samples) and I want to turn it into an AVAudioPCMBuffer so I can pass it to AVAudioFile's write(from:). There's an obvious way (actually not obvious at all, I cribbed it from this gist):

var floats: [Float] = ... // this comes from somewhere else
let audioBuffer = AudioBuffer(mNumberChannels: 1, mDataByteSize: UInt32(floats.count * MemoryLayout<Float>.size), mData: &floats)
var bufferList = AudioBufferList(mNumberBuffers: 1, mBuffers: audioBuffer)
let outputAudioBuffer = AVAudioPCMBuffer(pcmFormat: buffer.format, bufferListNoCopy: &bufferList)!
try self.renderedAudioFile?.write(from: outputAudioBuffer)

This works (I get the audio output I expect) but in Xcode 13.4.1 this gives me a warning on the &floats: Cannot use inout expression here; argument 'mData' must be a pointer that outlives the call to 'init(mNumberChannels:mDataByteSize:mData:)'

Ok, scope the pointer then:

var floats: [Float] = ... // this comes from somewhere else
try withUnsafeMutablePointer(to: &floats) { bytes in
    let audioBuffer = AudioBuffer(mNumberChannels: 1, mDataByteSize: UInt32(bytes.pointee.count * MemoryLayout<Float>.size), mData: bytes)
    var bufferList = AudioBufferList(mNumberBuffers: 1, mBuffers: audioBuffer)
    let outputAudioBuffer = AVAudioPCMBuffer(pcmFormat: buffer.format, bufferListNoCopy: &bufferList)!
    try self.renderedAudioFile?.write(from: outputAudioBuffer)
}

The warning goes away, but now the output is garbage. I really don't understand this as floats.count and bytes.pointee.count are the same number. What am I doing wrong?

3
  • Don't you want withUnsafeMutableBufferPointer?
    – jrturton
    Jun 8 at 15:16
  • Apparently not: Cannot convert value of type 'UnsafeMutableBufferPointer<Float>' to expected argument type 'UnsafeMutableRawPointer?' (where it's passed into the AudioBuffer constructor as mData) Jun 8 at 20:16
  • A helper function in Objective-C could be an option
    – sbooth
    Jun 17 at 14:31

1 Answer 1

1

This solution is somewhat hackish but should work:

@implementation AVAudioFile (FloatArrayWriting)

- (BOOL)writeFloatArray:(const float *)data count:(NSInteger)count format:(AVAudioFormat *)format error:(NSError **)error
{
    NSParameterAssert(data != NULL);
    NSParameterAssert(count >= 0);
    NSParameterAssert(format != nil);

    AudioBufferList abl;
    abl.mNumberBuffers = 1;
    abl.mBuffers[0].mData = (void *)data;
    abl.mBuffers[0].mNumberChannels = 1;
    abl.mBuffers[0].mDataByteSize = count * sizeof(float);

    AVAudioPCMBuffer *buffer = [[AVAudioPCMBuffer alloc] initWithPCMFormat:format bufferListNoCopy:&abl deallocator:NULL];
    return [self writeFromBuffer:buffer error:error];
}

@end

By implementing the method in Objective-C you can sidestep the pointer gymnastics needed for AVFAudio in Swift.

Here is a possible Swift solution:

try floats.withUnsafeMutableBufferPointer { umrbp in
    let audioBuffer = AudioBuffer(mNumberChannels: 1, mDataByteSize: UInt32(umrbp.count * MemoryLayout<Float>.size), mData: umrbp.baseAddress)
    var bufferList = AudioBufferList(mNumberBuffers: 1, mBuffers: audioBuffer)
    let outputAudioBuffer = AVAudioPCMBuffer(pcmFormat: buffer.format, bufferListNoCopy: &bufferList)!
    try self.renderedAudioFile?.write(from: outputAudioBuffer)
}
7
  • Thanks for taking the effort to think this through, but surely the "pointer gymnastics" are at least possible in Swift? If they aren't, what's the underlying reason and how big a hole is this in Swift's capabilities? Or is it just an edge-case compiler bug? Jun 20 at 7:32
  • I added a possible Swift solution but I haven't had a chance to test it for correctness.
    – sbooth
    Jun 20 at 13:47
  • YES! The magic spell was .baseAddress, thank you. You also need mDataByteSize: UInt32(bytes.count * MemoryLayout<Float>.size), so I edited that in to your answer, hope you don't mind. Jun 21 at 9:28
  • Glad it's working for you. I believe that umrbp.count is the count of bytes, not array elements, so multiplying shouldn't be necessary.
    – sbooth
    Jun 21 at 11:37
  • The multiplication is definitely necessary, without it I got little chunks of my samples, with it, it works properly. Jun 21 at 14:10

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.