10

I'm working on the app that records user audio, writes data to file using AudioToolbox and processes these data. In analytics I see A LOT of errors that happen in AudioToolbox recording. Almost half of them is -38 kAudioFileNotOpenError error returned from AudioFileWriteBytes() call.

For now it seems like this happens for no reason: user starts recording, everything goes well and then error is logged for 10-80 times in a row. In analytics there is no user actions like going to background or pausing recording (we have this function).

I researched info online but didn't find much info about errors.

I'm posting all of the recording code (with stripped unused or analytics code), because besides -38 kAudioFileNotOpenError I have a bunch of other errors and this might mean that I might be using AudioToolbox in the wrong way. Here are top errors:

  1. AudioFileWriteBytes() returns -38 kAudioFileNotOpenError error: ([1] in code) - ~50% of all errors
  2. AudioUnitRender() returns -10863 kAudioUnitErr_CannotDoInCurrentContext error ([2] in code) - ~5%
  3. AudioFileWriteBytes() returns 1868981823 kAudioFileDoesNotAllow64BitDataSizeError error: ([1] in code) - ~4%
  4. AudioUnitRender() returns -1 error ([2] in code) - ~3%

Any help, comment or suggesting will be very helpful!

Here's the code (it's also available on GitHub: https://github.com/derpoliuk/SO-AudioToolbox-error-quesion):

class Recorder {

    static let shared = Recorder()
    private static let sampleRate: Float64 = 16000

    var processAudioData: ((Data) -> ())?

    fileprivate var remoteIOUnit: AudioComponentInstance?
    private var audioFile: AudioFileID?
    private var startingByte: Int64 = 0
    // Audio recording settings
    private let formatId: AudioFormatID = kAudioFormatLinearPCM
    private let bitsPerChannel: UInt32 = 16
    private let channelsPerFrame: UInt32 = 1
    private let bytesPerFrame: UInt32 = 2 // channelsPerFrame * 2
    private let framesPerPacket: UInt32 = 1
    private let encoderBitRate = 12800
    private let formatFlags: AudioFormatFlags = kAudioFormatFlagsNativeEndian | kAudioFormatFlagIsSignedInteger | kAudioFormatFlagIsPacked

    func record(atURL url: URL) {
        var status = openFileForWriting(fileURL: url)
        startingByte = 0
        status = prepareAudioToolbox()
        status = startAudioToolboxRecording()
    }

    func openFileForWriting(fileURL: URL) -> OSStatus {
        var asbd = AudioStreamBasicDescription()
        memset(&asbd, 0, MemoryLayout<AudioStreamBasicDescription>.size)
        asbd.mSampleRate = Recorder.sampleRate
        asbd.mFormatID = formatId
        asbd.mFormatFlags = formatFlags
        asbd.mBitsPerChannel = bitsPerChannel
        asbd.mChannelsPerFrame = channelsPerFrame
        asbd.mFramesPerPacket = framesPerPacket
        asbd.mBytesPerFrame = bytesPerFrame
        asbd.mBytesPerPacket = framesPerPacket * bytesPerFrame
        // Set up the file
        var audioFile: AudioFileID?
        var audioErr: OSStatus = noErr
        audioErr = AudioFileCreateWithURL(fileURL as CFURL, AudioFileTypeID(kAudioFileWAVEType), &asbd, .eraseFile, &audioFile)
        if audioErr == noErr {
            self.audioFile = audioFile
        }
        return audioErr
    }

    func prepareAudioToolbox() -> OSStatus {
        var status = noErr
        // Describe the RemoteIO unit
        var audioComponentDescription = AudioComponentDescription()
        audioComponentDescription.componentType = kAudioUnitType_Output
        audioComponentDescription.componentSubType = kAudioUnitSubType_RemoteIO
        audioComponentDescription.componentManufacturer = kAudioUnitManufacturer_Apple
        audioComponentDescription.componentFlags = 0
        audioComponentDescription.componentFlagsMask = 0
        // Get the RemoteIO unit
        var ioUnit: AudioComponentInstance?
        let remoteIOComponent = AudioComponentFindNext(nil, &audioComponentDescription)
        status = AudioComponentInstanceNew(remoteIOComponent!, &ioUnit)
        guard status == noErr else {
            return status
        }
        guard let remoteIOUnit = ioUnit else {
            return 656783
        }
        self.remoteIOUnit = remoteIOUnit
        // Configure the RemoteIO unit for input
        let bus1: AudioUnitElement = 1
        var oneFlag: UInt32 = 1
        status = AudioUnitSetProperty(remoteIOUnit,
                                      kAudioOutputUnitProperty_EnableIO,
                                      kAudioUnitScope_Input,
                                      bus1,
                                      &oneFlag,
                                      UInt32(MemoryLayout<UInt32>.size));
        guard status == noErr else {
            return status
        }
        var asbd = AudioStreamBasicDescription()
        asbd.mSampleRate = Recorder.sampleRate
        asbd.mFormatID = formatId
        asbd.mFormatFlags = formatFlags
        asbd.mBitsPerChannel = bitsPerChannel
        asbd.mChannelsPerFrame = channelsPerFrame
        asbd.mFramesPerPacket = framesPerPacket
        asbd.mBytesPerFrame = bytesPerFrame
        asbd.mBytesPerPacket = framesPerPacket * bytesPerFrame
        // Set format for mic input (bus 1) on RemoteIO's output scope
        status = AudioUnitSetProperty(remoteIOUnit,
                                      kAudioUnitProperty_StreamFormat,
                                      kAudioUnitScope_Output,
                                      bus1,
                                      &asbd,
                                      UInt32(MemoryLayout<AudioStreamBasicDescription>.size))
        guard status == noErr else {
            return status
        }
        // Set the recording callback
        var callbackStruct = AURenderCallbackStruct()
        callbackStruct.inputProc = recordingCallback
        callbackStruct.inputProcRefCon = nil
        status = AudioUnitSetProperty(remoteIOUnit,
                                      kAudioOutputUnitProperty_SetInputCallback,
                                      kAudioUnitScope_Global,
                                      bus1,
                                      &callbackStruct,
                                      UInt32(MemoryLayout<AURenderCallbackStruct>.size));
        guard status == noErr else {
            return status
        }
        // Initialize the RemoteIO unit
        return AudioUnitInitialize(remoteIOUnit)
    }

    func startAudioToolboxRecording() -> OSStatus {
        guard let remoteIOUnit = remoteIOUnit else {
            return 656783
        }
        return AudioOutputUnitStart(remoteIOUnit)
    }

    func writeDataToFile(audioBuffers: UnsafeMutableBufferPointer<AudioBuffer>) -> OSStatus {
        guard let audioFile = audioFile else {
            return 176136
        }
        var startingByte = self.startingByte
        for audioBuffer in audioBuffers {
            var numBytes = audioBuffer.mDataByteSize
            guard let mData = audioBuffer.mData else {
                continue
            }
            // [1] following call fails with `-38` error (`kAudioFileNotOpenError`). Less often it fails with `1868981823` error (`kAudioFileDoesNotAllow64BitDataSizeError`)
            let audioErr = AudioFileWriteBytes(audioFile,
                                               false,
                                               startingByte,
                                               &numBytes,
                                               mData)
            guard audioErr == noErr else {
                return audioErr
            }
            let data = Data(bytes:  mData, count: Int(numBytes))
            processAudioData?(data)
            startingByte += Int64(numBytes)
        }
        self.startingByte = startingByte
        return noErr
    }

}

private func recordingCallback(
    inRefCon: UnsafeMutableRawPointer,
    ioActionFlags: UnsafeMutablePointer<AudioUnitRenderActionFlags>,
    inTimeStamp: UnsafePointer<AudioTimeStamp>,
    inBusNumber: UInt32,
    inNumberFrames: UInt32,
    ioData: UnsafeMutablePointer<AudioBufferList>?) -> OSStatus {

    guard let remoteIOUnit = Recorder.shared.remoteIOUnit else {
        return 656783
    }
    var status = noErr
    let channelCount: UInt32 = 1
    var bufferList = AudioBufferList()
    bufferList.mNumberBuffers = channelCount
    let buffers = UnsafeMutableBufferPointer<AudioBuffer>(start: &bufferList.mBuffers,
                                                          count: Int(bufferList.mNumberBuffers))
    buffers[0].mNumberChannels = 1
    buffers[0].mDataByteSize = inNumberFrames * 2
    buffers[0].mData = nil
    // get the recorded samples
    // [2] following call fails with `-10863` error (`kAudioUnitErr_CannotDoInCurrentContext`) and less often with `-1` error
    status = AudioUnitRender(remoteIOUnit,
                             ioActionFlags,
                             inTimeStamp,
                             inBusNumber,
                             inNumberFrames,
                             UnsafeMutablePointer<AudioBufferList>(&bufferList))
    guard status == noErr else {
        return status
    }
    status = Recorder.shared.writeDataToFile(audioBuffers: buffers)
    return status
}
6
  • Did you try reproducing the same problem on MacOS target?
    – Kamil.S
    Commented Jan 30, 2018 at 11:59
  • 1
    First question: have you ever reproduced the problem using your code sample? The code shown here never closes the file, so -38 (file not open) is hard to understand. However, the Recorder class is meant to be a singleton (right?), yet it can be instantiated by others. Maybe the code is being misused in your app? The only error that makes any sense is kAudioFileDoesNotAllow64BitDataSizeError, which you would get if your WAV file exceeded 4GB. Is that likely? Commented Jan 30, 2018 at 12:13
  • @Kamil.S no, I didn't reproduce it on iOS and I didn't try it on macOS. How it'll be different (I have more chances to reproduce it on macOS or vice versa)?
    – derpoliuk
    Commented Jan 30, 2018 at 15:53
  • @RhythmicFistman thank you for detailed comment. Data size error - thank you for the tip, 4GB might be the case (but I think it's unlikely), I'll check it. The class is indeed singleton, but it isn't instantiated by others, only .shared method is used.
    – derpoliuk
    Commented Jan 30, 2018 at 17:01
  • @derpoliuk i'm trying to do the same thing but not sure what should be the file extension. could you help?
    – prabhu
    Commented Mar 12, 2021 at 8:58

1 Answer 1

1

Ok I hope this help, I think that the problem is in the speed of recording vs writing vs rendering so you can write with blocks so that you can isolate the methods, I have the same problems with graphics so I always block (lock and unlock buffers).

Working with Blocks

5
  • There are no blocks in Swift, but even if you account for their closures equivalent derpoliuk is clearly relying on AudioToolbox C-level API. Hence the only async part is already visible being the recordingCallback
    – Kamil.S
    Commented Jan 29, 2018 at 13:37
  • Thanks for answer. I struggle to wrap my head around it - do you mean use block-based API? If yes, @Kamil.S is right, I'm relying on C-level APIs in my code.
    – derpoliuk
    Commented Jan 30, 2018 at 11:51
  • 1
    Ok can you please try to disable the rendering and see the result, if it works then try to render less frames, less details or lesser actions. Commented Jan 30, 2018 at 12:02
  • 1
    In games we drop frames to render more details or drop collision detection to maintain frame rate to 30~40 fps, we sacrifice something from another it depend on what is more important ;) Commented Jan 30, 2018 at 12:04
  • @Tarek.Eladly I get it now, thank you. Link to documentation confused me a bit. It makes sense to me to disable processAudioData closure in code to see what happens.
    – derpoliuk
    Commented Jan 30, 2018 at 15:51

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.