41

How to live stream videos from iPhone to server like Ustream or Qik? I know there's something called Http Live Streaming from Apple, but most resources I found only talks about streaming videos from server to iPhone.

Is Apple's Http Living Streaming something I should use? Or something else? Thanks.

2
  • 2
    They're not using HTTP Live Streaming. All of the recently approved apps are actually using a private API for capturing the screen. Almost inexplicably, Apple reversed the policy on this specific set of CoreGraphics calls and allowed these apps in. Expect a true API for this feature in a future iPhone OS release - these apps will be required to use that when it is available. In the meantime, these currently private calls are okay.
    – Hunter
    Dec 25, 2009 at 16:19
  • Hi, I found that we might need a media server like Wowza to allow RTSP streaming, but you can also do something similar without using RTSP by HTTP. I am a bit clueless on this topic now actually, correct me if I am wrong. I understand that people use private API for capturing the screen, but what does it have to do with streaming them to the server? Thanks!
    – 0pcl
    Dec 28, 2009 at 1:16

3 Answers 3

46

There isn't a built-in way to do this, as far as I know. As you say, HTTP Live Streaming is for downloads to the iPhone.

The way I'm doing it is to implement an AVCaptureSession, which has a delegate with a callback that's run on every frame. That callback sends each frame over the network to the server, which has a custom setup to receive it.

Here's the flow: https://developer.apple.com/library/content/documentation/AudioVideo/Conceptual/AVFoundationPG/Articles/04_MediaCapture.html#//apple_ref/doc/uid/TP40010188-CH5-SW2

And here's some code:

// make input device
NSError *deviceError;
AVCaptureDevice *cameraDevice = [AVCaptureDevice defaultDeviceWithMediaType:AVMediaTypeVideo];
AVCaptureDeviceInput *inputDevice = [AVCaptureDeviceInput deviceInputWithDevice:cameraDevice error:&deviceError];

// make output device
AVCaptureVideoDataOutput *outputDevice = [[AVCaptureVideoDataOutput alloc] init];
[outputDevice setSampleBufferDelegate:self queue:dispatch_get_main_queue()];

// initialize capture session
AVCaptureSession *captureSession = [[[AVCaptureSession alloc] init] autorelease];
[captureSession addInput:inputDevice];
[captureSession addOutput:outputDevice];

// make preview layer and add so that camera's view is displayed on screen
AVCaptureVideoPreviewLayer *previewLayer = [AVCaptureVideoPreviewLayer layerWithSession:captureSession];
previewLayer.frame = view.bounds;
[view.layer addSublayer:previewLayer];

// go!
[captureSession startRunning];

Then the output device's delegate (here, self) has to implement the callback:

-(void) captureOutput:(AVCaptureOutput*)captureOutput didOutputSampleBuffer:(CMSampleBufferRef)sampleBuffer fromConnection:(AVCaptureConnection*)connection
{
    CVImageBufferRef imageBuffer = CMSampleBufferGetImageBuffer( sampleBuffer );
    CGSize imageSize = CVImageBufferGetEncodedSize( imageBuffer );
    // also in the 'mediaSpecific' dict of the sampleBuffer

   NSLog( @"frame captured at %.fx%.f", imageSize.width, imageSize.height );
}

EDIT/UPDATE

Several people have asked how to do this without sending the frames to the server one by one. The answer is complex...

Basically, in the didOutputSampleBuffer function above, you add the samples into an AVAssetWriter. I actually had three asset writers active at a time -- past, present, and future -- managed on different threads.

The past writer is in the process of closing the movie file and uploading it. The current writer is receiving the sample buffers from the camera. The future writer is in the process of opening a new movie file and preparing it for data. Every 5 seconds, I set past=current; current=future and restart the sequence.

This then uploads video in 5-second chunks to the server. You can stitch the videos together with ffmpeg if you want, or transcode them into MPEG-2 transport streams for HTTP Live Streaming. The video data itself is H.264-encoded by the asset writer, so transcoding merely changes the file's header format.

15
  • I should add that I'm not doing it this way anymore, since frame-by-frame upload turned out to be too slow for me. But if you're looking for a way to edit frames as they come in from the device's camera, this is it.
    – jab
    Dec 20, 2011 at 0:17
  • 3
    Can you please share/assist code for uploading video mechanism which is not slow as you mentioned ? Any hint please ? Jan 25, 2012 at 9:35
  • 2
    Well, to speed up the data transfer, the video has to be compressed. So, two possibilities: 1) Compress it on the fly, requiring a codec library plus lots of CPU; or 2) Use the iPhone's built-in, hardware-accelerated mp4 compression -- but that only supports streaming to disk. I am streaming to disk, changing target files every few seconds and uploading the finished files. It's very tricky and complex, even without the workarounds for several Apple bugs I found. You can't easily use a single file as a pipe, because the frame index doesn't get written until the file is closed.
    – jab
    Feb 14, 2012 at 7:30
  • @NoMoreWishes My list of solutions above is stated a different way in this answer.
    – jab
    Feb 14, 2012 at 7:45
  • 2
    @kashifmehmood I think you're talking about downloading (i.e., watching videos)? This question is about getting the videos from an iPhone to a server. What you do with your videos once they're on the server is a separate topic.
    – jab
    Nov 11, 2013 at 16:11
3

I have found one library that will help you on this.

HaishinKit Streaming Library

Above Library is giving you all option streaming Via RTMP or HLS.

Just follow this library given step and read it all instruction carefully. Please don't direct run example code given in this library it is having some error instead of that get required class and pod into your demo app.

I have just done it with this you can record screen, Camera and Audio.

2
  • What kind of latency do you experience with this approach? Say from the instant the image is captured to when it is received by the app and when it is sent to the server? Oct 25, 2021 at 3:17
  • I have used this for Screen Record and create m3u8 file.@zr0gravity7 Dec 10, 2021 at 4:51
-4

I'm not sure you can do that with HTTP Live Streaming. HTTP Live Streaming segments the video in 10 secs (aprox.) length, and creates a playlist with those segments. So if you want the iPhone to be the stream server side with HTTP Live Streaming, you will have to figure out a way to segment the video file and create the playlist.

How to do it is beyond my knowledge. Sorry.

1
  • Streaming media involves four steps: (1) encoding the data from hardware, (2) transferring the data to a server, (3) transcoding the data to the right downstream format, (4) downloading, decoding and playing the data. The question is about step 2. Your answer concerns step 3. Dec 10, 2015 at 18:22

Your Answer

Reminder: Answers generated by Artificial Intelligence tools are not allowed on Stack Overflow. Learn more

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.