&lt;h2&gt;TL;DR&lt;/h2&gt;
I want to convert fMP4 fragments to TS segments (for HLS) as the fragments are being written using FFmpeg on an iOS device.

&lt;h1&gt;Why?&lt;/h1&gt;
I&#39;m trying to achieve live uploading on iOS while maintaining a seamless, HD copy locally. 

&lt;h1&gt;What I&#39;ve tried&lt;/h1&gt;
 1. Rolling `AVAssetWriter`s where each writes for 8 seconds, then concatenating the MP4s together via FFmpeg.

 **What went wrong** - There are blips in the audio and video at times. I&#39;ve identified 3 reasons for this.

 1) Priming frames for audio written by the AAC encoder creating gaps.
 
 2) Since video frames are 33.33ms long, and audio frames 0.022ms long, it&#39;s possible for them to not line up at the end of a file.
 
 3) The lack of frame accurate encoding present on Mac OS, but not available for iOS [Details Here][1]

 
 2. FFmpeg muxing a large video only MP4 file with raw audio into TS segments. The work was based on the [Kickflip SDK][2]

 **What Went Wrong** - Every once in a while an audio only file would get uploaded, with no video whatsoever. Never able to reproduce it in-house, but it was pretty upsetting to our users when they didn&#39;t record what they thought they did. There were also issues with accurate seeking on the final segments, almost like the TS segments were incorrectly time stamped.

&lt;h1&gt;What I&#39;m thinking now&lt;/h1&gt;

Apple was pushing fMP4 at WWDC this year (2016) and I hadn&#39;t looked into it much at all before that. Since an fMP4 file can be read, and played *while* it&#39;s being written, I thought that it would be possible for FFmpeg to transcode the file as it&#39;s being written as well, as long as we hold off sending the bytes to FFmpeg until each fragment within the file is finished.

However, I&#39;m not familiar enough with the FFmpeg C API, I only used it briefly within attempt #2. 

&lt;h1&gt;What I need from you&lt;/h1&gt;
 1. Is this a feasible solution? Is anybody familiar enough with fMP4 to know if I can actually accomplish this?
 2. How will I know that `AVFoundation` has finished writing a fragment within the file so that I can pipe it into FFmpeg?
 3. How can I take data from a file on disk, chunk at a time, pass it into FFmpeg and have it spit out TS segments?


  [1]: https://developer.apple.com/reference/avfoundation/avcapturefileoutputdelegate/1388760-captureoutputshouldprovidesample &quot;Details Here&quot;
  [2]: https://github.com/Kickflip/kickflip-ios-sdk &quot;Kickflip SDK&quot;

Transcoding fMP4 to HLS while writing on iOS using FFmpeg

To play sound even on Silent mode I use to use below method. But how it&#39;s not working.

    // Works on Swift 3  
    do {
        try AVAudioSession.sharedInstance().setCategory(AVAudioSessionCategoryPlayback)
    } catch {
        print(error)
    }

How to get it work in 4.2 / iOS 12?

In newer version we need to set mode and options.

    try AVAudioSession.sharedInstance().setCategory(
        &lt;#T##category:AVAudioSession.Category##AVAudioSession.Category#&gt;,
        mode: &lt;#T##AVAudioSession.Mode#&gt;, 
        options: &lt;#T##AVAudioSession.CategoryOptions#&gt;)`


AVAudioSession setCategory Swift 4.2 iOS 12 - Play Sound on Silent

I have an app that allows a user to record a video with `UIImagePickerController` and then upload it to YouTube. The problem is that the video file that `UIImagePickerController` creates is HUGE, even when the video is only 5 seconds long. For example, a 5 second long video is 16-20 megabytes. I want to keep the video in 540 or 720 quality, but I want to reduce the file size.

I&#39;ve been experimenting with AVFoundation and `AVAssetExportSession` to try to get a smaller file size. I&#39;ve tried the following code:

    AVAsset *video = [AVAsset assetWithURL:videoURL];
    AVAssetExportSession *exportSession = [AVAssetExportSession exportSessionWithAsset:video presetName:AVAssetExportPresetPassthrough];
    exportSession.shouldOptimizeForNetworkUse = YES;
    exportSession.outputFileType = AVFileTypeMPEG4;
    exportSession.outputURL = [pathToSavedVideosDirectory URLByAppendingPathComponent:@&quot;vid1.mp4&quot;];
    [exportSession exportAsynchronouslyWithCompletionHandler:^{
        NSLog(@&quot;done processing video!&quot;);
    }];

But **this hasn&#39;t reduced the file size at all**. I know what I&#39;m doing is possible because in Apple&#39;s Photos app, when you select **&quot;share on YouTube&quot;**, will automatically process the video file so its small enough to upload. I want to do the same thing in my app. 

How can I accomplish this?

How can I reduce the file size of a video created with UIImagePickerController?

When obtaining a UIImage of a video via AVAssetImageGenerator, I&#39;m getting back images rotated (well, technically they&#39;re not) when the video is shot in portrait orientation.  How can I tell what orientation the video was shot and then rotate the image properly?

    AVURLAsset *asset = [[AVURLAsset alloc] initWithURL:url options:nil];
    AVAssetImageGenerator *generate = [[AVAssetImageGenerator alloc] initWithAsset:asset];
    NSError *err = NULL;
    CMTime time = CMTimeMake(0, 60);
    CGImageRef imgRef = [generate copyCGImageAtTime:time actualTime:NULL error:&amp;err];
    [generate release];
    UIImage *currentImg = [[UIImage alloc] initWithCGImage:imgRef];

AVAssetImageGenerator provides images rotated

I am trying to take a screenshot of an `AVPlayer` inside a bigger view. I want to build a testing framework only, so private `APIs` or any method is good, because the framework will not be included when releasing to the AppStore. 

I have tried with using 

 - `UIGetScreenImage()` : works well on simulator but not on device  
 - `snapshotviewafterscreenupdates`: it shows the view but I cannot create a `UIImage` from that.
 - `drawViewInHierarchy` and `renderInContext` will not work with `AVPlayer`   
 - I don&#39;t want to use `AVAssetGenerator` for getting image from video, it is hard to get a good coordinate or the video player as the subview of other views

Screenshot for AVPlayer and Video

I&#39;m having some problems getting a `UIImage` from a `CVPixelBuffer`.  This is what I am trying:

    CVPixelBufferRef pixelBuffer = CMSampleBufferGetImageBuffer(imageDataSampleBuffer);
    CFDictionaryRef attachments = CMCopyDictionaryOfAttachments(kCFAllocatorDefault, imageDataSampleBuffer, kCMAttachmentMode_ShouldPropagate);
    CIImage *ciImage = [[CIImage alloc] initWithCVPixelBuffer:pixelBuffer options:(NSDictionary *)attachments];
    if (attachments)
    	CFRelease(attachments);
    size_t width = CVPixelBufferGetWidth(pixelBuffer);
    size_t height = CVPixelBufferGetHeight(pixelBuffer);
    if (width &amp;&amp; height) { // test to make sure we have valid dimensions
    	UIImage *image = [[UIImage alloc] initWithCIImage:ciImage];
    	
    	UIImageView *lv = [[UIImageView alloc] initWithFrame:self.view.frame];
    	lv.contentMode = UIViewContentModeScaleAspectFill;
    	self.lockedView = lv;
    	[lv release];
    	self.lockedView.image = image;
    	[image release];
    }
    [ciImage release];

`height` and `width` are both correctly set to the resolution of the camera.  `image` is created but I it seems to be black (or maybe transparent?).  I can&#39;t quite understand where the problem is.  Any ideas would be appreciated.

How to turn a CVPixelBuffer into a UIImage?

In the documentation I see several Apple frameworks for audio. All of them seem to be targeted at playing and recording audio. So I wonder what the big differences are between these?

 - Audio Toolbox
 - Audio Unit
 - AV Foundation
 - Core Audio

Did I miss a guide that gives a good overview of all these?

What&#39;s the difference between the Apple audio frameworks?

Before iOS 10 came out I was using the following code to get the video and audio capture for my video recorder:

     for device in AVCaptureDevice.devices()
     {
         if (device as AnyObject).hasMediaType( AVMediaTypeAudio )
         {
             self.audioCapture = device as? AVCaptureDevice
         }
         else if (device as AnyObject).hasMediaType( AVMediaTypeVideo )
         {
             if (device as AnyObject).position == AVCaptureDevicePosition.back
             {
                 self.backCameraVideoCapture = device as? AVCaptureDevice
             }
             else
             {
                 self.frontCameraVideoCapture = device as? AVCaptureDevice
             }
         }
     }

When iOS 10 finally came out, I received the following warning when I was running my code. Note that my video recorder was still working smoothly for about 2 weeks.

&gt; &#39;devices()&#39; was deprecated in iOS 10.0: Use AVCaptureDeviceDiscoverySession instead.

As I was running my code this morning, my video recorder stopped working. xCode8 does not give me any errors but the previewLayer for the camera capture is completely white. When I then start recording I receive the following error:

&gt; Error Domain=AVFoundationErrorDomain Code=-11800 &quot;The operation could not be completed&quot; UserInfo={NSLocalizedDescription=The operation could not be completed, NSUnderlyingError=0x17554440 {Error Domain=NSOSStatusErrorDomain Code=-12780 &quot;(null)&quot;}, NSLocalizedFailureReason=An unknown error occurred (-12780)}

I believe that has something to do with the fact that I am using the deprecated approach `AVCaptureDevice.devices()`. Hence, I was wondering how to use `AVCaptureDeviceDiscoverySession ` instead?

Thank you for your help in advance!

How to get front camera, back camera and audio with AVCaptureDeviceDiscoverySession

How can the iPhone be set to vibrate once?

For example, when a player loses a life or the game is over, the iPhone should vibrate.


Making the iPhone vibrate

I would like to play a sound using Swift.

My code worked in Swift 1.0 but now it doesn&#39;t work anymore in Swift 2 or newer.
  
    override func viewDidLoad() {
      super.viewDidLoad()

      let url:NSURL = NSBundle.mainBundle().URLForResource(&quot;soundName&quot;, withExtension: &quot;mp3&quot;)!

      do { 
        player = try AVAudioPlayer(contentsOfURL: url, fileTypeHint: nil) 
      } catch _{
        return
      }

      bgMusic.numberOfLoops = 1
      bgMusic.prepareToPlay()

      if (Data.backgroundMenuPlayed == 0){
        player.play()
        Data.backgroundMenuPlayed = 1
      }
    }

How to play a sound using Swift?

I have a serious problem: I have an `NSArray` with several `UIImage` objects. What I now want to do, is create movie from those `UIImages`. But I don&#39;t have any idea how to do so.

I hope someone can help me or send me a code snippet which does something like I want.

**Edit:** For future reference - After applying the solution, if the video looks distorted, make sure the width of the images/area you are capturing is a multiple of 16. Found after many hours of struggle here:  
https://stackoverflow.com/questions/9691646/why-does-my-movie-from-uiimages-gets-distorted?rq=1

Here is the complete solution (just ensure width is multiple of 16)  
http://codethink.no-ip.org/wordpress/archives/673




How do I export UIImage array as a movie?

How do you play a video with AV Kit Player View Controller in Swift?


    override func viewDidLoad() {
            super.viewDidLoad()
            let videoURLWithPath = &quot;http://****/5.m3u8&quot;
            let videoURL = NSURL(string: videoURLWithPath)
            playerViewController = AVPlayerViewController()

            dispatch_async(dispatch_get_main_queue()) {
                self.playerViewController?.player = AVPlayer.playerWithURL(videoURL) as AVPlayer
            }
        }

How to play video with AVPlayerViewController (AVKit) in Swift

Is there a relatively easy way of looping a video in AVFoundation?  

I&#39;ve created my AVPlayer and AVPlayerLayer like so:

    avPlayer = [[AVPlayer playerWithURL:videoUrl] retain];
    avPlayerLayer = [[AVPlayerLayer playerLayerWithPlayer:avPlayer] retain];

    avPlayerLayer.frame = contentView.layer.bounds;
    [contentView.layer addSublayer: avPlayerLayer];

and then I play my video with:

    [avPlayer play];

The video plays fine but stops at the end.  With the MPMoviePlayerController all you have to do is set its `repeatMode` property to the right value.  There doesn&#39;t appear to be a similar property on AVPlayer.  There also doesn&#39;t seem to be a callback that will tell me when the movie has finished so I can seek to the beginning and play it again.

I&#39;m not using MPMoviePlayerController because it has some serious limitations.  I want to be able to play back multiple video streams at once.


Looping a video with AVFoundation AVPlayer?

Is there a way to know whether an `AVPlayer` playback has stalled or reached the end?

Check play state of AVPlayer

I have just updated to Xcode 7 and swift 2 and finished fixing the errors that come with the transition. I finally got the project to build, but after the launch screen I get an error saying:

&gt; dyld: Library not loaded: @rpath/libswiftAVFoundation.dylib   Referenced from: /var/mobile/Containers/Bundle/Application/...  
&gt; Reason: no suitable image found.  Did find:
&gt; 	/private/var/mobile/Containers/Bundle/Application/.../Frameworks/libswiftAVFoundation.dylib:
&gt; mmap() errno=1 validating first page of
&gt; &#39;/private/var/mobile/Containers/Bundle/Application/.../Frameworks/libswiftAVFoundation.dylib&#39;


I have seen this error before but with other frameworks, and can&#39;t solve my issue. Is there a way to bypass this by adding my framework somewhere?

dyld: Library not loaded: @rpath/libswiftAVFoundation.dylib

I am trying to capture an image during a live preview from the camera, by AVFoundation [captureStillImageAsynchronouslyFromConnection][1]. So far the program works as expected. However, how can I mute the shutter sound? 


  [1]: https://developer.apple.com/documentation/avfoundation/avcapturestillimageoutput/1387374-capturestillimageasynchronously

AVFoundation, how to turn off the shutter sound when captureStillImageAsynchronouslyFromConnection?

There are a lot of questions about this problem on SO:

- https://stackoverflow.com/questions/4401232/avfoundation-how-to-turn-off-the-shutter-sound-when-capturestillimageasynchrono
- https://stackoverflow.com/questions/9557081/how-can-i-mute-the-capture-sound-in-avfoundation
- https://stackoverflow.com/questions/17040309/i-wish-i-could-mute-shutter-sound-of-camera-using-ios-sdk

But really no one answer works for me.

How do I capture an image programmatically without the camera shutter sound activating?

Capture image via captureStillImageAsynchronouslyFromConnection with no shutter sound

I&#39;m trying to play an `MP3` file that is passed to an `UIView` from a previous `UIView` (stored in a `NSURL *fileURL` variable).

I&#39;m initializing an `AVPlayer` with:

    player = [AVPlayer playerWithURL:fileURL];
    
    NSLog(@&quot;Player created:%d&quot;,player.status);

The `NSLog` prints `Player created:0,` which i figured means it is not ready to play yet.

When i click the play `UIButton`, the code i run is:

    -(IBAction)playButtonClicked
    {
    	NSLog(@&quot;Clicked Play. MP3:%@&quot;,[fileURL absoluteString]);
    	
    	if(([player status] == AVPlayerStatusReadyToPlay) &amp;&amp; !isPlaying)
    //	if(!isPlaying)
    	{
    		[player play];
    		NSLog(@&quot;Playing:%@ with %d&quot;,[fileURL absoluteString], player.status);
    		isPlaying = YES;
    	}
    	else if(isPlaying)
    	{
    
    		[player pause];
    		NSLog(@&quot;Pausing:%@&quot;,[fileURL absoluteString]);
    		isPlaying = NO;
    	}
    	else {
    		NSLog(@&quot;Error in player??&quot;);
    	}
    	
    }

When i run this, I always get `Error in player??` in the console.
If i however replace the `if` condition that checks if `AVPlayer` is ready to play, with a simple `if(!isPlaying)`..., then the music plays the SECOND TIME I click on the play `UIButton`.

The console log is:

    Clicked Play. MP3:http://www.nimh.nih.gov/audio/neurogenesis.mp3
    Playing:http://www.nimh.nih.gov/audio/neurogenesis.mp3 **with 0**

    Clicked Play. MP3:http://www.nimh.nih.gov/audio/neurogenesis.mp3
    Pausing:http://www.nimh.nih.gov/audio/neurogenesis.mp3

    Clicked Play. MP3:http://www.nimh.nih.gov/audio/neurogenesis.mp3
    2011-03-23 11:06:43.674 Podcasts[2050:207] Playing:http://www.nimh.nih.gov/audio/neurogenesis.mp3 **with 1**


I see that the SECOND TIME, the `player.status` seems to hold 1, which I&#39;m guessing is `AVPlayerReadyToPlay`.

What can I do to have the playing to work properly the first time i click the play `UIButton`?
(ie, how can i make sure the `AVPlayer` is not just created, but also ready to play?)

Knowing when AVPlayer object is ready to play

I am developing an iPhone application that needs to play videos. 
So far, I learned that there are at least two API&#39;s for achieving this; `AVPlayer` and `MPMoviePlayerController`.

What are the main differences?



AVPlayer and MPMoviePlayerController differences

I&#39;m working on an application where there is a collection view, and cells of the collection view can contain video. Right now I&#39;m displaying the video using `AVPlayer` and `AVPlayerLayer`. Unfortunately, the scrolling performance is terrible. It seems like `AVPlayer`, `AVPlayerItem`, and `AVPlayerLayer` do a lot of their work on the main thread. They are constantly taking out locks, waiting on semaphores, etc. which is blocking the main thread and causing severe frame drops.

Is there any way to tell `AVPlayer` to stop doing so many things on the main thread? So far nothing I&#39;ve tried has solved the problem.

I also tried building a simple video player using `AVSampleBufferDisplayLayer`. Using that I can make sure that everything happens off the main thread, and I can achieve ~60fps while scrolling and playing video. Unfortunately that method is much lower level, and it doesn&#39;t provide things like audio playback and time scrubbing out of the box. Is there any way to get similar performance with `AVPlayer`? I&#39;d much rather use that.

**Edit:**
After looking into this more, it doesn&#39;t look like it&#39;s possible to achieve good scrolling performance when using `AVPlayer`. Creating an `AVPlayer` and associating in with an `AVPlayerItem` instance kicks off a bunch of work which trampolines onto the main thread where it then waits on semaphores and tries to acquire a bunch of locks. The amount of time this stalls the main thread increases quite dramatically as the number of videos in the scrollview increases.

`AVPlayer` dealloc also seems to be a huge problem. Dealloc&#39;ing an `AVPlayer` also tries to synchronize a bunch of stuff. Again, this gets extremely bad as you create more players.

This is pretty depressing, and it makes `AVPlayer` almost unusable for what I&#39;m trying to do. Blocking the main thread like this is such an amateur thing to do so it&#39;s hard to believe Apple engineers would&#39;ve made this kind of mistake. Anyways, hopefully they can fix this soon.

Maintaining good scroll performance when using AVPlayer

My app is landscape only. I&#39;m presenting the AVCaptureVideoPreviewLayer like this:

    self.previewLayer = [[AVCaptureVideoPreviewLayer alloc] initWithSession:session];
    [self.previewLayer setBackgroundColor:[[UIColor blackColor] CGColor]];
    [self.previewLayer setVideoGravity:AVLayerVideoGravityResizeAspect];                    
    NSLog(@&quot;previewView: %@&quot;, self.previewView);
	CALayer *rootLayer = [self.previewView layer];
	[rootLayer setMasksToBounds:YES];
	[self.previewLayer setFrame:[rootLayer bounds]];
        NSLog(@&quot;previewlayer: %f, %f, %f, %f&quot;, self.previewLayer.frame.origin.x, self.previewLayer.frame.origin.y, self.previewLayer.frame.size.width, self.previewLayer.frame.size.height);
	[rootLayer addSublayer:self.previewLayer];
	[session startRunning];

                

self.previewView has a frame of (0,0,568,320), which is correct. self.previewLayer logs a frame of (0,0,568,320), which is theoretically correct. However, the camera display appears as a portrait rectangle in the middle of the landscape screen, and the orientation of the camera preview image is wrong by 90 degrees. What am I doing wrong? I need the camera preview layer to appear in the full screen, in landscape mode, and the image should be orientated correctly.






AVCaptureVideoPreviewLayer orientation - need landscape

As you see I&#39;m streaming an audio broadcast. But when I press the home button and exit the app streaming stops or I cannot hear. How can I continue streaming in background and listen it from lock screen?

ViewController.Swift


    import UIKit
    import AVFoundation
    import MediaPlayer
    import GoogleMobileAds
    
    
        class ViewController: UIViewController, GADInterstitialDelegate {
        
            @IBOutlet weak var exitMapButton: UIButton!
            @IBOutlet weak var radarMap: UIWebView!
            var interstitial: GADInterstitial!
            func createAndLoadInterstitial() -&gt; GADInterstitial {
                var interstitial = GADInterstitial(adUnitID: &quot;adUnitID-XXXX&quot;)
                interstitial.delegate = self
                interstitial.loadRequest(GADRequest())
                return interstitial
            }
            
            func getAd(){
                if (self.interstitial.isReady)
                {
                    self.interstitial.presentFromRootViewController(self)
                    self.interstitial = self.createAndLoadInterstitial()
                }
            }
            @IBOutlet weak var ataturkButton: UIButton!
            @IBOutlet weak var sabihaButton: UIButton!
            @IBOutlet weak var esenbogaButton: UIButton!
            @IBOutlet weak var weatherButton: UIButton!
            @IBOutlet weak var statusLabel: UILabel!
            @IBOutlet weak var playButton: UIButton!
            @IBOutlet weak var webViewButton: UIButton!
            var googleBannerView: GADBannerView!
    override func viewDidLoad() {
                super.viewDidLoad()
            }
    class PlayerAv {
                var audioLink: String?
                var player: AVPlayer
                init(link: String) {
                    self.audioLink = link
                    self.player = AVPlayer(URL: NSURL(string: link))
                }
            }
            var myPlayer = PlayerAv(link: &quot;http://somewebsite.com/abc.pls&quot;)
            var setTowerState = &quot;&quot;
            
            @IBAction func sliderValueChanged(sender: UISlider) {
                var currentValue = Float(sender.value)
                println(currentValue)
                myPlayer.player.volume = currentValue
            }
            @IBAction func getWeatherWindow(sender: AnyObject) {
                UIApplication.sharedApplication().openURL(NSURL(string: &quot;http://somewebpage.com&quot;)!)
                println(&quot;Directed to weather page&quot;)
            }
            @IBAction func changeToAtaturk() {
                myPlayer.player.pause()
                myPlayer = PlayerAv(link: &quot;http://somewebsite.com/abc.pls&quot;)
                myPlayer.audioLink == &quot;&quot;
                println(&quot;\(myPlayer.audioLink!)--a&quot;)
                playButton.setTitle(&quot;Pause&quot;, forState: UIControlState.Normal)
                myPlayer.player.play()
                setTowerState = &quot;ataturk&quot;
                statusLabel.text = &quot;Status: Playing, LTBA&quot;
            }
            @IBAction func changeToEsenboga() {
                myPlayer.player.pause()
                myPlayer = PlayerAv(link: &quot;http://somewebsite.com/def.pls&quot;)
                println(&quot;\(myPlayer.audioLink!)--a&quot;)
                playButton.setTitle(&quot;Pause&quot;, forState: UIControlState.Normal)
                myPlayer.player.play()
                setTowerState = &quot;esenboga&quot;
                statusLabel.text = &quot;Status: Playing, LTAC&quot;
            }
            @IBAction func changeToSabiha() {
                myPlayer.player.pause()
                myPlayer = PlayerAv(link: &quot;http://somewebsite.com/efg.pls&quot;)
                println(&quot;\(myPlayer.audioLink!)--a&quot;)
                playButton.setTitle(&quot;Pause&quot;, forState: UIControlState.Normal)
                myPlayer.player.play()
                setTowerState = &quot;sabiha&quot;
                statusLabel.text = &quot;Status: Playing, LTFJ&quot;
            }
            override func didReceiveMemoryWarning() {
                super.didReceiveMemoryWarning()
                // Dispose of any resources that can be recreated.
            }
            @IBAction func playButtonPressed(sender: AnyObject) {
                toggle()
            }
            func toggle() {
                if playButton.titleLabel?.text == &quot;Play&quot; {
                    playRadio()
                    println(&quot;Playing&quot;)
                    statusLabel.text = &quot;Status: Playing&quot;
                } else {
                    pauseRadio()
                    println(&quot;Paused&quot;)
                    statusLabel.text = &quot;Status: Paused&quot;
                }
            }
            func playRadio() {
                myPlayer.player.play()
                playButton.setTitle(&quot;Pause&quot;, forState: UIControlState.Normal)   
            }
            func pauseRadio() {
                myPlayer.player.pause()
                playButton.setTitle(&quot;Play&quot;, forState: UIControlState.Normal)
            }
        }

How to play audio in background with Swift?

I&#39;m using `AVPlayer` for a radio app using HTTP live streaming. Now I want to implement a level meter for that audio stream. The very best would a level meter showing the different frequencies, but a simple left / right solution would be a great starting point.

I found several examples using `AVAudioPlayer`. But I cannot find a solution for getting the required informations off `AVPlayer`.

Can someone think of a solution for my problem?

**EDIT** I want to create something like this (but nicer)

![nice levelmeter][1]

**EDIT II**

One suggestion was to use `MTAudioProcessingTap` to get the raw audio data. The examples I could find using the `[[[_player currentItem] asset] tracks]` array, which is, in my case, an empty array. Another suggestion was to use `[[_player currentItem] audioMix]` which is `null` for me.

**EDIT III**

After *years* already, there still not seems to be a solution. I did indeed make progress, so I&#39;m sharing it.

During setup, I&#39;m adding a key-value observer to the playerItem:

    [[[self player] currentItem] addObserver:self forKeyPath:@&quot;tracks&quot; options:kNilOptions context:NULL];
    
    //////////////////////////////////////////////////////

    - (void)observeValueForKeyPath:(NSString *)keyPath ofObject:(id)object change:(NSDictionary *)changecontext:(void *)context
        if ([keyPath isEqualToString:@&quot;tracks&quot;] &amp;&amp; [[object tracks] count] &gt; 0) {
            for (AVPlayerItemTrack *itemTrack in [object tracks]) {
                AVAssetTrack *track = [itemTrack assetTrack];
                
                if ([[track mediaType] isEqualToString:AVMediaTypeAudio]) {
                    [self addAudioProcessingTap:track];
                    break;
                }
            }
    }

    - (void)addAudioProcessingTap:(AVAssetTrack *)track {
        MTAudioProcessingTapRef tap;
        MTAudioProcessingTapCallbacks callbacks;
        callbacks.version = kMTAudioProcessingTapCallbacksVersion_0;
        callbacks.clientInfo = (__bridge void *)(self);
        callbacks.init = init;
        callbacks.prepare = prepare;
        callbacks.process = process;
        callbacks.unprepare = unprepare;
        callbacks.finalize = finalise;

        // more tap setup...
                
        AVMutableAudioMix *audioMix = [AVMutableAudioMix audioMix];
        
        AVMutableAudioMixInputParameters *inputParams = [AVMutableAudioMixInputParameters audioMixInputParametersWithTrack:audioTrack];
        [inputParams setAudioTapProcessor:tap];
        [audioMix setInputParameters:@[inputParams]];
        
        [[[self player] currentItem] setAudioMix:audioMix];
    }

So far so good. This all works, I could find the right track and setup the inputParams and audioMix etc.
But unfortunately the only callback, that gets called is the init callback. None of the others will fire at any point.

I tried different (kinds of) stream sources, one of them an official Apple HLS stream: http://devimages.apple.com/iphone/samples/bipbop/bipbopall.m3u8

  [1]: http://i.stack.imgur.com/zQEmK.gif

AVPlayer HLS live stream level meter (Display FFT Data)

    AVCaptureVideoPreviewLayer *avLayer = 
                    [AVCaptureVideoPreviewLayer layerWithSession:session];
    avLayer.frame = self.view.frame;
    [self.view.layer addSublayer:avLayer];

I use AVCaptureVideoPreviewLayer to display video on the view.
But the video&#39;s view didn&#39;t fill up the full iPhone4&#39;s screen.(two grey bar at the right&amp;left side)

I want the video fills up full screen.
How can I deal with it? Thank you very much!

![enter image description here][1]


  [1]: http://i.stack.imgur.com/9fkW9.png


AVCaptureVideoPreviewLayer doesn&#39;t fill up whole iPhone 4S Screen

I&#39;m working on an iOS application that needs to play some sounds using the `AVFoundation` framework. The workspace structure in Xcode 4 contains two projects:

- Workspace
  - The application itself (main project)
  - A utility library

After building the utility library, it results in a static library which is used in the main application as a framework.

So, when trying to play a sound inside the main application by using the code below, it works as expected.

    NSString *resourcePath = [[NSBundle mainBundle] resourcePath];
    NSString *path = [NSString stringWithFormat:@&quot;%@/sound.mp3&quot;, resourcePath];

    NSURL *url = [NSURL fileURLWithPath:path];
    NSError *error = nil;

    AVAudioPlayer *audioPlayer = [[AVAudioPlayer alloc] initWithContentsOfURL:url
                                                                        error:&amp;error];
    [audioPlayer play];

In contrast, when trying to play exactly the same sound (or any other) inside the utility library using the same code as above, no sound is played at all, even though error is _nil_ and the _audioPlayer_ property values are the right ones (number of channels, duration).

I&#39;ve made sure the `AVFoundation` framework is in both projects.

Also, my class uses the `AVAudioPlayerDelegate` protocol and implements these two methods:

    - (void)audioPlayerDidFinishPlaying:(AVAudioPlayer *)player successfully:(BOOL)flag;
    - (void)audioPlayerDecodeErrorDidOccur:(AVAudioPlayer *)player error:(NSError *)error;

None of these methods is called after trying to play the sound.

If I use the `AudioToolbox` framework instead, then it plays the sound. But I&#39;m interested in using `AVFoundation` for several reasons.

Any idea of what is going on? Am I missing something about `AVFoundation`? Could it be related to using `AVAudioPlayer` from inside a static library?

Thanks in advance.


AVAudioPlayer not playing any sound

Is it possible to use the existing Apple system sounds in my own app? I would like to write a sample app in Swift that does the following steps:

1. Read/Get a list of all available systemSounds on the device (I think they are located in `/System/Library/Audio/UISounds/`)
2. show the list on the screen
3. if I touch a list item, play these sound

So its basically the same, like when you choose a new ringtone on your iPhone.

I think some apps are using this sounds, or have they copied/bought it?

Thanks and regards
Jens

All Avfoundation Solutions on Gang of Coders

Total of 26 Avfoundation Solutions