Recherche avancée

Sur d’autres sites (1965)

• avformat_open_input fails intermittently with avfoundation due to "audio format is not supported"

  27 septembre 2019, par NaderNader

  My application uses the ffmpeg APIs (avformat, avdevice, etc) to open a selected audio input for encoding. For some inputs I can reliably open them the first time, but when I close and reopen that input later, the avformat_open_input() call fails due to "audio format is not supported". My testing shows that it never fails the first time after starting my, and has only about a 50% chance of success when reopening.

  The failure only occurs with my "Built-in Microphone" audio input. I have a USB audio card that reliably opens and closes repeatedly. I have read the documentation and see that the proper way to free the resources after opening is to call avformat_close_input. The only way I have found to guarantee success is to only open the input once.

  I have written a test program to recreate these failures.

  int main() {
  
  
  
      avdevice_register_all();
  
  
  
      cout << "Running open audio test" << endl;
  
  
  
  
  
      int i;
  
      for(i = 0; i< 10; i++) {
  
  
  
          AVDictionary* options = NULL;
  
          AVInputFormat* inputFormat = av_find_input_format("avfoundation");
  
          if (!inputFormat) {
  
              cout << "avfoundation inputFormat=null" << endl;
  
          }
  
  
  
          AVFormatContext* formatContext = avformat_alloc_context();
  
          int result = avformat_open_input(&formatContext, ":1", inputFormat, &options);
  
          if (result < 0) {
  
              char error[256];
  
              av_strerror(result, error, sizeof(error));
  
              cout << "result=" << result << " " << error << endl;
  
          } else {
  
              cout << "input opened successfully" << endl;
  
          }
  
  
  
          sleep(1);
  
  
  
          avformat_close_input(&formatContext);
  
  
  
          sleep(1);
  
  
  
      }
  
  
  
      return 0;
  
  }

  I would expect the main loop to succeed each time but a typical output shows a high failure rate :

  Running open audio test

  input opened successfully
  
  [avfoundation @ 0x7fdeb281de00] audio format is not supported
  
  result=-5 Input/output error
  
  [avfoundation @ 0x7fdeb2001400] audio format is not supported
  
  result=-5 Input/output error
  
  [avfoundation @ 0x7fdeb2001400] audio format is not supported
  
  result=-5 Input/output error
  
  input opened successfully
  
  input opened successfully
  
  input opened successfully
  
  [avfoundation @ 0x7fdeb2068800] audio format is not supported
  
  result=-5 Input/output error
  
  input opened successfully
  
  input opened successfully

  I have tried increasing the sleep time between close and open to 5 seconds, but saw no difference in behavior.

  The source of the failure is https://github.com/FFmpeg/FFmpeg/blob/master/libavdevice/avfoundation.m#L672

  It appears avfoundation.m internally is opening an input stream and grabbing an audio frame to determine the format, but the value returned is not valid sometimes, when the process has previously opened and closed that input.

  Am I not closing the resources properly ? Do I have a hardware issue specific to my macbook ?

  Additional Details :

  Tested MacBook Pro with MacOS Mojave 10.14.6
  Tested with Ffmpeg 3.4.1, 4.0, and 4.1

  list_devices :

  [AVFoundation input device @ 0x7f80fff066c0] AVFoundation video devices:
  
  [AVFoundation input device @ 0x7f80fff066c0] [0] FaceTime HD Camera
  
  [AVFoundation input device @ 0x7f80fff066c0] [1] Capture screen 0
  
  [AVFoundation input device @ 0x7f80fff066c0] AVFoundation audio devices:
  
  [AVFoundation input device @ 0x7f80fff066c0] [0] Behringer Duplex
  
  [AVFoundation input device @ 0x7f80fff066c0] [1] Built-in Microphone
  
  [AVFoundation input device @ 0x7f80fff066c0] [2] USB Audio CODEC

• Why does an "ffmpeg fail" occur when trying to export frames from my "data_src.mp4" file, while using DeepFaceLab ?

  28 août 2020, par Toby Ryberg

  I've been following this step-by-step videoin installing and using DeepFaceLab on my Macbook Pro, which uses OS Catalina. I've been stuck at the step which begins at the 4:42 mark, where he enters this code :

  


  python main.py videoed extract-video —input-file WORKSPACE/data_src.mp4 —output-dir WORKSPACE/data_src

  


  After entering the command, I'm prompted to enter an FPS value ; no problem. Next, it asks for a file output type, which is where I get tied up— as far as I know. It appears as though I can enter either png or jpeg, but receive the same error message, which looks like this :

  


  / !\ ffmpeg fail, job commandline :['ffmpeg', '-i', '/Users/tobyryberg/Documents/deepfakes/DeepFaceLab/WORKSPACE/data_src.mp4', '-pix_fmt', 'rgb24', '/Users/tobyryberg/Documents/deepfakes/DeepFaceLab/WORKSPACE/data_src/%5d.png']

  


  I have no idea what went wrong, as I BELIEVE that I have been doing everything right thus far. If this is at all necessary information, I've opted to use an 18+ minute long video for my source clip, which is an .mp4 file, without audio. If there's someone out there who has the patience to work with me and figure out what went wrong, I'll be forever grateful !

  


• What are good settings for transcoding videos uploaded to my app ?

  14 mai 2020, par Dmitry Minkovsky

  I am working on an app that allows users to share videos. The problem is that many videos are very high bitrate. For example, A 4-minute H264 video from an old iPhone is encoded at 1080p and runs 17,000 kb/s ( 500 megabytes). Accepting and distributing such videos at this bitrate/resolution is not practical for a social application.

  



  I have been playing with ffmpeg to transcode videos to smaller sizes and higher compression, but have not achieved acceptable results. For example :

  



  ffmpeg \
    -i in.mov \
    -vf scale=w='if(gt(iw\,ih)\,780\,-2)':h='if(gt(iw\,ih)\,-2\,780)' \ 
    -c:v libx264 \
    -crf 28 \
    -preset medium \
    -pix_fmt yuv420p \
    -movflags +faststart \
    out.mp4


  



  This command transcodes the above-mentioned 500MB file down to 70MB. It scales the larger dimension of the video to 780 pixels and compresses the video quite a bit. The results are okay, but the file is still large.

  



  Taking the longer dimension down to 480 pixels, the file is reduced to 40MB. Still quite large, and now significantly degraded. Also, the transcoding still takes quite a long time : about 1-1.5x on my 4 year old i7 Macbook Pro with 16GB RAM.

  



  I'm not sure how to improve on this. H265 is not supported in browsers. I am wondering :

  



  

  • How can I reduce size further ?

  


  • How can I transcode faster than 1x without significantly reducing quality ? Even 2-3x doesn't seem great ?

  


  



  Is this as good as it gets ?