Recherche avancée

Sur d’autres sites (10537)

• Audio stuttering every couple of seconds

  27 juin 2019, par Glutch

  I’m merging a video (recorded with ffmpeg, good quality, all solid), with a musicfile.mp3. However every couple of seconds the music stutters and skips slightly. Which seems very strange since simply adding music on top of a video sounds like the engine could relax and take its time, creating no artifacts. (In comparison to recording live desktop footage). Can anyone help me sort this out ?

  System : MacOS MBP 2015, 16gb ram 2.7ghz i5

  ffmpeg -i "temp/1561246948349.mkv" -i "music/happy.mp3" -vcodec copy -filter_complex amix -map 0:v -map 0:a -map 1:a -shortest -b:a 144k "finished/2019-06-22/1561246948349/output.mkv"
  
  ffmpeg version 4.1.3 Copyright (c) 2000-2019 the FFmpeg developers
  
    built with Apple LLVM version 10.0.1 (clang-1001.0.46.4)
  
    configuration: --prefix=/usr/local/Cellar/ffmpeg/4.1.3_1 --enable-shared --enable-pthreads --enable-version3 --enable-hardcoded-tables --enable-avresample --cc=clang --host-cflags='-I/Library/Java/JavaVirtualMachines/adoptopenjdk-11.0.2.jdk/Contents/Home/include -I/Library/Java/JavaVirtualMachines/adoptopenjdk-11.0.2.jdk/Contents/Home/include/darwin' --host-ldflags= --enable-ffplay --enable-gnutls --enable-gpl --enable-libaom --enable-libbluray --enable-libmp3lame --enable-libopus --enable-librubberband --enable-libsnappy --enable-libtesseract --enable-libtheora --enable-libvorbis --enable-libvpx --enable-libx264 --enable-libx265 --enable-libxvid --enable-lzma --enable-libfontconfig --enable-libfreetype --enable-frei0r --enable-libass --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable-librtmp --enable-libspeex --enable-videotoolbox --disable-libjack --disable-indev=jack --enable-libaom --enable-libsoxr
  
    libavutil      56. 22.100 / 56. 22.100
  
    libavcodec     58. 35.100 / 58. 35.100
  
    libavformat    58. 20.100 / 58. 20.100
  
    libavdevice    58.  5.100 / 58.  5.100
  
    libavfilter     7. 40.101 /  7. 40.101
  
    libavresample   4.  0.  0 /  4.  0.  0
  
    libswscale      5.  3.100 /  5.  3.100
  
    libswresample   3.  3.100 /  3.  3.100
  
    libpostproc    55.  3.100 / 55.  3.100
  
  Input #0, matroska,webm, from 'temp/1561246948349.mkv':
  
    Metadata:
  
      ENCODER         : Lavf58.20.100
  
    Duration: 00:00:21.50, start: 0.000000, bitrate: 5834 kb/s
  
      Stream #0:0: Video: h264 (High 4:4:4 Predictive), yuv422p(progressive), 2880x1800, 30 fps, 30 tbr, 1k tbn, 2000k tbc (default)
  
      Metadata:
  
        ENCODER         : Lavc58.35.100 libx264
  
        DURATION        : 00:00:21.467000000
  
      Stream #0:1: Audio: vorbis, 44100 Hz, stereo, fltp (default)
  
      Metadata:
  
        ENCODER         : Lavc58.35.100 libvorbis
  
        DURATION        : 00:00:21.496000000
  
  Input #1, mp3, from 'music/happy.mp3':
  
    Metadata:
  
      album           : Random
  
      genre           : Jazz & Blues
  
    Duration: 00:15:59.84, start: 0.025057, bitrate: 186 kb/s
  
      Stream #1:0: Audio: mp3, 44100 Hz, stereo, fltp, 186 kb/s
  
      Metadata:
  
        encoder         : LAME3.100
  
  Stream mapping:
  
    Stream #0:1 (vorbis) -> amix:input0
  
    Stream #1:0 (mp3float) -> amix:input1
  
    amix -> Stream #0:0 (libvorbis)
  
    Stream #0:0 -> #0:1 (copy)
  
  Press [q] to stop, [?] for help
  
  Output #0, matroska, to 'finished/2019-06-22/1561246948349/output.mkv':
  
    Metadata:
  
      encoder         : Lavf58.20.100
  
      Stream #0:0: Audio: vorbis (libvorbis) (oV[0][0] / 0x566F), 44100 Hz, stereo, fltp, 144 kb/s (default)
  
      Metadata:
  
        encoder         : Lavc58.35.100 libvorbis
  
      Stream #0:1: Video: h264 (High 4:4:4 Predictive) (H264 / 0x34363248), yuv422p(progressive), 2880x1800, q=2-31, 30 fps, 30 tbr, 1k tbn, 1k tbc (default)
  
      Metadata:
  
        ENCODER         : Lavc58.35.100 libx264
  
        DURATION        : 00:00:21.467000000
  
  frame=  640 fps=0.0 q=-1.0 Lsize=   15227kB time=00:00:21.46 bitrate=5810.3kbits/s speed=33.8x    
  
  video:14888kB audio:318kB subtitle:0kB other streams:0kB global headers:4kB muxing overhead: 0.139864%

• FFMPEG : How to avoid audio/video desync in output of crossfaded clips when input is variable frame rate video

  25 décembre 2018, par Anders Lunde

  I’m doing screen recordings of gameplay (Dota2) using my NVIDIA graphics card GeForce experience hardware recording (NVEC Encoder). This creates a variable frame rate output video. My NVIDIA settings are 60 fps 15000 kbps. I have paid a guy to make a program that generates scripts that given start/stop timepoints can extract clips from the video and merge them with crossfade. See example code below. The script works for many input recordings but fails often : The audio and video are desynchronized (usually audio delay) in many of the clips, ca 0.5 seconds. I think it fails more when frame rate dropped more during recording. He does not know how to fix the problem, and I wonder if anyone could point out if anything could be fixed in the script (example below) ?

  Processing speed is quite important (now making a 10 min ’highlight’ video takes ca 7-10 min). Solutions increasing that amount very much more is not of too big interest, unfortunately. His approach has been to work separately with audio and video and merge in the end. He already has a program to make ffmpeg code for working with different scenarios (also adding overlays, adding music, intro/outro) so it would be preferable with some easy fixes to his code and not dramatic redesigning of the logic. But if nothing else can fix the problem, a redesign in logic is ok. Using other tools than ffmpeg is also ok, but should be automatable (scripts/cli) and not increase processing times too much.

  Running the program "mediainfo" on the input video shows that framerate dropped quite low for this input video :

  Frame rate mode : Variable

  Frame rate : 60.000 FPS

  Minimum frame rate : 3.059 FPS

  Maximum frame rate : 63.739 FPS

  Full report here : https://pastebin.com/TX061Wih

  The input video can be downloaded from dropbox here (6 GB) :
  https://www.dropbox.com/s/ftwdgapazbi62pr/fullgame.mp4?dl=0

  Here the example of a script when asked to extract two clips from input video at 9:57 (41 sec length) and 15:45 (28 sec length) and crossfade merge them with a 0.5 crossfade time. There might be some code-remnants from options that are not used in this example (overlays, music, intro/outro). Using the input video above, this creates audio/video desync.

  6 commands excecuted in sequence :

  ffmpeg.exe -loglevel warning -ss 00:09:57 -i fullgame.mp4 -t 00:00:41 -filter_complex "[0:a]afade=t=out:st=40.5:d=0.5[a1]" -map "[a1]" -y out_temp_00.mp4.wav
  
  
  
  ffmpeg.exe -loglevel warning -i fullgame.mp4 -ss 00:09:57 -t 00:00:41 -an -vcodec copy -f mpegts -avoid_negative_ts make_zero -y out_temp_00.mp4.ts
  
  
  
  ffmpeg.exe -loglevel warning -ss 00:15:45 -i fullgame.mp4 -t 00:00:28 -filter_complex "[0:a]afade=t=in:st=0:d=0.5[a1]" -map "[a1]" -y out_temp_01.mp4.wav
  
  
  
  ffmpeg.exe -loglevel warning -i fullgame.mp4 -ss 00:15:45 -t 00:00:28 -an -vcodec copy -f mpegts -avoid_negative_ts make_zero -y out_temp_01.mp4.ts
  
  
  
  ffmpeg.exe -loglevel warning -i out_temp_00.mp4.wav -i out_temp_01.mp4.wav -y -filter_complex "[0:a]adelay=0|0[a0];[1:a]adelay=40500|40500[a1];[a0][a1]amix=inputs=2:dropout_transition=68.5,atrim=duration=68.5[outa0];[outa0]loudnorm[outa]" -map "[outa]" -ar 48000 -acodec aac -strict -2 fullgame_Output.mp4.aac
  
  
  
  ffmpeg.exe -loglevel warning -i out_temp_00.mp4.ts -i out_temp_01.mp4.ts -y -i fullgame_Output.mp4.aac  -filter_complex "[0:v]trim=start=0.5,setpts=PTS-STARTPTS[0c];[1:v]trim=start=0.5,setpts=PTS-STARTPTS[1c];[0:v]trim=40.5:41,setpts=PTS-STARTPTS[fo];[1:v]trim=0:0.5[fi];[fi]format=pix_fmts=yuva420p,fade=t=in:st=0:d=0.5:alpha=1[z];[fo]format=pix_fmts=yuva420p,fade=t=out:st=0:d=0.5:alpha=1[x];[z]fifo[w];[x]fifo[q];[q][w]overlay[r];[0c][r][1c]concat=n=3[outv]" -map "[outv]" -map 2:a -shortest -acodec copy -vcodec libx264 -preset ultrafast -b 15000k -aspect 1920:1080 fullgame_Output.mp4

  P.S.

  I already asked for help at an ffmpeg chat room. One guy said he knew what the problem was, but didnt know how to fix it(?) :

  [00:10] <kepstin> oh, wait, you're using -vcodec copy
  
  [00:10] <kepstin> that explains everything.
  
  [00:10] <kepstin> when you're using -vcodec copy, the start time (set with -ss) is rounded to the nearest keyframe
  
  [00:10] <kepstin> it's not exact
  
  [00:11] <kepstin> depending on the keyframe interval, this will result in possibly quite large shifts
  
  [00:11] <kepstin> (also, your commands are applying audio filters on commands with -an, which is confusing/contradictory)
  
  [00:12] <birdboy88> so the problem is that the audio temporary clips are not being extracted from the same excat timepoints?
  
  [00:13] <kepstin> birdboy88: yeah, your audio is being re-encoded to wav so it's being cut sample-accurate, but the video's not being precisely cut.
  
  [00:16] <birdboy88> kepstin: so I need to use slow seek (?) to extract video accurately? Or somehow extract audio only where there are video keyframes?
  
  [00:17] <kepstin> birdboy88: i don't know how to extract audio starting at video keyframes with ffmpeg cli. You're already doing slow seek, which doesn't help (you should move the -ss option to before the -i option to speed it up)
  
  [00:17] <kepstin> if you want accurate video cutting when saving to a file, you have to re-encode the video
  
  [00:18] <kepstin> (doing this in a single ffmpeg command means you don't have to save to a file, so you can avoid the issue)
  
  [00:18] * kepstin is off for a bit now
  
  </kepstin></kepstin></kepstin></birdboy88></kepstin></birdboy88></kepstin></kepstin></kepstin></kepstin></kepstin></kepstin>

  EDIT :
  Everything is done with the latest ffmpeg version.

  I was unable to get Gyan’s code to work. It always loses some audio (audio is either 40.5 or 27.5, so only one audio is used). This is the only one working for me (changes were adelay=40500|40500 and amix=inputs=2[a0] ;[a0]loudnorm) :

  ffmpeg -i fullgame.mp4 -filter_complex "[0]split=2[vpre][vpost];
  
  [0]asplit=2[apre][apost];
  
  [vpre]trim=start='00:09:57':duration='00:00:41',setpts=PTS-STARTPTS[vpre-t];
  
  [apre]atrim=start='00:09:57':duration='00:00:41',asetpts=PTS-STARTPTS,afade=t=out:st=40.5:d=0.5[apre-t];
  
  [vpost]trim=start='00:15:45':duration='00:00:28',setpts=PTS-STARTPTS,format=yuva420p,fade=t=in:st=0:d=0.5:alpha=1,setpts=PTS+40.5/TB[vpost-t];
  
  [apost]atrim=start='00:15:45':duration='00:00:28',asetpts=PTS-STARTPTS,afade=t=in:st=0:d=0.5,adelay=40500|40500[apost-t];
  
  [vpre-t][vpost-t]overlay[v];
  
  [apre-t][apost-t]amix=inputs=2[a0];[a0]loudnorm[a]" -map "[v]" -map "[a]" -y -c:v libx264 -preset ultrafast -b:v 15000k -aspect 1920:1080 -c:a aac fullgame_Output.mp4

  Then I tried using a similar setup but with 3 clips, but on one machine I got error : "Error while filtering : Cannot allocate memory". And my 16 GB memory machine the processing speed is 0.02x ! Any way to avoid this ? This is the code I tried :

  ffmpeg -i fullgame.mp4 -filter_complex "[0]split=3[vpre][vpost][v3];
  
  [0]asplit=3[apre][apost][a3];
  
  [vpre]trim=start=357:duration=41,setpts=PTS-STARTPTS[vpre-t];
  
  [apre]atrim=start=357:duration=41,asetpts=PTS-STARTPTS,afade=t=out:st=40.5:d=0.5[apre-t];
  
  [vpost]trim=start=795:duration=28,setpts=PTS-STARTPTS,format=yuva420p,fade=t=in:st=0:d=0.5:alpha=1,fade=t=out:st=40.5:d=0.5:alpha=1,setpts=PTS+40.5/TB[vpost-t];
  
  [apost]atrim=start=795:duration=28,asetpts=PTS-STARTPTS,afade=t=in:st=0:d=0.5,afade=t=out:st=27.5:d=0.5,adelay=40500|40500[apost-t];
  
  [v3]trim=start=95:duration=30,setpts=PTS-STARTPTS,format=yuva420p,fade=t=in:st=0:d=0.5,setpts=PTS+41Û0.5/TB[v3-t];
  
  [a3]atrim=start=95:duration=30,asetpts=PTS-STARTPTS,afade=t=in:st=0:d=0.5,adelay=68500|68500[a3-t];
  
  [vpre-t][vpost-t]overlay[v1];
  
  [v1][v3-t]overlay[v];
  
  [apre-t][apost-t][a3-t]amix=inputs=3[a0];
  
  [a0]loudnorm[a]" -map "[v]" -map "[a]" -y -c:v libx264 -preset ultrafast -b:v 15000k -aspect 1920:1080 -c:a aac fullgame_Output.mp4

• Codec h264_cuvid is not supported

  9 septembre 2019, par gn cavalry

  ======================= Environment =======================
  System : ubuntu 18.04
  Architecture : x86_64
  Display Card : NVIDIA GeForce 820m
  Display Card Driver : NVIDIA-Linux-x86_64-390.87
  gcc : 6.5.0
  CUDA : 9.1.85 (also tried 9.0.176)
  FFmpeg : 3.4 (also tried 4.0, 4.1)

  ==================== FFmpeg Compilation ====================

  ./configure \
  
    --prefix="$DIR_BUILD" \
  
    --bindir="$DIR_BIN" \
  
    --enable-cuda \
  
    --enable-cuvid \
  
    --enable-nvenc \
  
    --enable-nonfree \
  
    --enable-libnpp \
  
    --extra-cflags=-I/usr/local/cuda/include \
  
    --extra-ldflags=-L/usr/local/cuda/lib64

  ======================= Verification =======================
  Driver Verification :
  (I have downgrade my gcc from 7.3 to 6.5, I don’t know why there still shows gcc version 7.3)

  $ cat /proc/driver/nvidia/version
  
  NVRM version: NVIDIA UNIX x86_64 Kernel Module  390.87  Tue Aug 21 12:33:05 PDT 2018
  
  GCC version:  gcc version 7.3.0 (Ubuntu 7.3.0-27ubuntu1~18.04)

  CUDA Verification :

  $nvcc -V
  
  nvcc: NVIDIA (R) Cuda compiler driver
  
  Copyright (c) 2005-2017 NVIDIA Corporation
  
  Built on Fri_Nov__3_21:07:56_CDT_2017
  
  Cuda compilation tools, release 9.1, V9.1.85
  
  
  
  $./deviceQuery
  
  Rsult = PASS
  
  
  
  $./bandwidthTest
  
  Result = PASS

  FFmpeg Decoder Verification :

  $ ffmpeg -codecs | grep cuvid
  
  ffmpeg version 3.4.5 Copyright (c) 2000-2018 the FFmpeg developers
  
    built with gcc 6.5.0 (Ubuntu 6.5.0-2ubuntu1~18.04) 20181026
  
    configuration: --prefix=/home/cavalry/Downloads/compile_ffmpeg/ffmpeg_build --bindir=/home/cavalry/Downloads/compile_ffmpeg/bin --enable-cuda --enable-cuvid --enable-nvenc --enable-nonfree --enable-libnpp --extra-cflags=-I/usr/local/cuda/include --extra-ldflags=-L/usr/local/cuda/lib64
  
    libavutil      55. 78.100 / 55. 78.100
  
    libavcodec     57.107.100 / 57.107.100
  
    libavformat    57. 83.100 / 57. 83.100
  
    libavdevice    57. 10.100 / 57. 10.100
  
    libavfilter     6.107.100 /  6.107.100
  
    libswscale      4.  8.100 /  4.  8.100
  
    libswresample   2.  9.100 /  2.  9.100
  
   DEV.LS h264                 H.264 / AVC / MPEG-4 AVC / MPEG-4 part 10 (decoders: h264 h264_v4l2m2m h264_vdpau h264_cuvid ) (encoders: h264_nvenc h264_v4l2m2m h264_vaapi nvenc nvenc_h264 )
  
   DEV.L. hevc                 H.265 / HEVC (High Efficiency Video Coding) (decoders: hevc hevc_cuvid ) (encoders: nvenc_hevc hevc_nvenc hevc_vaapi )
  
   DEVIL. mjpeg                Motion JPEG (decoders: mjpeg mjpeg_cuvid ) (encoders: mjpeg mjpeg_vaapi )
  
   DEV.L. mpeg1video           MPEG-1 video (decoders: mpeg1video mpeg1video_vdpau mpeg1_v4l2m2m mpeg1_cuvid )
  
   DEV.L. mpeg2video           MPEG-2 video (decoders: mpeg2video mpegvideo mpegvideo_vdpau mpeg2_v4l2m2m mpeg2_cuvid ) (encoders: mpeg2video mpeg2_vaapi )
  
   DEV.L. mpeg4                MPEG-4 part 2 (decoders: mpeg4 mpeg4_v4l2m2m mpeg4_vdpau mpeg4_cuvid ) (encoders: mpeg4 mpeg4_v4l2m2m )
  
   D.V.L. vc1                  SMPTE VC-1 (decoders: vc1 vc1_vdpau vc1_v4l2m2m vc1_cuvid )
  
   DEV.L. vp8                  On2 VP8 (decoders: vp8 vp8_v4l2m2m vp8_cuvid ) (encoders: vp8_v4l2m2m vp8_vaapi )
  
   DEV.L. vp9                  Google VP9 (decoders: vp9 vp9_v4l2m2m vp9_cuvid ) (encoders: vp9_vaapi )

  FFmpeg Encoder Verification :

  $ ffmpeg -codecs | grep nvenc 
  
  ffmpeg version 3.4.5 Copyright (c) 2000-2018 the FFmpeg developers
  
    built with gcc 6.5.0 (Ubuntu 6.5.0-2ubuntu1~18.04) 20181026
  
    configuration: --prefix=/home/cavalry/Downloads/compile_ffmpeg/ffmpeg_build --bindir=/home/cavalry/Downloads/compile_ffmpeg/bin --enable-cuda --enable-cuvid --enable-nvenc --enable-nonfree --enable-libnpp --extra-cflags=-I/usr/local/cuda/include --extra-ldflags=-L/usr/local/cuda/lib64
  
    libavutil      55. 78.100 / 55. 78.100
  
    libavcodec     57.107.100 / 57.107.100
  
    libavformat    57. 83.100 / 57. 83.100
  
    libavdevice    57. 10.100 / 57. 10.100
  
    libavfilter     6.107.100 /  6.107.100
  
    libswscale      4.  8.100 /  4.  8.100
  
    libswresample   2.  9.100 /  2.  9.100
  
   DEV.LS h264                 H.264 / AVC / MPEG-4 AVC / MPEG-4 part 10 (decoders: h264 h264_v4l2m2m h264_vdpau h264_cuvid ) (encoders: h264_nvenc h264_v4l2m2m h264_vaapi nvenc nvenc_h264 )
  
   DEV.L. hevc                 H.265 / HEVC (High Efficiency Video Coding) (decoders: hevc hevc_cuvid ) (encoders: nvenc_hevc hevc_nvenc hevc_vaapi )

  ================== Exec ffmepg command line ===================

  All things seem goes right, then I executed the following command :
  ffmpeg -c:v h264_cuvid -i ./holidy.mp4 output.mkv
  But it turns out :
  [h264_cuvid @ 0x55f93a512200] Codec h264_cuvid is not supported.

  Here is the whole information :

  $ ffmpeg -c:v h264_cuvid -i ./holidy.mp4 output.mkv
  
  ffmpeg version 3.4.5 Copyright (c) 2000-2018 the FFmpeg developers
  
    built with gcc 6.5.0 (Ubuntu 6.5.0-2ubuntu1~18.04) 20181026
  
    configuration: --prefix=/home/cavalry/Downloads/compile_ffmpeg/ffmpeg_build --bindir=/home/cavalry/Downloads/compile_ffmpeg/bin --enable-cuda --enable-cuvid --enable-nvenc --enable-nonfree --enable-libnpp --extra-cflags=-I/usr/local/cuda/include --extra-ldflags=-L/usr/local/cuda/lib64
  
    libavutil      55. 78.100 / 55. 78.100
  
    libavcodec     57.107.100 / 57.107.100
  
    libavformat    57. 83.100 / 57. 83.100
  
    libavdevice    57. 10.100 / 57. 10.100
  
    libavfilter     6.107.100 /  6.107.100
  
    libswscale      4.  8.100 /  4.  8.100
  
    libswresample   2.  9.100 /  2.  9.100
  
  Input #0, mov,mp4,m4a,3gp,3g2,mj2, from './holidy.mp4':
  
    Metadata:
  
      major_brand     : isom
  
      minor_version   : 1
  
      compatible_brands: isomavc1iso6
  
      creation_time   : 2018-01-29T09:18:23.000000Z
  
      album           : Yinyuetai
  
      artist          : yinyuetai.com
  
      comment         : Yinyuetai-1TR1166
  
      date            : 01/29/18 17:18:23
  
    Duration: 00:04:15.21, start: 0.000000, bitrate: 4210 kb/s
  
      Stream #0:0(und): Video: h264 (High) (avc1 / 0x31637661), yuv420p, 1920x1080, 4087 kb/s, 24 fps, 24 tbr, 24k tbn, 48 tbc (default)
  
      Metadata:
  
        creation_time   : 2018-01-29T09:18:23.000000Z
  
        handler_name    : 264@GPAC0.5.1-DEV-rev5472
  
      Stream #0:1(und): Audio: aac (LC) (mp4a / 0x6134706D), 44100 Hz, stereo, fltp, 120 kb/s (default)
  
      Metadata:
  
        creation_time   : 2018-01-29T09:17:31.000000Z
  
        handler_name    : Sound Media Handler
  
  [h264_cuvid @ 0x55f3e05ca1c0] Codec h264_cuvid is not supported.
  
  Stream mapping:
  
    Stream #0:0 -> #0:0 (h264 (h264_cuvid) -> mpeg4 (native))
  
    Stream #0:1 -> #0:1 (aac (native) -> ac3 (native))
  
  Error while opening decoder for input stream #0:0 : Invalid argument

  I have tried width CUDA9.0, CUDA9.1, FFmpeg3.4, FFmpeg4.0, FFmpeg 4.1, but it reports the same error. Can anyone help me ? I will appreciate you greatly !