Recherche avancée

Sur d’autres sites (3889)

• Programming filter_complex graph in ffmpeg to enable 'overaly_cuda' with transparency in input frames [closed]

  16 mai 2023, par time4tea

  I'm trying to overlay a full frame image on top of an MP4, in ffmpeg, using as much hardware-assistance as possible.

  


  This is for https://github.com/time4tea/gopro-dashboard-overlay

  


  I have the non-GPU overlay working totally fine, and would like to take advantage of the GPU now.

  


  The inputs to ffmpeg are :

  


  

  • a stream from an MP4 file - with 1 audio and 1 video stream

  


  • frames from the dashboard software, which are supplied as raw RGBA frames, at the same frame size as the movie.

  


  


  I've managed to get the overlay sort of working using the nvidia extensions, but it doesn't work as it uses nv12 frame formats which don't have any idea of transparency (AFAIK) so the overlaid frame completely obscures the movie frame - makes sense.

  


  The incantation that does this is (put on separate lines to try to keep the different sections - inputs / transforms / outputs - obvious) :

  


  ffmpeg -y -report -hide_banner -loglevel info 
-hwaccel cuda -hwaccel_output_format cuda 
-i movie.mp4 
-f rawvideo -framerate 10.0 -s 1024x576 -pix_fmt rgba -i - 
-filter_complex [0:v]null[mp4_stream];[1:v]format=nv12,hwupload_cuda[overlay_stream];[mp4_stream][overlay_stream]overlay_cuda,hwdownload,format=nv12 
-vcodec h264_nvenc 
-rc:v cbr -b:v 20M -bf:v 3 -profile:v high -spatial-aq true 
-movflags faststart 
output.mp4


  


  When i try to use yuva420p (which I believe is the correct format, but happy to be corrected) - in all various different places, for example :

  


  ffmpeg -y -report -hide_banner -loglevel info 
-hwaccel cuda -hwaccel_output_format yuva420p 
-i movie.mp4 
-f rawvideo -framerate 10.0 -s 1024x576 -pix_fmt rgba -i - 
-filter_complex [0:v]null[mp4_stream];[1:v]format=yuva420p,hwupload_cuda[overlay_stream];[mp4_stream][overlay_stream]overlay_cuda,hwdownload,format=yuva420p -vcodec h264_nvenc 
-rc:v cbr -b:v 20M -bf:v 3 -profile:v high -spatial-aq true -movflags faststart output.mp4


  


  I get flavours of the same error message :

  


  Impossible to convert between the formats supported by the filter 'Parsed_null_0' and the filter 'auto_scaler_1'


  


  AIUI - auto scalers are inserted into the pipeline when things don't match resolutions or formats - but here everything should match ?

  


  Using a filter_complex of [1:v]format=yuva420p,hwupload_cuda[overlay_stream];[0:v][overlay_stream]overlay_cuda,hwdownload,format=yuva420p i.e not using a null filter, which I put in just to make quickly changing filters easy, has the same error.

  


  Impossible to convert between the formats supported by the filter 'graph 0 input from stream 0:0' and the filter 'auto_scaler_1'


  


• avutil/hwcontext_cuda : Define and use common CHECK_CU()

  11 novembre 2018, par Philip Langdale

  avutil/hwcontext_cuda : Define and use common CHECK_CU()
  We have a pattern of wrapping CUDA calls to print errors and
  
  normalise return values that is used in a couple of places. To
  
  avoid duplication and increase consistency, let's put the wrapper
  
  implementation in a shared place and use it everywhere.
  Affects :
  * avcodec/cuviddec
  
  * avcodec/nvdec
  
  * avcodec/nvenc
  
  * avfilter/vf_scale_cuda
  
  * avfilter/vf_scale_npp
  
  * avfilter/vf_thumbnail_cuda
  
  * avfilter/vf_transpose_npp
  
  * avfilter/vf_yadif_cuda
  

  • [DH] libavcodec/Makefile
  • [DH] libavcodec/cuda_check.c
  • [DH] libavcodec/cuviddec.c
  • [DH] libavcodec/nvdec.c
  • [DH] libavcodec/nvenc.c
  • [DH] libavfilter/Makefile
  • [DH] libavfilter/cuda_check.c
  • [DH] libavfilter/vf_scale_cuda.c
  • [DH] libavfilter/vf_scale_npp.c
  • [DH] libavfilter/vf_thumbnail_cuda.c
  • [DH] libavfilter/vf_transpose_npp.c
  • [DH] libavfilter/vf_yadif_cuda.c
  • [DH] libavutil/Makefile
  • [DH] libavutil/cuda_check.c
  • [DH] libavutil/cuda_check.h
  • [DH] libavutil/hwcontext_cuda.c

• Loop overlay input video

  30 novembre 2017, par Janis S.

  I use ffmpeg command to overlay one video over the other.
  The shortest in2.mp4 is 30s and I would like to repeat it until the longest in1.avi stops. With the following command, shortest is overlaid once and longest continues until its end.

  ffmpeg -i in1.avi -i in2.mp4 -filter_complex "[0:v]setpts=PTS-STARTPTS, scale=1920x1080[top];[1:v]setpts=PTS-STARTPTS, scale=1920x1080, format=yuva420p, colorchannelmixer=aa=0.5[bottom]; [top][bottom]overlay=shortest=0" -acodec libvo_aacenc -vcodec libx264 out.mp4

  I have tried to place loop=-1 in various places after -filter_complex but get an error

  No such filter: 'loop' Error initializing complex filters. Invalid argument

  Complete output :

  ffmpeg -i in1.avi -i in2.mp4 -filter_complex "[0:v]setpts=PTS-STARTPTS, scale=1920x1080[top];[1:v]setpts=PTS-STARTPTS, scale=1920x1080, format=yuva420p, colorchannelmixer=aa=0.5,loop=-1[bottom]; [top][bottom]overlay=shortest=0" -acodec libvo_aacenc -vcodec libx264 out.mp4
  
  ffmpeg version 2.8.4 Copyright (c) 2000-2015 the FFmpeg developers   built with gcc 5.2.0 (GCC)   configuration: --enable-gpl
  
  --enable-version3 --disable-w32threads --enable-avisynth --enable-bzlib --enable-fontconfig --enable-frei0r --enable-gnutls --enable-iconv --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libdcadec --enable-libfreetype --enable-libgme --enable-libgsm --enable-libilbc --enable-libmodplug --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable-libopus --enable-librtmp --enable-libschroedinger --enable-libsoxr --enable-libspeex --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvo-aacenc --enable-libvo-amrwbenc --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxavs --enable-libxvid --enable-lzma --enable-decklink --enable-zlib   libavutil      54. 31.100 / 54. 31.100   libavcodec     56. 60.100 /
  
  56. 60.100   libavformat    56. 40.101 / 56. 40.101   libavdevice    56.  4.100 / 56.  4.100   libavfilter     5. 40.101 /  5. 40.101   libswscale      3.  1.101 /  3.  1.101   libswresample   1.  2.101 / 
  
  1.  2.101   libpostproc    53.  3.100 / 53.  3.100 Input #0, avi, from 'in1.avi':   Metadata:
  
      encoder         : Lavf57.32.100   Duration: 00:03:03.28, start: 0.000000, bitrate: 3003 kb/s
  
      Stream #0:0: Video: h264 (High 4:4:4 Predictive) (H264 / 0x34363248), yuv444p, 1920x1080 [SAR 1:1 DAR 16:9], 160 kb/s, 25 fps, 25 tbr, 25 tbn, 50 tbc
  
      Stream #0:1: Audio: pcm_f32le ([3][0][0][0] / 0x0003), 44100 Hz, stereo, flt, 2822 kb/s Input #1, mov,mp4,m4a,3gp,3g2,mj2, from 'in2.mp4':   Metadata:
  
      major_brand     : mp42
  
      minor_version   : 0
  
      compatible_brands: mp42mp41isomavc1
  
      creation_time   : 2016-11-05 17:25:45   Duration: 00:00:15.02, start: 0.000000, bitrate: 4071 kb/s
  
      Stream #1:0(und): Video: h264 (High) (avc1 / 0x31637661), yuv420p(tv, bt709), 1920x1080 [SAR 1:1 DAR 16:9], 3815 kb/s, 25 fps, 25 tbr, 25 tbn, 50 tbc (default)
  
      Metadata:
  
        creation_time   : 2016-11-05 17:25:45
  
        handler_name    : L-SMASH Video Handler
  
        encoder         : AVC Coding
  
      Stream #1:1(und): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, stereo, fltp, 255 kb/s (default)
  
      Metadata:
  
        creation_time   : 2016-11-05 17:25:45
  
        handler_name    : L-SMASH Audio Handler [AVFilterGraph @ 056a41e0] No such filter: 'loop' Error initializing complex filters. Invalid argument